2024-05-08T20:40:33.526 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T20:40:33.527 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020 --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/orig.config.yaml 2024-05-08T20:40:33.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T20:40:33.658 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} email: pdonnell@redhat.com first_in_suite: false job_id: '7698020' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: lockdep: true mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWeTGKbrhZWvNv7x3CapaYIVaVhS8SiySqxyjilj7FnkWc2d7rnEokVy7GzUb5ZDdngAbq2o8FTcchGnSv8qWs= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM74K1Ppy/lIRFHCHQ8hBRXr6oRY71yh6kA6mVl71E5cIN7C2DbWnutUqRF/gpU8BvgsmHgLI3g6xPXR81VWBtU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T20:40:33.658 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T20:40:33.658 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T20:40:33.659 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T20:40:33.660 INFO:teuthology.task.internal:Checking packages... 2024-05-08T20:40:33.684 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T20:40:33.684 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T20:40:33.685 INFO:teuthology.packaging:ref: None 2024-05-08T20:40:33.685 INFO:teuthology.packaging:tag: None 2024-05-08T20:40:33.685 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:40:33.685 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:40:33.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:40:33.832 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T20:40:33.833 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T20:40:33.838 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T20:40:33.838 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T20:40:33.843 INFO:teuthology.task.internal:Saving configuration 2024-05-08T20:40:33.860 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T20:40:33.864 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T20:40:33.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:35:25.823074', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWeTGKbrhZWvNv7x3CapaYIVaVhS8SiySqxyjilj7FnkWc2d7rnEokVy7GzUb5ZDdngAbq2o8FTcchGnSv8qWs='} 2024-05-08T20:40:33.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:35:25.824685', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM74K1Ppy/lIRFHCHQ8hBRXr6oRY71yh6kA6mVl71E5cIN7C2DbWnutUqRF/gpU8BvgsmHgLI3g6xPXR81VWBtU='} 2024-05-08T20:40:33.913 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T20:40:33.919 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-08T20:40:33.919 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-08T20:40:33.919 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T20:40:33.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcf81e92160>, signals=[15]) 2024-05-08T20:40:33.991 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T20:40:33.997 INFO:teuthology.task.internal:Opening connections... 2024-05-08T20:40:33.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T20:40:33.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:40:34.072 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T20:40:34.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:40:34.143 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T20:40:34.148 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-05-08T20:40:34.169 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-05-08T20:40:34.169 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-05-08T20:40:34.225 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T20:40:34.225 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T20:40:34.225 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2024-05-08T20:40:34.225 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T20:40:34.226 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T20:40:34.227 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-05-08T20:40:34.248 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-05-08T20:40:34.268 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-05-08T20:40:34.268 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-05-08T20:40:34.327 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T20:40:34.327 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T20:40:34.327 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2024-05-08T20:40:34.327 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2024-05-08T20:40:34.327 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2024-05-08T20:40:34.327 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2024-05-08T20:40:34.327 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T20:40:34.328 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T20:40:34.328 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-05-08T20:40:34.348 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T20:40:34.356 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T20:40:34.361 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T20:40:34.361 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:40:34.363 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:40:34.386 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T20:40:34.391 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T20:40:34.391 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:40:34.421 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:40:34.457 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T20:40:34.509 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T20:40:34.524 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T20:40:34.524 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T20:40:34.524 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:40:34.525 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:40:34.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:40:34.544 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2024-05-08T20:40:34.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:40:34.545 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-05-08T20:40:34.604 INFO:teuthology.orchestra.run.smithi183.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:34.604 INFO:teuthology.orchestra.run.smithi135.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:34.604 INFO:teuthology.task.kernel:Running kernel on smithi183: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:34.604 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2024-05-08T20:40:34.605 INFO:teuthology.task.kernel:Running kernel on smithi135: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:34.605 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-05-08T20:40:36.137 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2024-05-08T20:40:36.137 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2024-05-08T20:40:36.183 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T20:40:36.183 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2024-05-08T20:40:36.438 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:40:36.438 INFO:teuthology.orchestra.run.smithi183.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:40:36.438 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:40:36.476 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:40:36.476 INFO:teuthology.orchestra.run.smithi135.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:40:36.476 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:40:38.181 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-05-08T20:40:38.292 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-05-08T20:40:39.218 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-05-08T20:40:41.157 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 16 MB 00:02 2024-05-08T20:40:42.818 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 509 kB/s | 24 kB 00:00 2024-05-08T20:40:43.562 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T20:40:43.562 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T20:40:43.639 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T20:40:43.640 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-05-08T20:40:43.640 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T20:40:43.792 DEBUG:teuthology.orchestra.run.smithi135:> echo no | sudo yum reinstall kernel || true 2024-05-08T20:40:44.129 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T20:40:44.129 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2024-05-08T20:40:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:40:44.333 INFO:teuthology.orchestra.run.smithi135.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:40:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:40:44.642 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 08:40:42 PM UTC. 2024-05-08T20:40:44.731 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T20:40:44.737 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T20:40:44.748 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 425 kB/s | 24 kB 00:00 2024-05-08T20:40:44.777 INFO:teuthology.orchestra.run.smithi135.stderr:Error: No packages marked for reinstall. 2024-05-08T20:40:44.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum reinstall -y kernel || true 2024-05-08T20:40:45.160 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T20:40:45.160 INFO:teuthology.orchestra.run.smithi135.stdout:Unable to read consumer identity 2024-05-08T20:40:45.419 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:40:45.419 INFO:teuthology.orchestra.run.smithi135.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:40:45.419 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:40:45.501 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T20:40:45.501 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T20:40:45.580 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-05-08T20:40:45.581 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-05-08T20:40:45.581 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-05-08T20:40:45.705 DEBUG:teuthology.orchestra.run.smithi183:> echo no | sudo yum reinstall kernel || true 2024-05-08T20:40:45.722 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 08:40:42 PM UTC. 2024-05-08T20:40:45.785 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T20:40:45.785 INFO:teuthology.orchestra.run.smithi135.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T20:40:45.817 INFO:teuthology.orchestra.run.smithi135.stderr:Error: No packages marked for reinstall. 2024-05-08T20:40:45.866 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T20:40:46.034 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:46.034 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:46.034 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T20:40:46.034 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T20:40:46.034 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T20:40:46.041 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2024-05-08T20:40:46.041 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2024-05-08T20:40:46.065 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-05-08T20:40:46.082 DEBUG:teuthology.parallel:result is None 2024-05-08T20:40:46.249 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:40:46.249 INFO:teuthology.orchestra.run.smithi183.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:40:46.249 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:40:46.557 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 08:40:44 PM UTC. 2024-05-08T20:40:46.631 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T20:40:46.639 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T20:40:46.706 INFO:teuthology.orchestra.run.smithi183.stderr:Error: No packages marked for reinstall. 2024-05-08T20:40:46.754 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum reinstall -y kernel || true 2024-05-08T20:40:47.091 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2024-05-08T20:40:47.091 INFO:teuthology.orchestra.run.smithi183.stdout:Unable to read consumer identity 2024-05-08T20:40:47.349 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:40:47.350 INFO:teuthology.orchestra.run.smithi183.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T20:40:47.350 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:40:47.650 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 08:40:44 PM UTC. 2024-05-08T20:40:47.719 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T20:40:47.719 INFO:teuthology.orchestra.run.smithi183.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T20:40:47.745 INFO:teuthology.orchestra.run.smithi183.stderr:Error: No packages marked for reinstall. 2024-05-08T20:40:47.792 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T20:40:47.985 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:47.986 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T20:40:47.986 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T20:40:47.986 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-08T20:40:47.986 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T20:40:48.022 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2024-05-08T20:40:48.037 DEBUG:teuthology.parallel:result is None 2024-05-08T20:40:48.038 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T20:40:48.046 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T20:40:48.047 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:40:48.049 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:40:48.095 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T20:40:48.101 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T20:40:48.108 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T20:40:48.108 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:40:48.110 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:40:48.161 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T20:40:48.168 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T20:40:48.168 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:40:48.185 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:40:48.223 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:40:48.224 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:40:48.234 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:40:48.236 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:40:48.237 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T20:40:48.243 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T20:40:48.244 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:40:48.280 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:40:48.309 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T20:40:48.317 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T20:40:48.318 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:40:48.352 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:40:48.369 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:40:48.455 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:40:48.509 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:40:48.592 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:40:48.637 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:40:48.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:40:48.704 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:40:48.740 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:40:48.797 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:40:48.880 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:40:48.922 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:40:48.923 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:40:48.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-05-08T20:40:48.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-05-08T20:40:49.035 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:40:49.070 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:40:49.544 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T20:40:49.555 INFO:teuthology.task.internal:Starting timer... 2024-05-08T20:40:49.555 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T20:40:49.569 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T20:40:49.578 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T20:40:49.579 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-05-08T20:40:49.630 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-05-08T20:40:49.632 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-05-08T20:40:49.692 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-05-08T20:40:49.694 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T20:40:49.694 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-05-08T20:40:49.715 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-05-08T20:40:49.716 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-05-08T20:40:49.742 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-05-08T20:40:49.742 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2024-05-08T20:40:49.743 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:40:49.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:40:49.785 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:40:49.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:40:49.812 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T20:40:49.812 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-05-08T20:40:49.860 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-05-08T20:40:49.887 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T20:40:49.898 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T20:40:49.914 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T20:40:49.915 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi135.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T20:51:05.694 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2024-05-08T20:51:05.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T20:51:05.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:51:05.778 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-05-08T20:51:05.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-05-08T20:51:05.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T20:51:05.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:51:05.918 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-05-08T20:51:05.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-05-08T20:51:05.989 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T20:51:05.999 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T20:51:05.999 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T20:51:06.000 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:51:06.002 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T20:51:06.002 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:51:06.033 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T20:51:06.048 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T20:51:06.062 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T20:51:06.077 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T20:51:06.116 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-05-08T20:51:06.127 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-05-08T20:51:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T20:51:06.156 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T20:51:06.164 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-05-08T20:51:06.176 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-05-08T20:51:06.192 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T20:51:06.206 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T20:51:06.224 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2024-05-08T20:51:06.227 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T20:51:06.228 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-08T20:51:06.228 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.228 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.228 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.228 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.282 INFO:teuthology.orchestra.run.smithi183.stderr:bash: ntpq: command not found 2024-05-08T20:51:06.285 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T20:51:06.285 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-05-08T20:51:06.285 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.285 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.285 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.285 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:51:06.286 INFO:teuthology.run_tasks:Running task install... 2024-05-08T20:51:06.294 DEBUG:teuthology.task.install:project ceph 2024-05-08T20:51:06.295 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T20:51:06.295 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T20:51:06.295 INFO:teuthology.task.install:Using flavor: default 2024-05-08T20:51:06.300 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T20:51:06.301 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T20:51:06.301 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T20:51:06.301 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:51:06.303 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T20:51:06.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:51:06.457 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T20:51:06.457 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T20:51:06.462 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T20:51:06.462 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T20:51:06.630 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T20:51:06.630 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:51:06.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T20:51:06.632 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T20:51:06.633 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:51:06.633 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T20:51:06.660 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T20:51:06.661 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T20:51:06.662 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T20:51:06.662 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T20:51:06.729 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T20:51:06.730 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T20:51:06.807 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T20:51:06.808 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T20:51:06.874 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-05-08T20:51:06.875 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-05-08T20:51:06.875 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-05-08T20:51:06.876 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-05-08T20:51:07.252 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2024-05-08T20:51:07.253 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T20:51:08.580 INFO:teuthology.orchestra.run.smithi183.stdout:63 files removed 2024-05-08T20:51:08.631 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T20:51:08.638 INFO:teuthology.orchestra.run.smithi135.stdout:63 files removed 2024-05-08T20:51:08.690 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T20:51:08.967 INFO:teuthology.orchestra.run.smithi183.stdout:Updating Subscription Management repositories. 2024-05-08T20:51:09.026 INFO:teuthology.orchestra.run.smithi135.stdout:Updating Subscription Management repositories. 2024-05-08T20:51:10.655 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 231 kB/s | 80 kB 00:00 2024-05-08T20:51:10.802 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 202 kB/s | 80 kB 00:00 2024-05-08T20:51:10.980 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-05-08T20:51:11.102 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-05-08T20:51:11.298 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-05-08T20:51:11.395 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2024-05-08T20:51:11.474 INFO:teuthology.orchestra.run.smithi183.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-05-08T20:51:11.545 INFO:teuthology.orchestra.run.smithi135.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-05-08T20:51:12.338 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2024-05-08T20:51:13.210 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 16 MB 00:01 2024-05-08T20:51:15.946 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 417 kB/s | 24 kB 00:00 2024-05-08T20:51:16.623 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-05-08T20:51:16.774 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 389 kB/s | 24 kB 00:00 2024-05-08T20:51:17.551 INFO:teuthology.orchestra.run.smithi183.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 12 MB/s | 8.8 MB 00:00 2024-05-08T20:51:19.424 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 61 MB 00:01 2024-05-08T20:51:20.311 INFO:teuthology.orchestra.run.smithi183.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 51 MB/s | 61 MB 00:01 2024-05-08T20:51:31.057 INFO:teuthology.orchestra.run.smithi135.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 67 MB 00:01 2024-05-08T20:51:31.785 INFO:teuthology.orchestra.run.smithi183.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 67 MB 00:01 2024-05-08T20:51:46.115 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T20:51:46.116 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T20:51:46.135 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T20:51:46.137 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T20:51:46.138 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T20:51:46.140 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T20:51:46.143 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T20:51:46.147 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T20:51:46.149 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T20:51:46.372 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-05-08T20:51:46.386 INFO:teuthology.orchestra.run.smithi135.stdout:=================================================================================================================================== 2024-05-08T20:51:46.386 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-05-08T20:51:46.386 INFO:teuthology.orchestra.run.smithi135.stdout:=================================================================================================================================== 2024-05-08T20:51:46.386 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-05-08T20:51:46.386 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T20:51:46.386 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T20:51:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T20:51:46.388 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T20:51:46.389 INFO:teuthology.orchestra.run.smithi135.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T20:51:46.390 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T20:51:46.391 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T20:51:46.392 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T20:51:46.393 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T20:51:46.394 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T20:51:46.395 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T20:51:46.396 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T20:51:46.397 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling module streams: 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql 10 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout:=================================================================================================================================== 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout:Install 130 Packages 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 16 Packages 2024-05-08T20:51:46.398 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:51:46.399 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 215 M 2024-05-08T20:51:46.399 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-05-08T20:51:46.855 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T20:51:46.856 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T20:51:46.875 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T20:51:46.876 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T20:51:46.877 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T20:51:46.879 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T20:51:46.882 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T20:51:46.886 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T20:51:46.887 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T20:51:46.932 INFO:teuthology.orchestra.run.smithi135.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2024-05-08T20:51:47.103 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-05-08T20:51:47.117 INFO:teuthology.orchestra.run.smithi183.stdout:=================================================================================================================================== 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout:=================================================================================================================================== 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T20:51:47.118 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T20:51:47.119 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T20:51:47.120 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T20:51:47.121 INFO:teuthology.orchestra.run.smithi183.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-05-08T20:51:47.122 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T20:51:47.123 INFO:teuthology.orchestra.run.smithi183.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T20:51:47.124 INFO:teuthology.orchestra.run.smithi183.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T20:51:47.125 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T20:51:47.126 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T20:51:47.127 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T20:51:47.128 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T20:51:47.129 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout:Enabling module streams: 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql 10 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout:=================================================================================================================================== 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout:Install 130 Packages 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 16 Packages 2024-05-08T20:51:47.130 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:51:47.131 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 215 M 2024-05-08T20:51:47.131 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-05-08T20:51:47.402 INFO:teuthology.orchestra.run.smithi183.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2024-05-08T20:51:47.407 INFO:teuthology.orchestra.run.smithi135.stdout:(2/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 8.5 MB/s | 5.5 MB 00:00 2024-05-08T20:51:47.474 INFO:teuthology.orchestra.run.smithi135.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 2.4 MB/s | 166 kB 00:00 2024-05-08T20:51:47.783 INFO:teuthology.orchestra.run.smithi135.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 7.4 MB/s | 2.3 MB 00:00 2024-05-08T20:51:48.017 INFO:teuthology.orchestra.run.smithi135.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 6.7 MB/s | 1.6 MB 00:00 2024-05-08T20:51:48.042 INFO:teuthology.orchestra.run.smithi135.stdout:(6/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 775 kB/s | 860 kB 00:01 2024-05-08T20:51:48.293 INFO:teuthology.orchestra.run.smithi183.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 965 kB/s | 860 kB 00:00 2024-05-08T20:51:48.367 INFO:teuthology.orchestra.run.smithi135.stdout:(7/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 13 MB/s | 22 MB 00:01 2024-05-08T20:51:48.394 INFO:teuthology.orchestra.run.smithi183.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 1.6 MB/s | 166 kB 00:00 2024-05-08T20:51:48.459 INFO:teuthology.orchestra.run.smithi135.stdout:(8/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 11 MB/s | 4.8 MB 00:00 2024-05-08T20:51:48.526 INFO:teuthology.orchestra.run.smithi135.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 366 kB/s | 24 kB 00:00 2024-05-08T20:51:49.326 INFO:teuthology.orchestra.run.smithi135.stdout:(10/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 14 MB/s | 13 MB 00:00 2024-05-08T20:51:49.401 INFO:teuthology.orchestra.run.smithi135.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 3.4 MB/s | 261 kB 00:00 2024-05-08T20:51:49.468 INFO:teuthology.orchestra.run.smithi135.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 464 kB/s | 31 kB 00:00 2024-05-08T20:51:49.568 INFO:teuthology.orchestra.run.smithi135.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 7.6 MB/s | 782 kB 00:00 2024-05-08T20:51:49.636 INFO:teuthology.orchestra.run.smithi135.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 2.1 MB/s | 142 kB 00:00 2024-05-08T20:51:49.702 INFO:teuthology.orchestra.run.smithi135.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 2.0 MB/s | 139 kB 00:00 2024-05-08T20:51:49.786 INFO:teuthology.orchestra.run.smithi135.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 5.6 MB/s | 474 kB 00:00 2024-05-08T20:51:50.169 INFO:teuthology.orchestra.run.smithi183.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.3 MB/s | 2.3 MB 00:01 2024-05-08T20:51:50.370 INFO:teuthology.orchestra.run.smithi135.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 11 MB/s | 6.5 MB 00:00 2024-05-08T20:51:50.436 INFO:teuthology.orchestra.run.smithi135.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 671 kB/s | 45 kB 00:00 2024-05-08T20:51:50.512 INFO:teuthology.orchestra.run.smithi135.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.7 MB/s | 129 kB 00:00 2024-05-08T20:51:50.595 INFO:teuthology.orchestra.run.smithi135.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 2.3 MB/s | 197 kB 00:00 2024-05-08T20:51:50.679 INFO:teuthology.orchestra.run.smithi135.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 4.4 MB/s | 370 kB 00:00 2024-05-08T20:51:50.763 INFO:teuthology.orchestra.run.smithi135.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 4.3 MB/s | 365 kB 00:00 2024-05-08T20:51:50.838 INFO:teuthology.orchestra.run.smithi135.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.4 MB/s | 107 kB 00:00 2024-05-08T20:51:50.905 INFO:teuthology.orchestra.run.smithi135.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.4 MB/s | 95 kB 00:00 2024-05-08T20:51:51.053 INFO:teuthology.orchestra.run.smithi183.stdout:(5/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 1.4 MB/s | 5.5 MB 00:03 2024-05-08T20:51:51.115 INFO:teuthology.orchestra.run.smithi183.stdout:(6/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 1.6 MB/s | 1.6 MB 00:00 2024-05-08T20:51:51.263 INFO:teuthology.orchestra.run.smithi135.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 9.6 MB/s | 3.5 MB 00:00 2024-05-08T20:51:51.347 INFO:teuthology.orchestra.run.smithi135.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 2.1 MB/s | 181 kB 00:00 2024-05-08T20:51:51.422 INFO:teuthology.orchestra.run.smithi135.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 324 kB/s | 24 kB 00:00 2024-05-08T20:51:51.498 INFO:teuthology.orchestra.run.smithi135.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.8 MB/s | 138 kB 00:00 2024-05-08T20:51:52.090 INFO:teuthology.orchestra.run.smithi135.stdout:(29/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 13 MB/s | 47 MB 00:03 2024-05-08T20:51:52.165 INFO:teuthology.orchestra.run.smithi135.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 5.3 MB/s | 3.5 MB 00:00 2024-05-08T20:51:52.249 INFO:teuthology.orchestra.run.smithi135.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 2.9 MB/s | 245 kB 00:00 2024-05-08T20:51:52.340 INFO:teuthology.orchestra.run.smithi135.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 536 kB/s | 49 kB 00:00 2024-05-08T20:51:52.416 INFO:teuthology.orchestra.run.smithi135.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 218 kB/s | 16 kB 00:00 2024-05-08T20:51:52.499 INFO:teuthology.orchestra.run.smithi135.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 3.1 MB/s | 263 kB 00:00 2024-05-08T20:51:52.600 INFO:teuthology.orchestra.run.smithi135.stdout:(35/146): ceph-mgr-diskprediction-local-18.2.2- 15 MB/s | 7.4 MB 00:00 2024-05-08T20:51:52.625 INFO:teuthology.orchestra.run.smithi135.stdout:(36/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 1.3 MB/s | 170 kB 00:00 2024-05-08T20:51:52.641 INFO:teuthology.orchestra.run.smithi135.stdout:(37/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 435 kB/s | 18 kB 00:00 2024-05-08T20:51:52.678 INFO:teuthology.orchestra.run.smithi183.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 3.0 MB/s | 4.8 MB 00:01 2024-05-08T20:51:52.884 INFO:teuthology.orchestra.run.smithi135.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 243 kB/s | 59 kB 00:00 2024-05-08T20:51:52.984 INFO:teuthology.orchestra.run.smithi135.stdout:(39/146): gperftools-libs-2.7-9.el8.x86_64.rpm 853 kB/s | 306 kB 00:00 2024-05-08T20:51:53.018 INFO:teuthology.orchestra.run.smithi135.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 561 kB/s | 75 kB 00:00 2024-05-08T20:51:53.101 INFO:teuthology.orchestra.run.smithi135.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 524 kB/s | 44 kB 00:00 2024-05-08T20:51:53.126 INFO:teuthology.orchestra.run.smithi135.stdout:(42/146): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2024-05-08T20:51:53.210 INFO:teuthology.orchestra.run.smithi135.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 396 kB/s | 33 kB 00:00 2024-05-08T20:51:53.236 INFO:teuthology.orchestra.run.smithi135.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2024-05-08T20:51:53.286 INFO:teuthology.orchestra.run.smithi135.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2024-05-08T20:51:53.327 INFO:teuthology.orchestra.run.smithi135.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-05-08T20:51:53.395 INFO:teuthology.orchestra.run.smithi135.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2024-05-08T20:51:53.420 INFO:teuthology.orchestra.run.smithi135.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 883 kB/s | 81 kB 00:00 2024-05-08T20:51:53.478 INFO:teuthology.orchestra.run.smithi135.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2024-05-08T20:51:53.512 INFO:teuthology.orchestra.run.smithi135.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2024-05-08T20:51:53.637 INFO:teuthology.orchestra.run.smithi135.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 389 kB/s | 49 kB 00:00 2024-05-08T20:51:53.671 INFO:teuthology.orchestra.run.smithi135.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2024-05-08T20:51:53.730 INFO:teuthology.orchestra.run.smithi135.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2024-05-08T20:51:53.755 INFO:teuthology.orchestra.run.smithi135.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 721 kB/s | 60 kB 00:00 2024-05-08T20:51:53.830 INFO:teuthology.orchestra.run.smithi135.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2024-05-08T20:51:53.856 INFO:teuthology.orchestra.run.smithi135.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2024-05-08T20:51:53.914 INFO:teuthology.orchestra.run.smithi135.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 403 kB/s | 34 kB 00:00 2024-05-08T20:51:53.948 INFO:teuthology.orchestra.run.smithi135.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2024-05-08T20:51:53.981 INFO:teuthology.orchestra.run.smithi135.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 961 kB/s | 64 kB 00:00 2024-05-08T20:51:54.050 INFO:teuthology.orchestra.run.smithi135.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2024-05-08T20:51:54.082 INFO:teuthology.orchestra.run.smithi135.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2024-05-08T20:51:54.124 INFO:teuthology.orchestra.run.smithi135.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 390 kB/s | 29 kB 00:00 2024-05-08T20:51:54.158 INFO:teuthology.orchestra.run.smithi135.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2024-05-08T20:51:54.241 INFO:teuthology.orchestra.run.smithi135.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2024-05-08T20:51:54.245 INFO:teuthology.orchestra.run.smithi183.stdout:(8/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 3.1 MB/s | 22 MB 00:07 2024-05-08T20:51:54.258 INFO:teuthology.orchestra.run.smithi135.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2024-05-08T20:51:54.286 INFO:teuthology.orchestra.run.smithi183.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 591 kB/s | 24 kB 00:00 2024-05-08T20:51:54.317 INFO:teuthology.orchestra.run.smithi135.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 815 kB/s | 61 kB 00:00 2024-05-08T20:51:54.342 INFO:teuthology.orchestra.run.smithi135.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2024-05-08T20:51:54.392 INFO:teuthology.orchestra.run.smithi135.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2024-05-08T20:51:54.409 INFO:teuthology.orchestra.run.smithi135.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-05-08T20:51:54.518 INFO:teuthology.orchestra.run.smithi135.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 9.9 MB/s | 1.7 MB 00:00 2024-05-08T20:51:54.585 INFO:teuthology.orchestra.run.smithi135.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 275 kB/s | 48 kB 00:00 2024-05-08T20:51:54.677 INFO:teuthology.orchestra.run.smithi135.stdout:(72/146): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2024-05-08T20:51:54.760 INFO:teuthology.orchestra.run.smithi135.stdout:(73/146): python3-prettytable-0.7.2-14.el8.noar 251 kB/s | 44 kB 00:00 2024-05-08T20:51:54.778 INFO:teuthology.orchestra.run.smithi183.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 5.0 MB/s | 18 MB 00:03 2024-05-08T20:51:54.852 INFO:teuthology.orchestra.run.smithi135.stdout:(74/146): python3-pyasn1-modules-0.3.7-6.el8.no 628 kB/s | 110 kB 00:00 2024-05-08T20:51:54.912 INFO:teuthology.orchestra.run.smithi183.stdout:(11/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 5.9 MB/s | 13 MB 00:02 2024-05-08T20:51:54.919 INFO:teuthology.orchestra.run.smithi135.stdout:(75/146): python3-jsonpatch-1.21-2.el8.noarch.r 167 kB/s | 27 kB 00:00 2024-05-08T20:51:54.937 INFO:teuthology.orchestra.run.smithi183.stdout:(12/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.6 MB/s | 261 kB 00:00 2024-05-08T20:51:54.978 INFO:teuthology.orchestra.run.smithi135.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-05-08T20:51:54.992 INFO:teuthology.orchestra.run.smithi183.stdout:(13/146): libcephfs-devel-18.2.2-1322.gd21e4f96 389 kB/s | 31 kB 00:00 2024-05-08T20:51:55.079 INFO:teuthology.orchestra.run.smithi183.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.6 MB/s | 142 kB 00:00 2024-05-08T20:51:55.120 INFO:teuthology.orchestra.run.smithi135.stdout:(77/146): python3-werkzeug-0.12.2-4.el8.noarch. 2.2 MB/s | 457 kB 00:00 2024-05-08T20:51:55.130 INFO:teuthology.orchestra.run.smithi183.stdout:(15/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 4.0 MB/s | 782 kB 00:00 2024-05-08T20:51:55.155 INFO:teuthology.orchestra.run.smithi183.stdout:(16/146): librados-devel-18.2.2-1322.gd21e4f96. 1.8 MB/s | 139 kB 00:00 2024-05-08T20:51:55.170 INFO:teuthology.orchestra.run.smithi135.stdout:(78/146): bison-3.0.4-10.el8.x86_64.rpm 3.5 MB/s | 688 kB 00:00 2024-05-08T20:51:55.222 INFO:teuthology.orchestra.run.smithi183.stdout:(17/146): libradosstriper1-18.2.2-1322.gd21e4f9 5.1 MB/s | 474 kB 00:00 2024-05-08T20:51:55.237 INFO:teuthology.orchestra.run.smithi135.stdout:(79/146): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2024-05-08T20:51:55.306 INFO:teuthology.orchestra.run.smithi183.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 536 kB/s | 45 kB 00:00 2024-05-08T20:51:55.320 INFO:teuthology.orchestra.run.smithi135.stdout:(80/146): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2024-05-08T20:51:55.356 INFO:teuthology.orchestra.run.smithi183.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 2.5 MB/s | 129 kB 00:00 2024-05-08T20:51:55.388 INFO:teuthology.orchestra.run.smithi135.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 258 kB/s | 39 kB 00:00 2024-05-08T20:51:55.431 INFO:teuthology.orchestra.run.smithi183.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 2.6 MB/s | 197 kB 00:00 2024-05-08T20:51:55.455 INFO:teuthology.orchestra.run.smithi135.stdout:(82/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2024-05-08T20:51:55.505 INFO:teuthology.orchestra.run.smithi135.stdout:(83/146): uuid-1.6.2-43.el8.x86_64.rpm 548 kB/s | 64 kB 00:00 2024-05-08T20:51:55.523 INFO:teuthology.orchestra.run.smithi183.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 4.0 MB/s | 370 kB 00:00 2024-05-08T20:51:55.572 INFO:teuthology.orchestra.run.smithi135.stdout:(84/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 885 kB/s | 103 kB 00:00 2024-05-08T20:51:55.623 INFO:teuthology.orchestra.run.smithi183.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 3.6 MB/s | 365 kB 00:00 2024-05-08T20:51:55.673 INFO:teuthology.orchestra.run.smithi183.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 2.1 MB/s | 107 kB 00:00 2024-05-08T20:51:55.714 INFO:teuthology.orchestra.run.smithi135.stdout:(85/146): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2024-05-08T20:51:55.715 INFO:teuthology.orchestra.run.smithi183.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 2.2 MB/s | 95 kB 00:00 2024-05-08T20:51:55.756 INFO:teuthology.orchestra.run.smithi135.stdout:(86/146): python3-jinja2-2.10.1-3.el8.noarch.rp 2.9 MB/s | 538 kB 00:00 2024-05-08T20:51:55.881 INFO:teuthology.orchestra.run.smithi135.stdout:(87/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2024-05-08T20:51:55.956 INFO:teuthology.orchestra.run.smithi135.stdout:(88/146): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2024-05-08T20:51:56.023 INFO:teuthology.orchestra.run.smithi135.stdout:(89/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2024-05-08T20:51:56.107 INFO:teuthology.orchestra.run.smithi135.stdout:(90/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2024-05-08T20:51:56.149 INFO:teuthology.orchestra.run.smithi183.stdout:(25/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 6.6 MB/s | 6.5 MB 00:00 2024-05-08T20:51:56.232 INFO:teuthology.orchestra.run.smithi183.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 2.1 MB/s | 181 kB 00:00 2024-05-08T20:51:56.257 INFO:teuthology.orchestra.run.smithi135.stdout:(91/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2024-05-08T20:51:56.283 INFO:teuthology.orchestra.run.smithi183.stdout:(27/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 6.1 MB/s | 3.5 MB 00:00 2024-05-08T20:51:56.308 INFO:teuthology.orchestra.run.smithi183.stdout:(28/146): ceph-grafana-dashboards-18.2.2-1322.g 322 kB/s | 24 kB 00:00 2024-05-08T20:51:56.325 INFO:teuthology.orchestra.run.smithi183.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 3.2 MB/s | 138 kB 00:00 2024-05-08T20:51:56.407 INFO:teuthology.orchestra.run.smithi135.stdout:(92/146): openblas-threads-0.3.15-6.el8.x86_64. 14 MB/s | 5.2 MB 00:00 2024-05-08T20:51:56.516 INFO:teuthology.orchestra.run.smithi135.stdout:(93/146): openblas-0.3.15-6.el8.x86_64.rpm 20 MB/s | 5.0 MB 00:00 2024-05-08T20:51:56.566 INFO:teuthology.orchestra.run.smithi135.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 4.4 MB/s | 714 kB 00:00 2024-05-08T20:51:56.608 INFO:teuthology.orchestra.run.smithi135.stdout:(95/146): libpq-13.11-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2024-05-08T20:51:56.717 INFO:teuthology.orchestra.run.smithi135.stdout:(96/146): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2024-05-08T20:51:56.817 INFO:teuthology.orchestra.run.smithi135.stdout:(97/146): python3-pytz-2017.2-11.el8.noarch.rpm 260 kB/s | 54 kB 00:00 2024-05-08T20:51:56.819 INFO:teuthology.orchestra.run.smithi183.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 6.9 MB/s | 3.5 MB 00:00 2024-05-08T20:51:56.901 INFO:teuthology.orchestra.run.smithi183.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 2.9 MB/s | 245 kB 00:00 2024-05-08T20:51:56.951 INFO:teuthology.orchestra.run.smithi183.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 980 kB/s | 49 kB 00:00 2024-05-08T20:51:56.984 INFO:teuthology.orchestra.run.smithi135.stdout:(98/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 2.1 MB/s | 18 MB 00:08 2024-05-08T20:51:57.001 INFO:teuthology.orchestra.run.smithi183.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 325 kB/s | 16 kB 00:00 2024-05-08T20:51:57.009 INFO:teuthology.orchestra.run.smithi135.stdout:(99/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 981 kB/s | 188 kB 00:00 2024-05-08T20:51:57.131 INFO:teuthology.orchestra.run.smithi183.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 2.0 MB/s | 263 kB 00:00 2024-05-08T20:51:57.176 INFO:teuthology.orchestra.run.smithi135.stdout:(100/146): postgresql-10.23-4.module+el8.9.0+21 7.9 MB/s | 1.5 MB 00:00 2024-05-08T20:51:57.185 INFO:teuthology.orchestra.run.smithi183.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 3.0 MB/s | 170 kB 00:00 2024-05-08T20:51:57.235 INFO:teuthology.orchestra.run.smithi183.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 362 kB/s | 18 kB 00:00 2024-05-08T20:51:57.318 INFO:teuthology.orchestra.run.smithi135.stdout:(101/146): python3-scipy-1.0.0-21.module+el8.9. 23 MB/s | 14 MB 00:00 2024-05-08T20:51:57.344 INFO:teuthology.orchestra.run.smithi183.stdout:(37/146): ceph-mgr-diskprediction-local-18.2.2- 7.3 MB/s | 7.4 MB 00:01 2024-05-08T20:51:57.352 INFO:teuthology.orchestra.run.smithi135.stdout:(102/146): postgresql-contrib-10.23-4.module+el 2.4 MB/s | 812 kB 00:00 2024-05-08T20:51:57.469 INFO:teuthology.orchestra.run.smithi135.stdout:(103/146): postgresql-server-10.23-4.module+el8 17 MB/s | 5.1 MB 00:00 2024-05-08T20:51:57.486 INFO:teuthology.orchestra.run.smithi135.stdout:(104/146): libverto-devel-0.3.0-5.el8.x86_64.rp 107 kB/s | 18 kB 00:00 2024-05-08T20:51:57.511 INFO:teuthology.orchestra.run.smithi183.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 354 kB/s | 59 kB 00:00 2024-05-08T20:51:57.527 INFO:teuthology.orchestra.run.smithi135.stdout:(105/146): python3-jwt-1.6.1-2.el8.noarch.rpm 243 kB/s | 43 kB 00:00 2024-05-08T20:51:57.569 INFO:teuthology.orchestra.run.smithi135.stdout:(106/146): python3-oauthlib-2.1.0-1.el8.noarch. 1.5 MB/s | 155 kB 00:00 2024-05-08T20:51:57.570 INFO:teuthology.orchestra.run.smithi183.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2024-05-08T20:51:57.620 INFO:teuthology.orchestra.run.smithi135.stdout:(107/146): python3-pycparser-2.14-14.el8.noarch 816 kB/s | 109 kB 00:00 2024-05-08T20:51:57.662 INFO:teuthology.orchestra.run.smithi183.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 5.1 MB/s | 476 kB 00:00 2024-05-08T20:51:57.703 INFO:teuthology.orchestra.run.smithi135.stdout:(108/146): python3-requests-oauthlib-1.0.0-1.el 243 kB/s | 43 kB 00:00 2024-05-08T20:51:57.753 INFO:teuthology.orchestra.run.smithi183.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 476 kB/s | 44 kB 00:00 2024-05-08T20:51:57.778 INFO:teuthology.orchestra.run.smithi135.stdout:(109/146): libaio-devel-0.3.112-1.el8.x86_64.rp 89 kB/s | 19 kB 00:00 2024-05-08T20:51:57.804 INFO:teuthology.orchestra.run.smithi183.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2024-05-08T20:51:57.846 INFO:teuthology.orchestra.run.smithi183.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 791 kB/s | 33 kB 00:00 2024-05-08T20:51:57.888 INFO:teuthology.orchestra.run.smithi183.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 393 kB/s | 16 kB 00:00 2024-05-08T20:51:57.939 INFO:teuthology.orchestra.run.smithi183.stdout:(45/146): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2024-05-08T20:51:57.988 INFO:teuthology.orchestra.run.smithi183.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2024-05-08T20:51:58.055 INFO:teuthology.orchestra.run.smithi183.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2024-05-08T20:51:58.106 INFO:teuthology.orchestra.run.smithi183.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2024-05-08T20:51:58.156 INFO:teuthology.orchestra.run.smithi183.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 353 kB/s | 18 kB 00:00 2024-05-08T20:51:58.181 INFO:teuthology.orchestra.run.smithi183.stdout:(50/146): gperftools-libs-2.7-9.el8.x86_64.rpm 324 kB/s | 306 kB 00:00 2024-05-08T20:51:58.195 INFO:teuthology.orchestra.run.smithi135.stdout:(110/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 76 kB/s | 44 kB 00:00 2024-05-08T20:51:58.231 INFO:teuthology.orchestra.run.smithi183.stdout:(51/146): python3-kubernetes-11.0.0-6.el8.noarc 15 MB/s | 1.2 MB 00:00 2024-05-08T20:51:58.282 INFO:teuthology.orchestra.run.smithi183.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2024-05-08T20:51:58.354 INFO:teuthology.orchestra.run.smithi135.stdout:(111/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 397 kB/s | 229 kB 00:00 2024-05-08T20:51:58.379 INFO:teuthology.orchestra.run.smithi135.stdout:(112/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2024-05-08T20:51:58.382 INFO:teuthology.orchestra.run.smithi183.stdout:(53/146): python3-natsort-7.1.1-2.el8.noarch.rp 603 kB/s | 60 kB 00:00 2024-05-08T20:51:58.407 INFO:teuthology.orchestra.run.smithi183.stdout:(54/146): python3-logutils-0.3.5-11.el8.noarch. 216 kB/s | 49 kB 00:00 2024-05-08T20:51:58.413 INFO:teuthology.orchestra.run.smithi135.stdout:(113/146): pcre2-devel-10.32-2.el8.x86_64.rpm 852 kB/s | 605 kB 00:00 2024-05-08T20:51:58.463 INFO:teuthology.orchestra.run.smithi135.stdout:(114/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.8 MB/s | 200 kB 00:00 2024-05-08T20:51:58.483 INFO:teuthology.orchestra.run.smithi183.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2024-05-08T20:51:58.522 INFO:teuthology.orchestra.run.smithi135.stdout:(115/146): libsepol-devel-2.9-3.el8.x86_64.rpm 802 kB/s | 87 kB 00:00 2024-05-08T20:51:58.541 INFO:teuthology.orchestra.run.smithi183.stdout:(56/146): python3-repoze-lru-0.7-6.el8.noarch.r 576 kB/s | 34 kB 00:00 2024-05-08T20:51:58.564 INFO:teuthology.orchestra.run.smithi135.stdout:(116/146): keyutils-libs-devel-1.5.10-9.el8.x86 261 kB/s | 48 kB 00:00 2024-05-08T20:51:58.589 INFO:teuthology.orchestra.run.smithi135.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 459 kB/s | 58 kB 00:00 2024-05-08T20:51:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 419 kB/s | 39 kB 00:00 2024-05-08T20:51:58.623 INFO:teuthology.orchestra.run.smithi183.stdout:(57/146): python3-routes-2.4.1-12.el8.noarch.rp 2.4 MB/s | 196 kB 00:00 2024-05-08T20:51:58.698 INFO:teuthology.orchestra.run.smithi135.stdout:(119/146): libgfortran-8.5.0-20.el8.x86_64.rpm 5.8 MB/s | 645 kB 00:00 2024-05-08T20:51:58.723 INFO:teuthology.orchestra.run.smithi135.stdout:(120/146): fuse-2.9.7-17.el8.x86_64.rpm 522 kB/s | 83 kB 00:00 2024-05-08T20:51:58.725 INFO:teuthology.orchestra.run.smithi183.stdout:(58/146): python3-rsa-4.9-2.el8.noarch.rpm 628 kB/s | 64 kB 00:00 2024-05-08T20:51:58.774 INFO:teuthology.orchestra.run.smithi135.stdout:(121/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2024-05-08T20:51:58.809 INFO:teuthology.orchestra.run.smithi183.stdout:(59/146): python3-simplegeneric-0.8.1-17.el8.no 225 kB/s | 19 kB 00:00 2024-05-08T20:51:58.857 INFO:teuthology.orchestra.run.smithi135.stdout:(122/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T20:51:58.876 INFO:teuthology.orchestra.run.smithi183.stdout:(60/146): python3-singledispatch-3.4.0.3-18.el8 357 kB/s | 24 kB 00:00 2024-05-08T20:51:58.899 INFO:teuthology.orchestra.run.smithi135.stdout:(123/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 414 kB/s | 73 kB 00:00 2024-05-08T20:51:58.941 INFO:teuthology.orchestra.run.smithi135.stdout:(124/146): elfutils-libelf-devel-0.189-3.el8.x8 369 kB/s | 62 kB 00:00 2024-05-08T20:51:58.943 INFO:teuthology.orchestra.run.smithi183.stdout:(61/146): python3-tempora-1.14.1-5.el8.noarch.r 439 kB/s | 29 kB 00:00 2024-05-08T20:51:58.991 INFO:teuthology.orchestra.run.smithi135.stdout:(125/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 4.1 MB/s | 562 kB 00:00 2024-05-08T20:51:59.001 INFO:teuthology.orchestra.run.smithi183.stdout:(62/146): python3-trustme-0.6.0-4.el8.noarch.rp 472 kB/s | 27 kB 00:00 2024-05-08T20:51:59.033 INFO:teuthology.orchestra.run.smithi135.stdout:(126/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 512 kB/s | 47 kB 00:00 2024-05-08T20:51:59.060 INFO:teuthology.orchestra.run.smithi183.stdout:(63/146): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2024-05-08T20:51:59.110 INFO:teuthology.orchestra.run.smithi183.stdout:(64/146): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2024-05-08T20:51:59.150 INFO:teuthology.orchestra.run.smithi135.stdout:(127/146): openssl-devel-1.1.1k-12.el8_9.x86_64 9.3 MB/s | 2.3 MB 00:00 2024-05-08T20:51:59.152 INFO:teuthology.orchestra.run.smithi183.stdout:(65/146): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2024-05-08T20:51:59.175 INFO:teuthology.orchestra.run.smithi135.stdout:(128/146): NetworkManager-initscripts-updown-1. 1.0 MB/s | 144 kB 00:00 2024-05-08T20:51:59.200 INFO:teuthology.orchestra.run.smithi135.stdout:(129/146): python3-cryptography-3.2.1-7.el8_9.x 2.6 MB/s | 559 kB 00:00 2024-05-08T20:51:59.229 INFO:teuthology.orchestra.run.smithi183.stdout:(66/146): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-05-08T20:51:59.295 INFO:teuthology.orchestra.run.smithi183.stdout:(67/146): python3-zc-lockfile-2.0-2.el8.noarch. 354 kB/s | 23 kB 00:00 2024-05-08T20:51:59.334 INFO:teuthology.orchestra.run.smithi135.stdout:(130/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 544 kB/s | 100 kB 00:00 2024-05-08T20:51:59.378 INFO:teuthology.orchestra.run.smithi183.stdout:(68/146): thrift-0.13.0-2.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2024-05-08T20:51:59.395 INFO:teuthology.orchestra.run.smithi183.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-05-08T20:51:59.470 INFO:teuthology.orchestra.run.smithi183.stdout:(70/146): python3-portend-2.6-1.el8.noarch.rpm 15 kB/s | 16 kB 00:01 2024-05-08T20:51:59.543 INFO:teuthology.orchestra.run.smithi135.stdout:(131/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 10 MB/s | 3.6 MB 00:00 2024-05-08T20:51:59.570 INFO:teuthology.orchestra.run.smithi135.stdout:(132/146): elfutils-libelf-0.189-3.el8.x86_64.r 994 kB/s | 232 kB 00:00 2024-05-08T20:51:59.579 INFO:teuthology.orchestra.run.smithi183.stdout:(71/146): python3-jsonpointer-1.10-11.el8.noarc 185 kB/s | 20 kB 00:00 2024-05-08T20:51:59.604 INFO:teuthology.orchestra.run.smithi183.stdout:(72/146): python3-packaging-16.8-9.el8.noarch.r 231 kB/s | 48 kB 00:00 2024-05-08T20:51:59.660 INFO:teuthology.orchestra.run.smithi135.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2024-05-08T20:51:59.702 INFO:teuthology.orchestra.run.smithi135.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 6.2 MB/s | 854 kB 00:00 2024-05-08T20:51:59.891 INFO:teuthology.orchestra.run.smithi135.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.8 MB/s | 1.5 MB 00:00 2024-05-08T20:51:59.952 INFO:teuthology.orchestra.run.smithi135.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 2.4 MB/s | 711 kB 00:00 2024-05-08T20:52:00.011 INFO:teuthology.orchestra.run.smithi135.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.7 MB/s | 333 kB 00:00 2024-05-08T20:52:00.072 INFO:teuthology.orchestra.run.smithi183.stdout:(73/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 8.2 MB/s | 47 MB 00:05 2024-05-08T20:52:00.078 INFO:teuthology.orchestra.run.smithi135.stdout:(138/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.5 MB/s | 1.1 MB 00:00 2024-05-08T20:52:00.097 INFO:teuthology.orchestra.run.smithi183.stdout:(74/146): python3-prettytable-0.7.2-14.el8.noar 85 kB/s | 44 kB 00:00 2024-05-08T20:52:00.130 INFO:teuthology.orchestra.run.smithi183.stdout:(75/146): python3-pyasn1-modules-0.3.7-6.el8.no 209 kB/s | 110 kB 00:00 2024-05-08T20:52:00.153 INFO:teuthology.orchestra.run.smithi135.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 221 kB 00:00 2024-05-08T20:52:00.195 INFO:teuthology.orchestra.run.smithi135.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 2.1 MB/s | 254 kB 00:00 2024-05-08T20:52:00.205 INFO:teuthology.orchestra.run.smithi183.stdout:(76/146): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2024-05-08T20:52:00.222 INFO:teuthology.orchestra.run.smithi183.stdout:(77/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-05-08T20:52:00.279 INFO:teuthology.orchestra.run.smithi135.stdout:(141/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 2.1 MB/s | 180 kB 00:00 2024-05-08T20:52:00.289 INFO:teuthology.orchestra.run.smithi183.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2024-05-08T20:52:00.329 INFO:teuthology.orchestra.run.smithi135.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.3 MB/s | 237 kB 00:00 2024-05-08T20:52:00.373 INFO:teuthology.orchestra.run.smithi183.stdout:(79/146): bison-3.0.4-10.el8.x86_64.rpm 4.0 MB/s | 688 kB 00:00 2024-05-08T20:52:00.388 INFO:teuthology.orchestra.run.smithi135.stdout:(143/146): librados2-18.2.2-1322.gd21e4f96.el8. 3.1 MB/s | 3.7 MB 00:01 2024-05-08T20:52:00.398 INFO:teuthology.orchestra.run.smithi183.stdout:(80/146): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2024-05-08T20:52:00.422 INFO:teuthology.orchestra.run.smithi135.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 696 kB/s | 99 kB 00:00 2024-05-08T20:52:00.482 INFO:teuthology.orchestra.run.smithi183.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 358 kB/s | 39 kB 00:00 2024-05-08T20:52:00.488 INFO:teuthology.orchestra.run.smithi135.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 16 MB/s | 2.5 MB 00:00 2024-05-08T20:52:00.515 INFO:teuthology.orchestra.run.smithi183.stdout:(82/146): libtool-2.4.6-25.el8.x86_64.rpm 3.1 MB/s | 709 kB 00:00 2024-05-08T20:52:00.530 INFO:teuthology.orchestra.run.smithi135.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 725 kB/s | 103 kB 00:00 2024-05-08T20:52:00.533 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-05-08T20:52:00.533 INFO:teuthology.orchestra.run.smithi135.stdout:Total 15 MB/s | 215 MB 00:14 2024-05-08T20:52:00.541 INFO:teuthology.orchestra.run.smithi183.stdout:(83/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2024-05-08T20:52:00.591 INFO:teuthology.orchestra.run.smithi183.stdout:(84/146): uuid-1.6.2-43.el8.x86_64.rpm 589 kB/s | 64 kB 00:00 2024-05-08T20:52:00.675 INFO:teuthology.orchestra.run.smithi183.stdout:(85/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 651 kB/s | 103 kB 00:00 2024-05-08T20:52:00.767 INFO:teuthology.orchestra.run.smithi183.stdout:(86/146): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2024-05-08T20:52:00.802 INFO:teuthology.orchestra.run.smithi183.stdout:(87/146): python3-jinja2-2.10.1-3.el8.noarch.rp 2.5 MB/s | 538 kB 00:00 2024-05-08T20:52:00.950 INFO:teuthology.orchestra.run.smithi183.stdout:(88/146): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2024-05-08T20:52:00.984 INFO:teuthology.orchestra.run.smithi183.stdout:(89/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.2 MB/s | 225 kB 00:00 2024-05-08T20:52:01.010 INFO:teuthology.orchestra.run.smithi183.stdout:(90/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.3 MB/s | 323 kB 00:00 2024-05-08T20:52:01.093 INFO:teuthology.orchestra.run.smithi183.stdout:(91/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2024-05-08T20:52:01.143 INFO:teuthology.orchestra.run.smithi183.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-05-08T20:52:01.285 INFO:teuthology.orchestra.run.smithi183.stdout:(93/146): openblas-threads-0.3.15-6.el8.x86_64. 17 MB/s | 5.2 MB 00:00 2024-05-08T20:52:01.327 INFO:teuthology.orchestra.run.smithi183.stdout:(94/146): automake-1.16.1-8.el8.noarch.rpm 3.8 MB/s | 714 kB 00:00 2024-05-08T20:52:01.436 INFO:teuthology.orchestra.run.smithi183.stdout:(95/146): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-05-08T20:52:01.461 INFO:teuthology.orchestra.run.smithi183.stdout:(96/146): libpq-13.11-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2024-05-08T20:52:01.486 INFO:teuthology.orchestra.run.smithi183.stdout:(97/146): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2024-05-08T20:52:01.562 INFO:teuthology.orchestra.run.smithi183.stdout:(98/146): python3-pytz-2017.2-11.el8.noarch.rpm 433 kB/s | 54 kB 00:00 2024-05-08T20:52:01.605 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-05-08T20:52:01.662 INFO:teuthology.orchestra.run.smithi183.stdout:(99/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-05-08T20:52:01.712 INFO:teuthology.orchestra.run.smithi183.stdout:(100/146): postgresql-10.23-4.module+el8.9.0+21 10 MB/s | 1.5 MB 00:00 2024-05-08T20:52:01.912 INFO:teuthology.orchestra.run.smithi183.stdout:(101/146): python3-scipy-1.0.0-21.module+el8.9. 30 MB/s | 14 MB 00:00 2024-05-08T20:52:01.946 INFO:teuthology.orchestra.run.smithi183.stdout:(102/146): postgresql-contrib-10.23-4.module+el 2.8 MB/s | 812 kB 00:00 2024-05-08T20:52:01.998 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-05-08T20:52:01.999 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-05-08T20:52:02.038 INFO:teuthology.orchestra.run.smithi183.stdout:(103/146): libverto-devel-0.3.0-5.el8.x86_64.rp 143 kB/s | 18 kB 00:00 2024-05-08T20:52:02.121 INFO:teuthology.orchestra.run.smithi183.stdout:(104/146): postgresql-server-10.23-4.module+el8 12 MB/s | 5.1 MB 00:00 2024-05-08T20:52:02.147 INFO:teuthology.orchestra.run.smithi183.stdout:(105/146): python3-jwt-1.6.1-2.el8.noarch.rpm 212 kB/s | 43 kB 00:00 2024-05-08T20:52:02.197 INFO:teuthology.orchestra.run.smithi183.stdout:(106/146): python3-oauthlib-2.1.0-1.el8.noarch. 976 kB/s | 155 kB 00:00 2024-05-08T20:52:02.231 INFO:teuthology.orchestra.run.smithi183.stdout:(107/146): python3-pycparser-2.14-14.el8.noarch 1.0 MB/s | 109 kB 00:00 2024-05-08T20:52:02.256 INFO:teuthology.orchestra.run.smithi183.stdout:(108/146): python3-requests-oauthlib-1.0.0-1.el 392 kB/s | 43 kB 00:00 2024-05-08T20:52:02.281 INFO:teuthology.orchestra.run.smithi183.stdout:(109/146): libaio-devel-0.3.112-1.el8.x86_64.rp 223 kB/s | 19 kB 00:00 2024-05-08T20:52:02.340 INFO:teuthology.orchestra.run.smithi183.stdout:(110/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 402 kB/s | 44 kB 00:00 2024-05-08T20:52:02.407 INFO:teuthology.orchestra.run.smithi183.stdout:(111/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-05-08T20:52:02.434 INFO:teuthology.orchestra.run.smithi183.stdout:(112/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2024-05-08T20:52:02.481 INFO:teuthology.orchestra.run.smithi183.stdout:(113/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2024-05-08T20:52:02.516 INFO:teuthology.orchestra.run.smithi183.stdout:(114/146): keyutils-libs-devel-1.5.10-9.el8.x86 576 kB/s | 48 kB 00:00 2024-05-08T20:52:02.541 INFO:teuthology.orchestra.run.smithi183.stdout:(115/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2024-05-08T20:52:02.583 INFO:teuthology.orchestra.run.smithi183.stdout:(116/146): libsepol-devel-2.9-3.el8.x86_64.rpm 856 kB/s | 87 kB 00:00 2024-05-08T20:52:02.675 INFO:teuthology.orchestra.run.smithi183.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 363 kB/s | 58 kB 00:00 2024-05-08T20:52:02.950 INFO:teuthology.orchestra.run.smithi183.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 94 kB/s | 39 kB 00:00 2024-05-08T20:52:03.087 INFO:teuthology.orchestra.run.smithi183.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 165 kB/s | 83 kB 00:00 2024-05-08T20:52:03.118 INFO:teuthology.orchestra.run.smithi183.stdout:(120/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2024-05-08T20:52:03.151 INFO:teuthology.orchestra.run.smithi183.stdout:(121/146): libgfortran-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 645 kB 00:00 2024-05-08T20:52:03.197 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-05-08T20:52:03.208 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-05-08T20:52:03.210 INFO:teuthology.orchestra.run.smithi183.stdout:(122/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2024-05-08T20:52:03.227 INFO:teuthology.orchestra.run.smithi183.stdout:(123/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 668 kB/s | 73 kB 00:00 2024-05-08T20:52:03.252 INFO:teuthology.orchestra.run.smithi183.stdout:(124/146): elfutils-libelf-devel-0.189-3.el8.x8 615 kB/s | 62 kB 00:00 2024-05-08T20:52:03.407 INFO:teuthology.orchestra.run.smithi183.stdout:(125/146): openssl-devel-1.1.1k-12.el8_9.x86_64 13 MB/s | 2.3 MB 00:00 2024-05-08T20:52:03.436 INFO:teuthology.orchestra.run.smithi183.stdout:(126/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 256 kB/s | 47 kB 00:00 2024-05-08T20:52:03.461 INFO:teuthology.orchestra.run.smithi183.stdout:(127/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 2.2 MB/s | 562 kB 00:00 2024-05-08T20:52:03.537 INFO:teuthology.orchestra.run.smithi183.stdout:(128/146): python3-cryptography-3.2.1-7.el8_9.x 4.2 MB/s | 559 kB 00:00 2024-05-08T20:52:03.562 INFO:teuthology.orchestra.run.smithi183.stdout:(129/146): NetworkManager-initscripts-updown-1. 1.1 MB/s | 144 kB 00:00 2024-05-08T20:52:03.637 INFO:teuthology.orchestra.run.smithi183.stdout:(130/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 569 kB/s | 100 kB 00:00 2024-05-08T20:52:03.762 INFO:teuthology.orchestra.run.smithi183.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2024-05-08T20:52:03.879 INFO:teuthology.orchestra.run.smithi183.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2024-05-08T20:52:04.030 INFO:teuthology.orchestra.run.smithi183.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.6 MB/s | 854 kB 00:00 2024-05-08T20:52:04.097 INFO:teuthology.orchestra.run.smithi183.stdout:(134/146): librados2-18.2.2-1322.gd21e4f96.el8. 6.6 MB/s | 3.7 MB 00:00 2024-05-08T20:52:04.147 INFO:teuthology.orchestra.run.smithi183.stdout:(135/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 6.1 MB/s | 3.6 MB 00:00 2024-05-08T20:52:04.180 INFO:teuthology.orchestra.run.smithi183.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.6 MB/s | 711 kB 00:00 2024-05-08T20:52:04.239 INFO:teuthology.orchestra.run.smithi183.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 10 MB/s | 1.5 MB 00:00 2024-05-08T20:52:04.264 INFO:teuthology.orchestra.run.smithi183.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.8 MB/s | 333 kB 00:00 2024-05-08T20:52:04.356 INFO:teuthology.orchestra.run.smithi183.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.1 MB/s | 1.1 MB 00:00 2024-05-08T20:52:04.381 INFO:teuthology.orchestra.run.smithi183.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 221 kB 00:00 2024-05-08T20:52:04.432 INFO:teuthology.orchestra.run.smithi183.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 254 kB 00:00 2024-05-08T20:52:04.499 INFO:teuthology.orchestra.run.smithi183.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 237 kB 00:00 2024-05-08T20:52:04.524 INFO:teuthology.orchestra.run.smithi183.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.2 MB/s | 180 kB 00:00 2024-05-08T20:52:04.549 INFO:teuthology.orchestra.run.smithi183.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 847 kB/s | 99 kB 00:00 2024-05-08T20:52:04.649 INFO:teuthology.orchestra.run.smithi183.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 821 kB/s | 103 kB 00:00 2024-05-08T20:52:04.716 INFO:teuthology.orchestra.run.smithi183.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 11 MB/s | 2.5 MB 00:00 2024-05-08T20:52:04.720 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-05-08T20:52:04.720 INFO:teuthology.orchestra.run.smithi183.stdout:Total 12 MB/s | 215 MB 00:17 2024-05-08T20:52:05.804 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-05-08T20:52:06.199 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-05-08T20:52:06.199 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-05-08T20:52:07.402 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-05-08T20:52:07.413 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-05-08T20:52:08.735 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-05-08T20:52:08.870 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T20:52:09.132 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T20:52:09.345 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T20:52:09.544 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T20:52:09.689 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T20:52:09.765 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T20:52:09.956 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T20:52:10.009 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T20:52:10.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T20:52:10.356 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T20:52:10.426 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T20:52:10.599 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-05-08T20:52:10.806 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T20:52:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T20:52:11.389 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T20:52:11.815 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T20:52:11.989 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T20:52:12.117 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T20:52:12.300 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T20:52:12.395 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T20:52:12.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T20:52:12.872 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T20:52:12.961 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T20:52:13.162 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T20:52:13.302 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-05-08T20:52:13.409 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T20:52:13.437 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T20:52:13.567 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T20:52:13.710 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T20:52:13.915 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T20:52:14.191 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T20:52:14.331 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T20:52:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T20:52:14.468 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T20:52:14.539 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T20:52:14.543 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T20:52:14.644 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T20:52:14.735 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T20:52:14.804 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T20:52:14.814 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T20:52:14.892 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T20:52:15.025 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T20:52:15.055 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T20:52:15.180 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T20:52:15.218 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T20:52:15.288 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T20:52:15.349 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T20:52:15.513 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-05-08T20:52:15.710 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T20:52:15.969 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T20:52:16.105 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T20:52:16.172 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T20:52:16.276 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T20:52:16.649 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T20:52:16.793 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T20:52:16.868 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T20:52:16.995 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T20:52:17.013 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T20:52:17.212 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T20:52:17.307 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T20:52:17.594 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T20:52:17.699 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T20:52:17.826 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T20:52:17.942 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T20:52:17.970 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-05-08T20:52:18.107 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T20:52:18.119 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-05-08T20:52:18.284 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-05-08T20:52:18.355 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T20:52:18.512 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T20:52:18.602 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-05-08T20:52:18.880 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-05-08T20:52:18.906 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T20:52:19.113 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T20:52:19.151 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T20:52:19.259 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T20:52:19.320 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T20:52:19.366 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T20:52:19.508 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T20:52:19.559 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T20:52:19.638 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T20:52:19.762 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T20:52:19.834 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T20:52:19.970 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T20:52:20.159 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T20:52:20.729 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-05-08T20:52:20.781 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T20:52:20.967 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T20:52:21.084 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-05-08T20:52:21.373 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-05-08T20:52:21.553 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T20:52:21.571 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T20:52:21.717 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T20:52:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T20:52:22.665 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-05-08T20:52:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-05-08T20:52:23.012 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-05-08T20:52:23.324 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T20:52:23.333 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-05-08T20:52:23.630 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-05-08T20:52:23.646 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-05-08T20:52:23.873 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T20:52:23.893 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T20:52:24.073 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T20:52:24.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T20:52:24.211 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T20:52:24.304 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T20:52:24.460 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T20:52:24.495 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T20:52:24.671 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T20:52:24.734 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T20:52:24.946 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T20:52:25.028 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T20:52:25.243 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T20:52:25.424 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-05-08T20:52:25.465 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T20:52:25.704 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T20:52:25.779 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-05-08T20:52:26.085 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-05-08T20:52:26.153 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T20:52:26.274 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T20:52:26.479 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T20:52:26.497 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T20:52:26.691 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-05-08T20:52:26.909 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-05-08T20:52:27.109 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-05-08T20:52:27.307 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-05-08T20:52:27.508 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-05-08T20:52:27.807 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-05-08T20:52:28.005 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T20:52:28.099 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-05-08T20:52:28.317 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-05-08T20:52:28.342 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-05-08T20:52:28.483 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-05-08T20:52:28.577 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T20:52:28.697 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-05-08T20:52:28.759 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T20:52:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T20:52:29.128 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-05-08T20:52:29.198 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T20:52:29.423 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-05-08T20:52:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T20:52:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T20:52:29.719 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T20:52:29.790 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T20:52:29.921 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-05-08T20:52:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T20:52:30.203 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-05-08T20:52:30.234 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T20:52:30.430 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-05-08T20:52:30.474 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T20:52:30.665 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-05-08T20:52:30.901 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T20:52:30.932 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-05-08T20:52:31.203 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-05-08T20:52:31.224 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T20:52:31.242 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T20:52:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-05-08T20:52:31.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-05-08T20:52:31.611 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-05-08T20:52:31.636 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-05-08T20:52:31.794 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-05-08T20:52:31.865 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-05-08T20:52:31.967 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-05-08T20:52:32.094 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T20:52:32.195 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T20:52:32.202 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-05-08T20:52:32.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-05-08T20:52:32.560 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-05-08T20:52:32.671 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-05-08T20:52:32.836 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-05-08T20:52:32.894 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T20:52:32.956 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T20:52:33.062 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-05-08T20:52:33.127 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T20:52:33.194 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-05-08T20:52:33.294 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-05-08T20:52:33.425 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-05-08T20:52:33.480 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T20:52:33.713 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T20:52:33.815 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-05-08T20:52:33.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T20:52:34.087 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T20:52:34.118 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-05-08T20:52:34.341 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T20:52:34.432 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-05-08T20:52:34.560 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T20:52:34.673 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-05-08T20:52:34.782 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T20:52:34.918 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-05-08T20:52:34.947 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T20:52:35.150 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-05-08T20:52:35.170 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T20:52:35.393 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-05-08T20:52:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T20:52:35.640 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-05-08T20:52:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T20:52:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T20:52:35.883 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-05-08T20:52:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T20:52:36.053 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-05-08T20:52:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T20:52:36.284 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-05-08T20:52:36.464 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T20:52:36.539 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T20:52:36.607 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-05-08T20:52:36.629 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T20:52:36.864 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T20:52:36.904 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-05-08T20:52:37.101 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T20:52:37.140 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-05-08T20:52:37.293 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T20:52:37.347 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T20:52:37.417 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-05-08T20:52:37.509 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T20:52:37.622 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T20:52:37.781 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-05-08T20:52:37.975 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T20:52:38.141 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T20:52:38.339 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T20:52:38.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T20:52:38.604 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T20:52:38.794 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T20:52:38.889 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T20:52:39.029 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T20:52:39.076 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T20:52:39.260 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T20:52:39.419 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T20:52:39.441 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T20:52:39.648 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T20:52:39.694 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T20:52:39.885 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T20:52:39.918 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T20:52:40.185 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T20:52:40.392 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T20:52:40.544 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T20:52:40.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T20:52:40.792 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T20:52:40.810 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T20:52:40.883 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T20:52:41.000 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T20:52:41.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T20:52:41.171 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T20:52:41.474 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T20:52:41.729 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T20:52:41.903 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T20:52:42.120 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T20:52:43.215 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T20:52:43.525 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T20:52:43.703 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T20:52:44.038 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T20:52:44.305 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T20:52:44.512 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T20:52:44.807 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T20:52:45.043 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T20:52:45.293 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T20:52:45.640 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T20:52:45.729 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T20:52:45.803 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T20:52:46.005 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T20:52:46.560 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T20:52:46.647 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T20:52:46.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T20:52:49.735 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T20:52:49.971 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T20:52:50.561 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T20:52:51.911 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T20:52:52.362 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T20:52:52.603 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T20:53:06.626 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T20:53:06.626 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-05-08T20:53:06.626 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-05-08T20:53:06.626 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2024-05-08T20:53:06.627 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /run 2024-05-08T20:53:06.627 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-05-08T20:53:06.627 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-05-08T20:53:06.627 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-05-08T20:53:06.627 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-05-08T20:53:06.627 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /dev 2024-05-08T20:53:06.627 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:53:06.957 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T20:53:08.604 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T20:53:08.832 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T20:53:09.051 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T20:53:09.222 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T20:53:09.701 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T20:53:09.881 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T20:53:09.899 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T20:53:11.698 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T20:53:11.859 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T20:53:11.979 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T20:53:12.181 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T20:53:12.216 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T20:53:12.216 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-05-08T20:53:12.216 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-05-08T20:53:12.216 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2024-05-08T20:53:12.217 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /run 2024-05-08T20:53:12.217 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-05-08T20:53:12.217 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-05-08T20:53:12.217 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-05-08T20:53:12.217 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-05-08T20:53:12.217 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /dev 2024-05-08T20:53:12.217 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:53:12.463 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T20:53:12.550 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T20:53:13.498 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T20:53:13.756 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T20:53:14.189 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T20:53:14.432 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T20:53:14.650 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T20:53:14.724 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T20:53:14.841 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T20:53:14.938 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T20:53:15.032 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T20:53:15.317 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T20:53:15.410 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T20:53:15.491 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T20:53:15.509 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T20:53:15.606 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T20:53:15.644 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T20:53:15.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T20:53:15.817 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T20:53:17.079 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T20:53:17.280 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T20:53:17.315 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T20:53:17.453 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T20:53:17.496 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T20:53:17.540 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T20:53:17.610 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T20:53:17.705 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T20:53:17.722 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T20:53:17.967 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T20:53:18.054 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T20:53:18.213 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T20:53:18.223 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T20:53:19.253 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T20:53:19.506 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T20:53:20.469 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T20:53:20.632 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T20:53:20.725 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T20:53:21.110 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T20:53:21.256 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T20:53:21.294 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T20:53:21.482 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T20:53:21.493 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T20:53:22.665 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T20:53:22.757 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T20:53:22.998 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T20:53:23.032 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T20:53:23.103 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T20:53:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T20:53:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T20:53:23.431 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T20:53:23.439 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-05-08T20:53:23.637 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T20:53:23.778 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T20:53:23.965 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T20:53:24.317 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T20:53:24.617 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-05-08T20:53:24.887 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-05-08T20:53:25.085 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T20:53:25.305 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T20:53:25.471 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T20:53:25.638 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T20:53:27.939 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T20:53:28.254 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T20:53:28.294 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T20:53:28.406 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T20:53:28.682 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T20:53:28.847 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T20:53:29.052 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T20:53:29.190 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-05-08T20:53:29.265 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T20:53:29.396 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T20:53:29.420 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T20:53:29.610 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T20:53:29.933 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T20:53:30.077 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T20:53:30.229 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T20:53:30.351 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-05-08T20:53:30.402 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T20:53:30.413 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T20:53:30.640 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-05-08T20:53:30.654 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-05-08T20:53:30.844 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T20:53:30.861 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T20:53:30.925 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T20:53:31.099 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T20:53:31.127 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T20:53:31.141 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T20:53:31.271 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T20:53:31.332 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T20:53:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T20:53:31.522 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T20:53:31.648 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T20:53:31.648 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T20:53:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T20:53:31.881 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T20:53:32.106 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T20:53:32.106 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T20:53:32.334 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T20:53:32.529 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T20:53:32.688 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T20:53:32.930 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T20:53:32.930 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T20:53:33.138 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T20:53:33.138 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T20:53:33.372 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T20:53:33.372 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T20:53:33.613 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T20:53:33.613 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T20:53:33.721 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T20:53:33.838 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T20:53:33.838 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T20:53:34.013 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T20:53:34.052 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T20:53:34.063 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T20:53:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T20:53:34.213 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T20:53:34.500 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T20:53:34.877 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T20:53:35.104 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T20:53:35.104 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T20:53:35.104 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T20:53:35.105 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T20:53:35.106 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T20:53:35.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T20:53:35.107 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T20:53:35.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T20:53:35.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T20:53:35.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T20:53:35.122 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T20:53:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T20:53:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-05-08T20:53:35.125 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-05-08T20:53:35.126 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-05-08T20:53:35.127 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-05-08T20:53:35.128 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T20:53:35.129 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T20:53:35.130 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T20:53:35.131 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T20:53:35.133 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T20:53:35.329 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T20:53:35.562 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T20:53:35.816 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T20:53:36.056 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T20:53:36.254 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T20:53:36.266 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T20:53:36.484 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-05-08T20:53:36.678 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T20:53:36.760 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T20:53:36.970 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T20:53:36.984 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T20:53:37.174 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T20:53:37.373 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T20:53:37.508 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T20:53:37.508 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T20:53:37.790 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T20:53:37.791 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T20:53:37.999 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T20:53:37.999 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T20:53:38.201 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T20:53:38.422 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T20:53:38.622 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T20:53:38.872 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T20:53:38.872 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T20:53:39.106 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T20:53:39.106 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T20:53:39.374 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T20:53:39.374 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T20:53:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T20:53:39.622 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T20:53:39.889 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T20:53:39.889 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T20:53:40.130 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T20:53:40.264 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T20:53:40.264 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T20:53:41.201 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T20:53:41.202 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T20:53:41.203 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T20:53:41.204 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T20:53:41.218 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T20:53:41.218 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T20:53:41.218 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T20:53:41.219 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T20:53:41.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T20:53:41.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-05-08T20:53:41.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-05-08T20:53:41.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-05-08T20:53:41.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-05-08T20:53:41.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-05-08T20:53:41.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-05-08T20:53:41.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-05-08T20:53:41.225 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-05-08T20:53:41.226 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-05-08T20:53:41.227 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-05-08T20:53:41.228 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-05-08T20:53:41.229 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T20:53:41.230 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T20:53:41.231 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T20:53:41.232 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T20:53:41.233 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T20:53:41.234 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T20:53:51.413 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T20:53:51.413 INFO:teuthology.orchestra.run.smithi135.stdout:Installed products updated. 2024-05-08T20:53:52.042 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:53:52.042 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-05-08T20:53:52.042 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T20:53:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.044 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.045 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: jq-1.6-7.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T20:53:52.046 INFO:teuthology.orchestra.run.smithi135.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.047 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T20:53:52.048 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.049 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T20:53:52.050 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T20:53:52.051 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T20:53:52.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:52.053 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T20:53:52.054 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T20:53:52.054 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T20:53:52.054 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T20:53:52.054 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T20:53:52.054 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T20:53:52.054 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:53:52.054 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-05-08T20:53:52.273 DEBUG:teuthology.parallel:result is None 2024-05-08T20:53:54.422 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T20:53:54.422 INFO:teuthology.orchestra.run.smithi183.stdout:Installed products updated. 2024-05-08T20:53:55.848 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T20:53:55.849 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.850 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.851 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: jq-1.6-7.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T20:53:55.852 INFO:teuthology.orchestra.run.smithi183.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.853 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T20:53:55.854 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.855 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T20:53:55.856 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T20:53:55.857 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T20:53:55.858 INFO:teuthology.orchestra.run.smithi183.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T20:53:55.859 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T20:53:55.860 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T20:53:55.860 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:53:55.860 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-05-08T20:53:56.923 DEBUG:teuthology.parallel:result is None 2024-05-08T20:53:56.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:53:57.077 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T20:53:57.105 INFO:teuthology.orchestra.run.smithi135.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T20:53:57.106 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T20:53:57.106 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T20:53:57.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:53:57.252 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T20:53:57.276 INFO:teuthology.orchestra.run.smithi183.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T20:53:57.276 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T20:53:57.276 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T20:53:57.278 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T20:53:57.278 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:53:57.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T20:53:57.328 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:53:57.328 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T20:53:57.370 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T20:53:57.370 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:53:57.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T20:53:57.400 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T20:53:57.469 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:53:57.469 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T20:53:57.496 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T20:53:57.563 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T20:53:57.563 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:53:57.563 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T20:53:57.592 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T20:53:57.660 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:53:57.660 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T20:53:57.687 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T20:53:57.753 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T20:53:57.754 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:53:57.754 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T20:53:57.781 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T20:53:57.848 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:53:57.848 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T20:53:57.874 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T20:53:57.942 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T20:53:58.036 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T20:53:58.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-05-08T20:53:58.039 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2024-05-08T20:53:58.066 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T20:53:58.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T20:53:58.107 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T20:53:58.133 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T20:53:58.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T20:53:58.174 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T20:53:58.207 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T20:53:58.207 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T20:53:58.207 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T20:53:58.208 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:53:58.208 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T20:53:58.256 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:58.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:58.402 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:53:58.402 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T20:53:58.419 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:58.533 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-08T20:53:58.565 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T20:53:58.565 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T20:53:58.566 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020', 'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698020', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.150423-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2738, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'sleep_before_teardown': 0, 'subset': '17/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.150423-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWeTGKbrhZWvNv7x3CapaYIVaVhS8SiySqxyjilj7FnkWc2d7rnEokVy7GzUb5ZDdngAbq2o8FTcchGnSv8qWs=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM74K1Ppy/lIRFHCHQ8hBRXr6oRY71yh6kA6mVl71E5cIN7C2DbWnutUqRF/gpU8BvgsmHgLI3g6xPXR81VWBtU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_19:22:21', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T20:53:58.566 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T20:53:58.569 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T20:53:58.617 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T20:53:58.625 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T20:53:58.684 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:53:58.684 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T20:53:58.707 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T20:53:58.708 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 179979 Links: 1 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 20:53:34.747477687 +0000 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 20:50:19.947073495 +0000 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 20:50:19.947073495 +0000 2024-05-08T20:53:58.765 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T20:53:58.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T20:53:58.829 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T20:53:58.830 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T20:53:58.830 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000190556 s, 2.7 MB/s 2024-05-08T20:53:58.831 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T20:53:58.888 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-05-08T20:53:58.946 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T20:53:58.946 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:53:58.946 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 180128 Links: 1 2024-05-08T20:53:58.946 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:53:58.946 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:53:58.946 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 20:53:34.747477687 +0000 2024-05-08T20:53:58.946 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 20:50:20.314066092 +0000 2024-05-08T20:53:58.947 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 20:50:20.314066092 +0000 2024-05-08T20:53:58.947 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T20:53:58.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T20:53:59.012 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T20:53:59.012 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T20:53:59.012 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00028834 s, 1.8 MB/s 2024-05-08T20:53:59.013 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T20:53:59.071 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 184336 Links: 1 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 20:53:34.747477687 +0000 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 20:50:20.678058750 +0000 2024-05-08T20:53:59.129 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 20:50:20.678058750 +0000 2024-05-08T20:53:59.130 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T20:53:59.130 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T20:53:59.195 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T20:53:59.195 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T20:53:59.195 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000190506 s, 2.7 MB/s 2024-05-08T20:53:59.196 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T20:53:59.254 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 6h/6d Inode: 183714 Links: 1 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-05-08 20:53:34.747477687 +0000 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 20:50:21.013051994 +0000 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 20:50:21.013051994 +0000 2024-05-08T20:53:59.313 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T20:53:59.314 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T20:53:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-05-08T20:53:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-05-08T20:53:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000229428 s, 2.2 MB/s 2024-05-08T20:53:59.380 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T20:53:59.438 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:53:59.438 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:53:59.438 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T20:53:59.459 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T20:53:59.459 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2024-05-08T20:53:59.519 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T20:53:59.519 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:53:59.519 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 182547 Links: 1 2024-05-08T20:53:59.519 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:53:59.519 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:53:59.519 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 20:53:40.842964857 +0000 2024-05-08T20:53:59.520 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 20:50:09.743657859 +0000 2024-05-08T20:53:59.520 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 20:50:09.743657859 +0000 2024-05-08T20:53:59.520 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2024-05-08T20:53:59.520 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T20:53:59.587 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T20:53:59.588 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T20:53:59.588 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000239898 s, 2.1 MB/s 2024-05-08T20:53:59.589 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T20:53:59.649 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2024-05-08T20:53:59.709 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T20:53:59.710 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:53:59.710 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 178120 Links: 1 2024-05-08T20:53:59.710 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:53:59.711 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:53:59.711 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 20:53:40.842964857 +0000 2024-05-08T20:53:59.711 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 20:50:10.091648497 +0000 2024-05-08T20:53:59.711 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 20:50:10.091648497 +0000 2024-05-08T20:53:59.712 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2024-05-08T20:53:59.712 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T20:53:59.778 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T20:53:59.778 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T20:53:59.778 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000226633 s, 2.3 MB/s 2024-05-08T20:53:59.779 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T20:53:59.838 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2024-05-08T20:53:59.896 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T20:53:59.896 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:53:59.896 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 175019 Links: 1 2024-05-08T20:53:59.896 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:53:59.897 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:53:59.897 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 20:53:40.842964857 +0000 2024-05-08T20:53:59.897 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 20:50:10.436639239 +0000 2024-05-08T20:53:59.897 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 20:50:10.436639239 +0000 2024-05-08T20:53:59.897 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2024-05-08T20:53:59.897 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T20:53:59.963 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T20:53:59.963 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T20:53:59.964 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000255503 s, 2.0 MB/s 2024-05-08T20:53:59.965 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T20:54:00.023 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 184419 Links: 1 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-05-08 20:53:40.842964857 +0000 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-05-08 20:50:10.779630039 +0000 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-05-08 20:50:10.779630039 +0000 2024-05-08T20:54:00.081 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2024-05-08T20:54:00.081 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T20:54:00.146 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-05-08T20:54:00.147 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-05-08T20:54:00.147 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000229273 s, 2.2 MB/s 2024-05-08T20:54:00.148 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T20:54:00.205 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:00.206 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T20:54:00.206 INFO:tasks.ceph:Generating config... 2024-05-08T20:54:00.207 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T20:54:00.207 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T20:54:00.207 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T20:54:00.207 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T20:54:00.207 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T20:54:00.207 INFO:tasks.ceph:[global] lockdep = True 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T20:54:00.208 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T20:54:00.209 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T20:54:00.209 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T20:54:00.209 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T20:54:00.209 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T20:54:00.210 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T20:54:00.210 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T20:54:00.210 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T20:54:00.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T20:54:00.267 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T20:54:00.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T20:54:00.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:54:00.349 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.135'), ('mon.b', '172.21.15.183'), ('mon.c', '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]')] 2024-05-08T20:54:00.349 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.135,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]', 'lockdep': True}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T20:54:00.350 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:00.350 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T20:54:00.407 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.135 --add b 172.21.15.183 --addv c '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:00.495 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:00.495 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: generated fsid 2800f999-7ad2-4fbf-96c4-2e5fd73f8089 2024-05-08T20:54:00.495 INFO:teuthology.orchestra.run.smithi135.stdout:setting min_mon_release = pacific 2024-05-08T20:54:00.495 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 0 2024-05-08T20:54:00.495 INFO:teuthology.orchestra.run.smithi135.stdout:fsid 2800f999-7ad2-4fbf-96c4-2e5fd73f8089 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:last_changed 2024-05-08T20:54:00.493940+0000 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-05-08T20:54:00.493940+0000 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:min_mon_release 16 (pacific) 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:election_strategy: 1 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:2: [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] mon.c 2024-05-08T20:54:00.496 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T20:54:00.497 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T20:54:00.514 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2800f999-7ad2-4fbf-96c4-2e5fd73f8089... 2024-05-08T20:54:00.515 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T20:54:00.557 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T20:54:00.600 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-05-08T20:54:00.600 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-05-08T20:54:00.600 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T20:54:00.600 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-05-08T20:54:00.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-05-08T20:54:00.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-05-08T20:54:00.603 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.135,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: lockdep = True 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 2800f999-7ad2-4fbf-96c4-2e5fd73f8089 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.604 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-05-08T20:54:00.605 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 20 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 20 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-05-08T20:54:00.606 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 10 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-08T20:54:00.607 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-05-08T20:54:00.608 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-05-08T20:54:00.609 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: mon op complaint time = 120 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: client mount timeout = 600 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: debug client = 20 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-08T20:54:00.610 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.e] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.f] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout:[mds] 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds = 20 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout: debug mds balancer = 20 2024-05-08T20:54:00.611 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-05-08T20:54:00.612 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug frag = True 2024-05-08T20:54:00.612 INFO:teuthology.orchestra.run.smithi135.stdout: mds debug scatterstat = True 2024-05-08T20:54:00.612 INFO:teuthology.orchestra.run.smithi135.stdout: mds op complaint time = 180 2024-05-08T20:54:00.612 INFO:teuthology.orchestra.run.smithi135.stdout: mds verify scatter = True 2024-05-08T20:54:00.612 INFO:teuthology.orchestra.run.smithi135.stdout: osd op complaint time = 180 2024-05-08T20:54:00.612 INFO:teuthology.orchestra.run.smithi135.stdout: rados mon op timeout = 900 2024-05-08T20:54:00.612 INFO:teuthology.orchestra.run.smithi135.stdout: rados osd op timeout = 900 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2024-05-08T20:54:00.613 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T20:54:00.614 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.615 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.135,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: lockdep = True 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = 2800f999-7ad2-4fbf-96c4-2e5fd73f8089 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2024-05-08T20:54:00.616 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2024-05-08T20:54:00.617 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2024-05-08T20:54:00.618 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 20 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 20 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 10 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2024-05-08T20:54:00.619 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2024-05-08T20:54:00.620 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T20:54:00.621 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2024-05-08T20:54:00.622 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2024-05-08T20:54:00.623 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.e] 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.f] 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds balancer = 20 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2024-05-08T20:54:00.624 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2024-05-08T20:54:00.626 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T20:54:00.626 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T20:54:00.724 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T20:54:00.724 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:00.724 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T20:54:00.741 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:00.741 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T20:54:00.798 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T20:54:00.799 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:00.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T20:54:00.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:54:00.875 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:00.875 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:00.933 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T20:54:00.933 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:00.933 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T20:54:00.933 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:54:00.973 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:00.973 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:01.030 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T20:54:01.030 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T20:54:01.030 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T20:54:01.084 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T20:54:01.087 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T20:54:01.150 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T20:54:01.153 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T20:54:01.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T20:54:01.207 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T20:54:01.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T20:54:01.236 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T20:54:01.330 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T20:54:01.333 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T20:54:01.360 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-08T20:54:01.453 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-08T20:54:01.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-08T20:54:01.482 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T20:54:01.538 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T20:54:01.541 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T20:54:01.568 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T20:54:01.662 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T20:54:01.664 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T20:54:01.691 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-08T20:54:01.786 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-08T20:54:01.789 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-08T20:54:01.815 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T20:54:01.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T20:54:01.861 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T20:54:01.874 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T20:54:01.875 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T20:54:01.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T20:54:01.902 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:01.902 INFO:tasks.ceph:role: osd.0 2024-05-08T20:54:01.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T20:54:01.902 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T20:54:01.976 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:01.977 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:02.402 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-08T20:54:02.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-08T20:54:02.404 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T20:54:02.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T20:54:02.605 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T20:54:02.674 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:02.674 INFO:tasks.ceph:role: osd.1 2024-05-08T20:54:02.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T20:54:02.675 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T20:54:02.750 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:02.750 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:02.751 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:03.166 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-08T20:54:03.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-08T20:54:03.168 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T20:54:03.281 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T20:54:03.314 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T20:54:03.383 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:03.383 INFO:tasks.ceph:role: osd.2 2024-05-08T20:54:03.383 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T20:54:03.383 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:03.907 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-08T20:54:03.909 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-08T20:54:03.909 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T20:54:04.050 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T20:54:04.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T20:54:04.153 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:04.153 INFO:tasks.ceph:role: osd.3 2024-05-08T20:54:04.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T20:54:04.153 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T20:54:04.227 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:04.227 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:04.228 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:04.669 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-05-08T20:54:04.671 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-05-08T20:54:04.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T20:54:04.836 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T20:54:04.870 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:04.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:04.955+0000 7f75e47f07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T20:54:04.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:04.956+0000 7f75e47f07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T20:54:04.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:04.956+0000 7f75e47f07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:54:04.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:04.956+0000 7f75e47f07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:54:04.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:04.956+0000 7f75e47f07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:54:04.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:04.956+0000 7f75e47f07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T20:54:07.809 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T20:54:07.841 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:07.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:07.930+0000 7f93ac1de7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T20:54:07.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:07.931+0000 7f93ac1de7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T20:54:07.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:07.931+0000 7f93ac1de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:54:07.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:07.931+0000 7f93ac1de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:54:07.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:07.931+0000 7f93ac1de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:54:07.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:07.931+0000 7f93ac1de7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T20:54:10.782 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T20:54:10.816 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:10.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:10.905+0000 7f69158897c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T20:54:10.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:10.905+0000 7f69158897c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T20:54:10.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:10.905+0000 7f69158897c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:54:10.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:10.905+0000 7f69158897c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:54:10.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:10.905+0000 7f69158897c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:54:10.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:10.905+0000 7f69158897c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T20:54:13.761 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T20:54:13.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:13.883+0000 7f7843a597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T20:54:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:13.883+0000 7f7843a597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T20:54:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:13.883+0000 7f7843a597c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:54:13.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:13.883+0000 7f7843a597c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:54:13.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:13.883+0000 7f7843a597c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:54:13.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:13.884+0000 7f7843a597c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T20:54:16.738 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T20:54:16.770 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T20:54:16.803 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:16.803 INFO:tasks.ceph:role: osd.4 2024-05-08T20:54:16.804 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T20:54:16.804 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T20:54:16.882 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:16.882 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:16.882 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:16.883 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:16.883 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:16.883 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:16.883 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:16.883 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:16.883 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:16.883 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:17.309 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T20:54:17.312 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T20:54:17.312 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T20:54:17.479 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T20:54:17.520 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T20:54:17.591 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:17.591 INFO:tasks.ceph:role: osd.5 2024-05-08T20:54:17.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T20:54:17.591 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T20:54:17.667 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:17.668 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:18.091 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T20:54:18.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T20:54:18.093 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T20:54:18.200 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T20:54:18.233 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T20:54:18.302 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:18.303 INFO:tasks.ceph:role: osd.6 2024-05-08T20:54:18.303 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T20:54:18.303 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T20:54:18.378 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:18.378 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:18.378 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:18.378 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:18.378 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:18.379 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:18.379 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:18.379 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:18.379 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:18.379 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:18.826 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T20:54:18.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T20:54:18.828 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T20:54:19.002 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T20:54:19.034 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T20:54:19.103 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:54:19.103 INFO:tasks.ceph:role: osd.7 2024-05-08T20:54:19.103 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T20:54:19.103 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T20:54:19.178 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:54:19.179 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:54:19.630 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-05-08T20:54:19.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-05-08T20:54:19.632 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T20:54:19.810 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T20:54:19.846 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:19.935 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:19.932+0000 7fc8da6137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T20:54:19.936 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:19.933+0000 7fc8da6137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T20:54:19.937 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:19.933+0000 7fc8da6137c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:54:19.937 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:19.933+0000 7fc8da6137c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:54:19.937 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:19.933+0000 7fc8da6137c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:54:19.937 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:19.934+0000 7fc8da6137c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T20:54:22.799 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T20:54:22.834 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:22.923 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:22.919+0000 7f5997f917c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T20:54:22.923 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:22.920+0000 7f5997f917c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T20:54:22.923 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:22.920+0000 7f5997f917c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:54:22.923 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:22.920+0000 7f5997f917c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:54:22.923 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:22.920+0000 7f5997f917c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:54:22.924 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:22.920+0000 7f5997f917c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T20:54:25.767 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T20:54:25.801 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:25.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:25.889+0000 7fb247db27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T20:54:25.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:25.889+0000 7fb247db27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T20:54:25.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:25.889+0000 7fb247db27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:54:25.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:25.889+0000 7fb247db27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:54:25.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:25.889+0000 7fb247db27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:54:25.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:25.890+0000 7fb247db27c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T20:54:28.568 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:28.570 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:28.747 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T20:54:28.776 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:28.866 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:28.862+0000 7ff956cc77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T20:54:28.866 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:28.862+0000 7ff956cc77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T20:54:28.866 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:28.862+0000 7ff956cc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:54:28.866 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:28.862+0000 7ff956cc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:54:28.866 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:28.862+0000 7ff956cc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:54:28.867 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:28.863+0000 7ff956cc77c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T20:54:31.714 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T20:54:31.747 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T20:54:31.747 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:31.747 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T20:54:31.779 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:31.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T20:54:31.850 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:31.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T20:54:31.919 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:31.920 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-08T20:54:31.988 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:31.988 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T20:54:32.057 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:32.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T20:54:32.126 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:32.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T20:54:32.192 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:32.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T20:54:32.259 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.259 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T20:54:32.292 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.292 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T20:54:32.364 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.364 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T20:54:32.434 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.434 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-08T20:54:32.503 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.503 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T20:54:32.573 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.573 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T20:54:32.642 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.642 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T20:54:32.708 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:32.708 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T20:54:32.775 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:32.775 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T20:54:32.793 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T20:54:32.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T20:54:32.836 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T20:54:32.860 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2024-05-08T20:54:32.860 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmToz6BBAAvIsZYbKEJxS3VtH5d0RCgw== 2024-05-08T20:54:32.860 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a] 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmoRFNDBAA3dEZ5mAiEFpG7k0mi+LJ6Q== 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c] 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmLTOjExAAnOKMo0yP+AQoGJaW/vG41w== 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.e] 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmzjL2GhAABpphH6R/K0jc9p53CM37sw== 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBs5jtmZQsNORAANIZ8DG3iHxHa9aciolqhRA== 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBv5jtm2ECQNxAAJQEQVnGQivlz4t0oFkaMKw== 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBy5jtmKHMHNhAAMZj0VF3qfXWfSUdmkV6r+Q== 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB15jtmaDW9NBAAf0K2+YBP7Zv/VXqvG5hR5w== 2024-05-08T20:54:32.861 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmfNXiCBAAWF7WR8OvPl7ArJzO9vrLnw== 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b] 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmg0sIIBAAzpex6jcxx6lsLz7q+E1s0w== 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d] 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtm5yRkJxAAhl90cDcuq+7UAIkdHfqPNQ== 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.f] 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmpLDRLhAAVkcWR4CHqsoeIHkw32tclA== 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB75jtmzX6zNxAAxcvhjxgIZGGofit1Qo5cqw== 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQB+5jtmlyruNhAAeK+xAbGO5QwOKQ7A2YqwlQ== 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2024-05-08T20:54:32.862 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCB5jtm26EbNRAAVtTO8xaL9JYDn7yroHyGaQ== 2024-05-08T20:54:32.863 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2024-05-08T20:54:32.863 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCE5jtmz+uEMxAAe8Vr6vqg531s4trwqr222A== 2024-05-08T20:54:32.863 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-05-08T20:54:32.863 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQBp5jtmJhBJMxAAwu58ENC6ArQZvnI5Sg+6sQ== 2024-05-08T20:54:32.864 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2024-05-08T20:54:32.864 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmToz6BBAAvIsZYbKEJxS3VtH5d0RCgw== 2024-05-08T20:54:32.864 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2024-05-08T20:54:32.864 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmoRFNDBAA3dEZ5mAiEFpG7k0mi+LJ6Q== 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmLTOjExAAnOKMo0yP+AQoGJaW/vG41w== 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.e] 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmzjL2GhAABpphH6R/K0jc9p53CM37sw== 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBs5jtmZQsNORAANIZ8DG3iHxHa9aciolqhRA== 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBv5jtm2ECQNxAAJQEQVnGQivlz4t0oFkaMKw== 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBy5jtmKHMHNhAAMZj0VF3qfXWfSUdmkV6r+Q== 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB15jtmaDW9NBAAf0K2+YBP7Zv/VXqvG5hR5w== 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2024-05-08T20:54:32.865 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmfNXiCBAAWF7WR8OvPl7ArJzO9vrLnw== 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmg0sIIBAAzpex6jcxx6lsLz7q+E1s0w== 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtm5yRkJxAAhl90cDcuq+7UAIkdHfqPNQ== 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.f] 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmpLDRLhAAVkcWR4CHqsoeIHkw32tclA== 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB75jtmzX6zNxAAxcvhjxgIZGGofit1Qo5cqw== 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQB+5jtmlyruNhAAeK+xAbGO5QwOKQ7A2YqwlQ== 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCB5jtm26EbNRAAVtTO8xaL9JYDn7yroHyGaQ== 2024-05-08T20:54:32.866 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2024-05-08T20:54:32.867 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQCE5jtmz+uEMxAAe8Vr6vqg531s4trwqr222A== 2024-05-08T20:54:32.867 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2024-05-08T20:54:32.867 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBp5jtmJhBJMxAAwu58ENC6ArQZvnI5Sg+6sQ== 2024-05-08T20:54:32.867 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:54:32.908 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:54:32.962 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:32.964 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.021 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.023 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.081 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.140 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.193 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.195 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.248 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.250 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.303 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.305 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.358 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:54:33.360 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:54:33.413 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.415 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.472 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.474 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.530 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.533 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:54:33.589 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.591 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.644 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.646 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.699 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.702 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.754 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.757 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:54:33.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:54:33.812 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:54:33.868 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T20:54:33.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T20:54:33.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:54:33.994 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T20:54:34.021 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T20:54:34.048 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:54:34.149 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T20:54:34.175 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T20:54:34.242 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:54:34.342 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T20:54:34.368 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:34.371 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:54:34.426 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T20:54:34.426 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:54:34.426 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:54:34.428 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:54:34.428 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:54:34.428 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:54:34.468 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:54:34.468 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:54:34.468 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:54:34.470 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:54:34.470 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T20:54:34.471 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T20:54:34.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T20:54:34.473 INFO:tasks.ceph.mgr.y:Started 2024-05-08T20:54:34.473 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T20:54:34.473 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T20:54:34.475 INFO:tasks.ceph.mgr.x:Started 2024-05-08T20:54:34.475 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T20:54:34.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T20:54:34.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.596+0000 7ff6125e5700 1 Processor -- start 2024-05-08T20:54:34.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.596+0000 7ff6125e5700 1 -- start start 2024-05-08T20:54:34.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff6125e5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff60c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:34.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff6125e5700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c066d80 con 0x7ff60c06afd0 2024-05-08T20:54:34.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff6125e5700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c157b10 con 0x7ff60c0c4b80 2024-05-08T20:54:34.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff6125e5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1406d0 con 0x7ff60c0c4f60 2024-05-08T20:54:34.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff610b82700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff60c06afd0 0x7ff60c150ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:52358/0 (socket says 172.21.15.135:52358) 2024-05-08T20:54:34.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff610b82700 1 -- 172.21.15.135:0/1603159105 learned_addr learned my addr 172.21.15.135:0/1603159105 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:34.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff60b7fe700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff60c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:34.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff60b7fe700 1 -- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 msgr2=0x7ff60c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:54:34.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff60b7fe700 1 -- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 msgr2=0x7ff60c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:54:34.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff60b7fe700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff60c06a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:54:34.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.597+0000 7ff60b7fe700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff60c06a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:54:34.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.765+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834808138 0 0) 0x7ff60c066d80 con 0x7ff60c06afd0 2024-05-08T20:54:34.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.765+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f80035b0 con 0x7ff60c06afd0 2024-05-08T20:54:34.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738447949 0 0) 0x7ff5f80035b0 con 0x7ff60c06afd0 2024-05-08T20:54:34.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 msgr2=0x7ff60c06a960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff60c06a960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 >> v1:172.21.15.183:6789/0 conn(0x7ff60c0c4b80 legacy=0x7ff60c15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c066aa0 con 0x7ff60c06afd0 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7ff6040019f0 con 0x7ff60c06afd0 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 >> v1:172.21.15.135:6789/0 conn(0x7ff60c06afd0 legacy=0x7ff60c150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff5f8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004060 0x7ff5f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5f8004d90 0x7ff5f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1406d0 con 0x7ff5f8004d90 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f800bc60 con 0x7ff5f8004060 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f800be20 con 0x7ff60c0c4f60 2024-05-08T20:54:34.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.766+0000 7ff610b82700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5f8004d90 0x7ff5f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff60b7fe700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004060 0x7ff5f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff60bfff700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff5f8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff610b82700 1 -- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 msgr2=0x7ff5f8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff610b82700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c0c4f60 0x7ff5f8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff610b82700 1 -- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004060 msgr2=0x7ff5f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff610b82700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004060 0x7ff5f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff610b82700 1 -- 172.21.15.135:0/1603159105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80035b0 con 0x7ff5f8004d90 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff610b82700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5f8004d90 0x7ff5f8005210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff60400a830 tx=0x7ff5f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a459bf1f6eca906 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400a2f0 con 0x7ff5f8004d90 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff604012620 con 0x7ff5f8004d90 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.767+0000 7ff60affd700 1 -- 172.21.15.135:0/1603159105 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6040129d0 con 0x7ff5f8004d90 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.768+0000 7ff6125e5700 1 -- 172.21.15.135:0/1603159105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5f8004d90 msgr2=0x7ff5f8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:34.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.768+0000 7ff6125e5700 1 --2- 172.21.15.135:0/1603159105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5f8004d90 0x7ff5f8005210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff60400a830 tx=0x7ff5f8005880 comp rx=0 tx=0).stop 2024-05-08T20:54:34.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.768+0000 7ff610b82700 1 -- 172.21.15.135:0/1603159105 reap_dead start 2024-05-08T20:54:34.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.768+0000 7ff6125e5700 1 -- 172.21.15.135:0/1603159105 shutdown_connections 2024-05-08T20:54:34.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.768+0000 7ff6125e5700 1 -- 172.21.15.135:0/1603159105 >> 172.21.15.135:0/1603159105 conn(0x7ff60c0cb200 msgr2=0x7ff60c0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:34.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.768+0000 7ff6125e5700 1 -- 172.21.15.135:0/1603159105 shutdown_connections 2024-05-08T20:54:34.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.768+0000 7ff6125e5700 1 -- 172.21.15.135:0/1603159105 wait complete. 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.770+0000 7ff6125e5700 1 Processor -- start 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.770+0000 7ff6125e5700 1 -- start start 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff6125e5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004d90 0x7ff60c1eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff6125e5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c154840 0x7ff60c159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff6125e5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff60c152830 0x7ff60c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff6125e5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c153220 con 0x7ff60c152830 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff6125e5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c159ec0 con 0x7ff5f8004d90 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff6125e5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c15a160 con 0x7ff60c154840 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff60c152830 0x7ff60c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:34.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004d90 0x7ff60c1eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c154840 0x7ff60c159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff60bfff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004d90 0x7ff60c1eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:52708/0 (socket says 172.21.15.135:52708) 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff60c152830 0x7ff60c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33890/0 (socket says 172.21.15.135:33890) 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff60b7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c154840 0x7ff60c159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:47276/0 (socket says 172.21.15.135:47276) 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff60bfff700 1 -- 172.21.15.135:0/1098453276 learned_addr learned my addr 172.21.15.135:0/1098453276 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 -- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c154840 msgr2=0x7ff60c159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c154840 0x7ff60c159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 -- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004d90 msgr2=0x7ff60c1eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004d90 0x7ff60c1eaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 -- 172.21.15.135:0/1098453276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c15a440 con 0x7ff60c152830 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff60b7fe700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c154840 0x7ff60c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:34.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff60bfff700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004d90 0x7ff60c1eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.771+0000 7ff610b82700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff60c152830 0x7ff60c152ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff604015000 tx=0x7ff604001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.773+0000 7ff608ff9700 1 -- 172.21.15.135:0/1098453276 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604024070 con 0x7ff60c152830 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.773+0000 7ff608ff9700 1 -- 172.21.15.135:0/1098453276 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400a210 con 0x7ff60c152830 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.773+0000 7ff608ff9700 1 -- 172.21.15.135:0/1098453276 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6040124c0 con 0x7ff60c152830 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.773+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c15a720 con 0x7ff60c152830 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.773+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c152030 con 0x7ff60c152830 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.773+0000 7ff608ff9700 1 -- 172.21.15.135:0/1098453276 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff60401e640 con 0x7ff60c152830 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.773+0000 7ff608ff9700 1 -- 172.21.15.135:0/1098453276 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff604029540 con 0x7ff60c152830 2024-05-08T20:54:34.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.774+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c067fa0 con 0x7ff60c152830 2024-05-08T20:54:34.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.778+0000 7ff608ff9700 1 -- 172.21.15.135:0/1098453276 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7ff60400a450 con 0x7ff60c152830 2024-05-08T20:54:34.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.854+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff60c073cf0 con 0x7ff60c152830 2024-05-08T20:54:34.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.858+0000 7ff608ff9700 1 -- 172.21.15.135:0/1098453276 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff60401ead0 con 0x7ff60c152830 2024-05-08T20:54:34.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.859+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff60c152830 msgr2=0x7ff60c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.859+0000 7ff6125e5700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff60c152830 0x7ff60c152ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff604015000 tx=0x7ff604001d80 comp rx=0 tx=0).stop 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.859+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 shutdown_connections 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.859+0000 7ff6125e5700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5f8004d90 0x7ff60c1eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.859+0000 7ff6125e5700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff60c152830 0x7ff60c152ce0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.859+0000 7ff6125e5700 1 --2- 172.21.15.135:0/1098453276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff60c154840 0x7ff60c159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.859+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 >> 172.21.15.135:0/1098453276 conn(0x7ff60c0cb200 msgr2=0x7ff60c13fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.860+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 shutdown_connections 2024-05-08T20:54:34.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:34.860+0000 7ff6125e5700 1 -- 172.21.15.135:0/1098453276 wait complete. 2024-05-08T20:54:34.862 INFO:teuthology.orchestra.run.smithi135.stderr:adjusted tunables profile to default 2024-05-08T20:54:34.873 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T20:54:34.873 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T20:54:34.874 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:34.874 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T20:54:34.900 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:34.900 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T20:54:34.967 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:34.967 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T20:54:35.033 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:54:35.033 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T20:54:35.099 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:35.099 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T20:54:35.129 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:35.130 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T20:54:35.192 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.191+0000 7feaa2ced200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:54:35.195 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:35.194+0000 7fcae8b30200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:54:35.196 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:35.196 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T20:54:35.265 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-05-08T20:54:35.265 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T20:54:35.271 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.270+0000 7feaa2ced200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:54:35.281 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:35.279+0000 7fcae8b30200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:54:35.308 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 86a512b8-6b0d-4807-8cc2-f4176131b3c4 0 2024-05-08T20:54:35.345 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.343+0000 7feaa2ced200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:54:35.359 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:35.357+0000 7fcae8b30200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:54:35.415 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.413+0000 7feaa2ced200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:54:35.433 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:35.431+0000 7fcae8b30200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:54:35.471 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.468+0000 7f2522996700 1 Processor -- start 2024-05-08T20:54:35.471 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.468+0000 7f2522996700 1 -- start start 2024-05-08T20:54:35.473 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.469+0000 7f2522996700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f251c0ce380 0x7f251c06baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.473 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f2522996700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c159590 con 0x7f251c0cca70 2024-05-08T20:54:35.473 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f2522996700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c06c350 con 0x7f251c0ca0e0 2024-05-08T20:54:35.473 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f2522996700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c159850 con 0x7f251c0ce380 2024-05-08T20:54:35.473 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251bfff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f251c0ce380 0x7f251c06baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.473 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251b7fe700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f251c0ca0e0 0x7f251c0c9610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:46892/0 (socket says 172.21.15.183:46892) 2024-05-08T20:54:35.473 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251bfff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f251c0ce380 0x7f251c06baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:48404/0 (socket says 172.21.15.183:48404) 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251b7fe700 1 -- 172.21.15.183:0/32099473 learned_addr learned my addr 172.21.15.183:0/32099473 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251bfff700 1 -- 172.21.15.183:0/32099473 >> v1:172.21.15.183:6789/0 conn(0x7f251c0ca0e0 legacy=0x7f251c0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251bfff700 1 -- 172.21.15.183:0/32099473 >> v1:172.21.15.135:6789/0 conn(0x7f251c0cca70 legacy=0x7f251c163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251affd700 1 -- 172.21.15.183:0/32099473 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810392973 0 0) 0x7f251c06c350 con 0x7f251c0ca0e0 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251bfff700 1 -- 172.21.15.183:0/32099473 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c159b30 con 0x7f251c0ce380 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251bfff700 1 --2- 172.21.15.183:0/32099473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0ce380 0x7f251c06baa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f250c009840 tx=0x7f250c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d74d0128a7918b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251affd700 1 -- 172.21.15.183:0/32099473 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c011830 con 0x7f251c0ce380 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251affd700 1 -- 172.21.15.183:0/32099473 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c011990 con 0x7f251c0ce380 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.470+0000 7f251affd700 1 -- 172.21.15.183:0/32099473 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c011d20 con 0x7f251c0ce380 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.471+0000 7f2522996700 1 -- 172.21.15.183:0/32099473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0ce380 msgr2=0x7f251c06baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.471+0000 7f2522996700 1 --2- 172.21.15.183:0/32099473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0ce380 0x7f251c06baa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f250c009840 tx=0x7f250c009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.471+0000 7f2522996700 1 -- 172.21.15.183:0/32099473 shutdown_connections 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.471+0000 7f2522996700 1 --2- 172.21.15.183:0/32099473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0ce380 0x7f251c06baa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.474 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.471+0000 7f2522996700 1 -- 172.21.15.183:0/32099473 >> 172.21.15.183:0/32099473 conn(0x7f251c0cec90 msgr2=0x7f251c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:35.475 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.471+0000 7f2522996700 1 -- 172.21.15.183:0/32099473 shutdown_connections 2024-05-08T20:54:35.475 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.471+0000 7f2522996700 1 -- 172.21.15.183:0/32099473 wait complete. 2024-05-08T20:54:35.477 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.472+0000 7f2522996700 1 Processor -- start 2024-05-08T20:54:35.477 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.472+0000 7f2522996700 1 -- start start 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2522996700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f251c0ca0e0 0x7f251c0b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2522996700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0cca70 0x7f251c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2522996700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c0ce380 0x7f251c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2522996700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c2570 con 0x7f251c0ca0e0 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2522996700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0c2750 con 0x7f251c0cca70 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2522996700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1f3040 con 0x7f251c0ce380 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0cca70 0x7f251c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0cca70 0x7f251c0b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:48412/0 (socket says 172.21.15.183:48412) 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 -- 172.21.15.183:0/3898942495 learned_addr learned my addr 172.21.15.183:0/3898942495 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2520f33700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c0ce380 0x7f251c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251bfff700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f251c0ca0e0 0x7f251c0b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 -- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c0ce380 msgr2=0x7f251c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.478 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c0ce380 0x7f251c0b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 -- 172.21.15.183:0/3898942495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f251c0ca0e0 msgr2=0x7f251c0b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f251c0ca0e0 0x7f251c0b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f251b7fe700 1 -- 172.21.15.183:0/3898942495 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c0094a0 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.473+0000 7f2520f33700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c0ce380 0x7f251c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.474+0000 7f251b7fe700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0cca70 0x7f251c0b4230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f251000c550 tx=0x7f251000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.474+0000 7f2518ff9700 1 -- 172.21.15.183:0/3898942495 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510004c80 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.474+0000 7f2518ff9700 1 -- 172.21.15.183:0/3898942495 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510004de0 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.474+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c1f3320 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.474+0000 7f2518ff9700 1 -- 172.21.15.183:0/3898942495 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510007310 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.474+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c0b37d0 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.475+0000 7f2518ff9700 1 -- 172.21.15.183:0/3898942495 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f251001d3f0 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.475+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c0b39c0 con 0x7f251c0cca70 2024-05-08T20:54:35.479 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.475+0000 7f2518ff9700 1 -- 172.21.15.183:0/3898942495 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2510013700 con 0x7f251c0cca70 2024-05-08T20:54:35.481 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.479+0000 7f2518ff9700 1 -- 172.21.15.183:0/3898942495 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f251001d8d0 con 0x7f251c0cca70 2024-05-08T20:54:35.566 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.564+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86a512b8-6b0d-4807-8cc2-f4176131b3c4", "id": 0} v 0) v1 -- 0x7f251c067fa0 con 0x7f251c0cca70 2024-05-08T20:54:35.571 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.569+0000 7f2518ff9700 1 -- 172.21.15.183:0/3898942495 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86a512b8-6b0d-4807-8cc2-f4176131b3c4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f251001da70 con 0x7f251c0cca70 2024-05-08T20:54:35.572 INFO:teuthology.orchestra.run.smithi183.stdout:0 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0cca70 msgr2=0x7f251c0b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0cca70 0x7f251c0b4230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f251000c550 tx=0x7f251000c860 comp rx=0 tx=0).stop 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 shutdown_connections 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f251c0ce380 0x7f251c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f251c0ca0e0 0x7f251c0b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 --2- 172.21.15.183:0/3898942495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f251c0cca70 0x7f251c0b4230 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 >> 172.21.15.183:0/3898942495 conn(0x7f251c0cec90 msgr2=0x7f251c0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 shutdown_connections 2024-05-08T20:54:35.573 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.570+0000 7f2522996700 1 -- 172.21.15.183:0/3898942495 wait complete. 2024-05-08T20:54:35.585 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new afc8bb5b-d959-4654-b521-5181a042affa 1 2024-05-08T20:54:35.588 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.587+0000 7feaa2ced200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:54:35.618 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:35.616+0000 7fcae8b30200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:54:35.742 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.737+0000 7f57077f9700 1 Processor -- start 2024-05-08T20:54:35.742 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.737+0000 7f57077f9700 1 -- start start 2024-05-08T20:54:35.742 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f57077f9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f57001571f0 0x7f57000c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.742 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f57077f9700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570015abf0 con 0x7f57000c89b0 2024-05-08T20:54:35.742 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f57077f9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570015b790 con 0x7f57001512e0 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f57077f9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5700157650 con 0x7f57001571f0 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f5704d94700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f57001571f0 0x7f57000c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f5705595700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f57001512e0 0x7f570015b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:46902/0 (socket says 172.21.15.183:46902) 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f5705595700 1 -- 172.21.15.183:0/680050521 learned_addr learned my addr 172.21.15.183:0/680050521 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f5704d94700 1 -- 172.21.15.183:0/680050521 >> v1:172.21.15.183:6789/0 conn(0x7f57001512e0 legacy=0x7f570015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f5704d94700 1 -- 172.21.15.183:0/680050521 >> v1:172.21.15.135:6789/0 conn(0x7f57000c89b0 legacy=0x7f57000c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.738+0000 7f5704d94700 1 -- 172.21.15.183:0/680050521 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57001516c0 con 0x7f57001571f0 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.739+0000 7f5704d94700 1 --2- 172.21.15.183:0/680050521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 0x7f57000c8470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009840 tx=0x7f56f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb2769228460d9f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.739+0000 7f56f7fff700 1 -- 172.21.15.183:0/680050521 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0011830 con 0x7f57001571f0 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.739+0000 7f56f7fff700 1 -- 172.21.15.183:0/680050521 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0011990 con 0x7f57001571f0 2024-05-08T20:54:35.743 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.739+0000 7f56f7fff700 1 -- 172.21.15.183:0/680050521 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0011d20 con 0x7f57001571f0 2024-05-08T20:54:35.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.739+0000 7f57077f9700 1 -- 172.21.15.183:0/680050521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 msgr2=0x7f57000c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.739+0000 7f57077f9700 1 --2- 172.21.15.183:0/680050521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 0x7f57000c8470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009840 tx=0x7f56f0009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:35.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.739+0000 7f57077f9700 1 -- 172.21.15.183:0/680050521 shutdown_connections 2024-05-08T20:54:35.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.740+0000 7f57077f9700 1 --2- 172.21.15.183:0/680050521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 0x7f57000c8470 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.740+0000 7f57077f9700 1 -- 172.21.15.183:0/680050521 >> 172.21.15.183:0/680050521 conn(0x7f570006a960 msgr2=0x7f570006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:35.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.740+0000 7f57077f9700 1 -- 172.21.15.183:0/680050521 shutdown_connections 2024-05-08T20:54:35.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.740+0000 7f57077f9700 1 -- 172.21.15.183:0/680050521 wait complete. 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.741+0000 7f57077f9700 1 Processor -- start 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.741+0000 7f57077f9700 1 -- start start 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.741+0000 7f57077f9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57000c89b0 0x7f57001efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.741+0000 7f57077f9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57001512e0 0x7f57000ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f57077f9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 0x7f57000cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f57077f9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57001f0040 con 0x7f57001512e0 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f57077f9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57000ca840 con 0x7f57001571f0 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f57077f9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57001583a0 con 0x7f57000c89b0 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57000c89b0 0x7f57001efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.748 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57000c89b0 0x7f57001efb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:38236/0 (socket says 172.21.15.183:38236) 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 -- 172.21.15.183:0/1112170112 learned_addr learned my addr 172.21.15.183:0/1112170112 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705d96700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 0x7f57000cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5704d94700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57001512e0 0x7f57000ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 -- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 msgr2=0x7f57000cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 0x7f57000cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 -- 172.21.15.183:0/1112170112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57001512e0 msgr2=0x7f57000ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57001512e0 0x7f57000ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 -- 172.21.15.183:0/1112170112 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f00094a0 con 0x7f57000c89b0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f5705595700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57000c89b0 0x7f57001efb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00c520 tx=0x7f56fc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f56f5ffb700 1 -- 172.21.15.183:0/1112170112 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc005d70 con 0x7f57000c89b0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f56f5ffb700 1 -- 172.21.15.183:0/1112170112 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56fc0070d0 con 0x7f57000c89b0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f56f5ffb700 1 -- 172.21.15.183:0/1112170112 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc007440 con 0x7f57000c89b0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570014f020 con 0x7f57000c89b0 2024-05-08T20:54:35.749 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f56f5ffb700 1 -- 172.21.15.183:0/1112170112 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f56fc012400 con 0x7f57000c89b0 2024-05-08T20:54:35.750 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.742+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57000cad70 con 0x7f57000c89b0 2024-05-08T20:54:35.750 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.743+0000 7f56f5ffb700 1 -- 172.21.15.183:0/1112170112 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f56fc012c90 con 0x7f57000c89b0 2024-05-08T20:54:35.750 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.743+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57000b1860 con 0x7f57000c89b0 2024-05-08T20:54:35.750 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.745+0000 7f56f5ffb700 1 -- 172.21.15.183:0/1112170112 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f56fc017070 con 0x7f57000c89b0 2024-05-08T20:54:35.754 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.752+0000 7feaa2ced200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:54:35.797 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:35.795+0000 7fcae8b30200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:54:35.835 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.833+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "afc8bb5b-d959-4654-b521-5181a042affa", "id": 1} v 0) v1 -- 0x7f5700067fa0 con 0x7f57000c89b0 2024-05-08T20:54:35.843 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.841+0000 7f56f5ffb700 1 -- 172.21.15.183:0/1112170112 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "afc8bb5b-d959-4654-b521-5181a042affa", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f570015b790 con 0x7f57000c89b0 2024-05-08T20:54:35.843 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-05-08T20:54:35.844 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57000c89b0 msgr2=0x7f57001efb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.844 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57000c89b0 0x7f57001efb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00c520 tx=0x7f56fc00c830 comp rx=0 tx=0).stop 2024-05-08T20:54:35.844 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 shutdown_connections 2024-05-08T20:54:35.844 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57001571f0 0x7f57000cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.844 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57000c89b0 0x7f57001efb00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.844 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 --2- 172.21.15.183:0/1112170112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57001512e0 0x7f57000ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.845 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 >> 172.21.15.183:0/1112170112 conn(0x7f570006a960 msgr2=0x7f57000c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:35.845 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 shutdown_connections 2024-05-08T20:54:35.845 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.842+0000 7f57077f9700 1 -- 172.21.15.183:0/1112170112 wait complete. 2024-05-08T20:54:35.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 43e6e948-9284-4f07-8e6c-91cdb06a16a0 2 2024-05-08T20:54:35.865 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.864+0000 7feaa2ced200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:54:35.916 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:35.914+0000 7fcae8b30200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:54:35.960 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:35.958+0000 7feaa2ced200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:54:35.978 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.976+0000 7fe40a9cd700 1 Processor -- start 2024-05-08T20:54:35.979 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.976+0000 7fe40a9cd700 1 -- start start 2024-05-08T20:54:35.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe40a9cd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe4040c9e80 0x7fe40415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe40a9cd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe4040c1f70 0x7fe4040c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe40a9cd700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40415b620 con 0x7fe404151400 2024-05-08T20:54:35.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe40a9cd700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040c1b20 con 0x7fe4040c9e80 2024-05-08T20:54:35.981 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe40a9cd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4040cd8e0 con 0x7fe4040c1f70 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe408f6a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe4040c1f70 0x7fe4040c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe403fff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe404151400 0x7fe404070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:46906/0 (socket says 172.21.15.183:46906) 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe403fff700 1 -- 172.21.15.183:0/4264951583 learned_addr learned my addr 172.21.15.183:0/4264951583 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.977+0000 7fe408f6a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe4040c1f70 0x7fe4040c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:48420/0 (socket says 172.21.15.183:48420) 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe4037fe700 1 --2- 172.21.15.183:0/4264951583 >> v2:172.21.15.135:3300/0 conn(0x7fe4040c9e80 0x7fe40415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe408f6a700 1 -- 172.21.15.183:0/4264951583 >> v2:172.21.15.135:3300/0 conn(0x7fe4040c9e80 msgr2=0x7fe40415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe408f6a700 1 --2- 172.21.15.183:0/4264951583 >> v2:172.21.15.135:3300/0 conn(0x7fe4040c9e80 0x7fe40415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe408f6a700 1 -- 172.21.15.183:0/4264951583 >> v1:172.21.15.183:6789/0 conn(0x7fe404151400 legacy=0x7fe404070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe408f6a700 1 -- 172.21.15.183:0/4264951583 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040c2900 con 0x7fe4040c1f70 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe402ffd700 1 -- 172.21.15.183:0/4264951583 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945589015 0 0) 0x7fe40415b620 con 0x7fe404151400 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe408f6a700 1 --2- 172.21.15.183:0/4264951583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040c23c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe4040c1c60 tx=0x7fe3fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eb5456582eb5dc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe402ffd700 1 -- 172.21.15.183:0/4264951583 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc016070 con 0x7fe4040c1f70 2024-05-08T20:54:35.982 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe402ffd700 1 -- 172.21.15.183:0/4264951583 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc00baf0 con 0x7fe4040c1f70 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.978+0000 7fe402ffd700 1 -- 172.21.15.183:0/4264951583 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc00e070 con 0x7fe4040c1f70 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 -- 172.21.15.183:0/4264951583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 msgr2=0x7fe4040c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 --2- 172.21.15.183:0/4264951583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040c23c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe4040c1c60 tx=0x7fe3fc00b330 comp rx=0 tx=0).stop 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 -- 172.21.15.183:0/4264951583 shutdown_connections 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 --2- 172.21.15.183:0/4264951583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040c23c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 --2- 172.21.15.183:0/4264951583 >> v2:172.21.15.135:3300/0 conn(0x7fe4040c9e80 0x7fe40415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 -- 172.21.15.183:0/4264951583 >> 172.21.15.183:0/4264951583 conn(0x7fe404066d70 msgr2=0x7fe40406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 -- 172.21.15.183:0/4264951583 shutdown_connections 2024-05-08T20:54:35.983 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.979+0000 7fe40a9cd700 1 -- 172.21.15.183:0/4264951583 wait complete. 2024-05-08T20:54:35.985 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.980+0000 7fe40a9cd700 1 Processor -- start 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.980+0000 7fe40a9cd700 1 -- start start 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe40a9cd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe40a9cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4040c9e80 0x7fe404159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe40a9cd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe404151400 0x7fe404153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe40a9cd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404152bf0 con 0x7fe4040c9e80 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe40a9cd700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404153910 con 0x7fe4040c1f70 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe40a9cd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040c31c0 con 0x7fe404151400 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe408f6a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe404151400 0x7fe404153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe403fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe408f6a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe404151400 0x7fe404153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:38246/0 (socket says 172.21.15.183:38246) 2024-05-08T20:54:35.986 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe408f6a700 1 -- 172.21.15.183:0/1615156883 learned_addr learned my addr 172.21.15.183:0/1615156883 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe4037fe700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4040c9e80 0x7fe404159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe403fff700 1 -- 172.21.15.183:0/1615156883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe404151400 msgr2=0x7fe404153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe403fff700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe404151400 0x7fe404153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe403fff700 1 -- 172.21.15.183:0/1615156883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4040c9e80 msgr2=0x7fe404159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe403fff700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4040c9e80 0x7fe404159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe403fff700 1 -- 172.21.15.183:0/1615156883 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc009a70 con 0x7fe4040c1f70 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe4037fe700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4040c9e80 0x7fe404159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe403fff700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040cb520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c410 tx=0x7fe3f400c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe400ff9700 1 -- 172.21.15.183:0/1615156883 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4004c80 con 0x7fe4040c1f70 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe400ff9700 1 -- 172.21.15.183:0/1615156883 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4004de0 con 0x7fe4040c1f70 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40415ac50 con 0x7fe4040c1f70 2024-05-08T20:54:35.987 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.981+0000 7fe400ff9700 1 -- 172.21.15.183:0/1615156883 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4007310 con 0x7fe4040c1f70 2024-05-08T20:54:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.982+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe404152fe0 con 0x7fe4040c1f70 2024-05-08T20:54:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.982+0000 7fe400ff9700 1 -- 172.21.15.183:0/1615156883 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe3f401d3f0 con 0x7fe4040c1f70 2024-05-08T20:54:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.982+0000 7fe400ff9700 1 -- 172.21.15.183:0/1615156883 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe3f400ce20 con 0x7fe4040c1f70 2024-05-08T20:54:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.982+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4040b2c70 con 0x7fe4040c1f70 2024-05-08T20:54:35.988 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:35.984+0000 7fe400ff9700 1 -- 172.21.15.183:0/1615156883 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fe3f401dc70 con 0x7fe4040c1f70 2024-05-08T20:54:36.017 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:36.015+0000 7fcae8b30200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:54:36.037 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:36.036+0000 7feaa2ced200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:54:36.072 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.070+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43e6e948-9284-4f07-8e6c-91cdb06a16a0", "id": 2} v 0) v1 -- 0x7fe404067fa0 con 0x7fe4040c1f70 2024-05-08T20:54:36.080 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.078+0000 7fe400ff9700 1 -- 172.21.15.183:0/1615156883 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43e6e948-9284-4f07-8e6c-91cdb06a16a0", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe3f401d770 con 0x7fe4040c1f70 2024-05-08T20:54:36.081 INFO:teuthology.orchestra.run.smithi183.stdout:2 2024-05-08T20:54:36.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.079+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 msgr2=0x7fe4040cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.079+0000 7fe40a9cd700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040cb520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c410 tx=0x7fe3f400c720 comp rx=0 tx=0).stop 2024-05-08T20:54:36.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.079+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 shutdown_connections 2024-05-08T20:54:36.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.080+0000 7fe40a9cd700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4040c1f70 0x7fe4040cb520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.080+0000 7fe40a9cd700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe404151400 0x7fe404153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.080+0000 7fe40a9cd700 1 --2- 172.21.15.183:0/1615156883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4040c9e80 0x7fe404159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.080+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 >> 172.21.15.183:0/1615156883 conn(0x7fe404066d70 msgr2=0x7fe404150790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:36.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.080+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 shutdown_connections 2024-05-08T20:54:36.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.080+0000 7fe40a9cd700 1 -- 172.21.15.183:0/1615156883 wait complete. 2024-05-08T20:54:36.094 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 438d2541-1287-42d0-936c-21a306edbb55 3 2024-05-08T20:54:36.096 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:36.094+0000 7fcae8b30200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:54:36.218 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.215+0000 7ff4a939b700 1 Processor -- start 2024-05-08T20:54:36.218 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.215+0000 7ff4a939b700 1 -- start start 2024-05-08T20:54:36.220 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a939b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff4a4153450 0x7ff4a4072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a939b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a40cc770 0x7ff4a4072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a939b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a40c2d40 con 0x7ff4a40c6990 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a939b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a40cc0b0 con 0x7ff4a4153450 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a939b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40c2130 con 0x7ff4a40cc770 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a27fc700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ff4a40c6990 0x7ff4a415cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:46918/0 (socket says 172.21.15.183:46918) 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a37fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a40cc770 0x7ff4a4072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a27fc700 1 -- 172.21.15.183:0/1997527596 learned_addr learned my addr 172.21.15.183:0/1997527596 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.216+0000 7ff4a2ffd700 1 --2- 172.21.15.183:0/1997527596 >> v2:172.21.15.135:3300/0 conn(0x7ff4a4153450 0x7ff4a4072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a1ffb700 1 -- 172.21.15.183:0/1997527596 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401825930 0 0) 0x7ff4a40c2d40 con 0x7ff4a40c6990 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a1ffb700 1 -- 172.21.15.183:0/1997527596 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff48c0035b0 con 0x7ff4a40c6990 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a37fe700 1 -- 172.21.15.183:0/1997527596 >> v2:172.21.15.135:3300/0 conn(0x7ff4a4153450 msgr2=0x7ff4a4072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a37fe700 1 --2- 172.21.15.183:0/1997527596 >> v2:172.21.15.135:3300/0 conn(0x7ff4a4153450 0x7ff4a4072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.221 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a37fe700 1 -- 172.21.15.183:0/1997527596 >> v1:172.21.15.183:6789/0 conn(0x7ff4a40c6990 legacy=0x7ff4a415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a37fe700 1 -- 172.21.15.183:0/1997527596 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a40c2410 con 0x7ff4a40cc770 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a37fe700 1 --2- 172.21.15.183:0/1997527596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a40cc770 0x7ff4a4072660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009d90 tx=0x7ff49c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10255937c773c467 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a1ffb700 1 -- 172.21.15.183:0/1997527596 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c00e070 con 0x7ff4a40cc770 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a1ffb700 1 -- 172.21.15.183:0/1997527596 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c00bb20 con 0x7ff4a40cc770 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a1ffb700 1 -- 172.21.15.183:0/1997527596 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c012430 con 0x7ff4a40cc770 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a939b700 1 -- 172.21.15.183:0/1997527596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a40cc770 msgr2=0x7ff4a4072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.217+0000 7ff4a939b700 1 --2- 172.21.15.183:0/1997527596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a40cc770 0x7ff4a4072660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009d90 tx=0x7ff49c00b330 comp rx=0 tx=0).stop 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.218+0000 7ff4a939b700 1 -- 172.21.15.183:0/1997527596 shutdown_connections 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.218+0000 7ff4a939b700 1 --2- 172.21.15.183:0/1997527596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a40cc770 0x7ff4a4072660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.218+0000 7ff4a939b700 1 --2- 172.21.15.183:0/1997527596 >> v2:172.21.15.135:3300/0 conn(0x7ff4a4153450 0x7ff4a4072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.218+0000 7ff4a939b700 1 -- 172.21.15.183:0/1997527596 >> 172.21.15.183:0/1997527596 conn(0x7ff4a406ec40 msgr2=0x7ff4a406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.218+0000 7ff4a939b700 1 -- 172.21.15.183:0/1997527596 shutdown_connections 2024-05-08T20:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.218+0000 7ff4a939b700 1 -- 172.21.15.183:0/1997527596 wait complete. 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.220+0000 7ff4a939b700 1 Processor -- start 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.220+0000 7ff4a939b700 1 -- start start 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a939b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a40c6990 0x7ff4a40c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a939b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4a40cc770 0x7ff4a41f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a939b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a4153450 0x7ff4a41477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a939b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40c5820 con 0x7ff4a40c6990 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a939b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4156760 con 0x7ff4a40cc770 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a939b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a41f24f0 con 0x7ff4a4153450 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4a40cc770 0x7ff4a41f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a40c6990 0x7ff4a40c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4a40cc770 0x7ff4a41f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:48438/0 (socket says 172.21.15.183:48438) 2024-05-08T20:54:36.225 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a37fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a4153450 0x7ff4a41477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 -- 172.21.15.183:0/934091687 learned_addr learned my addr 172.21.15.183:0/934091687 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 -- 172.21.15.183:0/934091687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a4153450 msgr2=0x7ff4a41477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 --2- 172.21.15.183:0/934091687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a4153450 0x7ff4a41477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 -- 172.21.15.183:0/934091687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a40c6990 msgr2=0x7ff4a40c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 --2- 172.21.15.183:0/934091687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a40c6990 0x7ff4a40c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 -- 172.21.15.183:0/934091687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c009a70 con 0x7ff4a40cc770 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.221+0000 7ff4a27fc700 1 --2- 172.21.15.183:0/934091687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4a40cc770 0x7ff4a41f2980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c700 tx=0x7ff49800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.222+0000 7ff48b7fe700 1 -- 172.21.15.183:0/934091687 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498005d70 con 0x7ff4a40cc770 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.222+0000 7ff48b7fe700 1 -- 172.21.15.183:0/934091687 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4980070d0 con 0x7ff4a40cc770 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.222+0000 7ff48b7fe700 1 -- 172.21.15.183:0/934091687 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498007460 con 0x7ff4a40cc770 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.222+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a4152980 con 0x7ff4a40cc770 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.222+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a41f2180 con 0x7ff4a40cc770 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.222+0000 7ff48b7fe700 1 -- 172.21.15.183:0/934091687 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff49801c440 con 0x7ff4a40cc770 2024-05-08T20:54:36.226 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.222+0000 7ff48b7fe700 1 -- 172.21.15.183:0/934091687 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ff498012890 con 0x7ff4a40cc770 2024-05-08T20:54:36.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.223+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a4067fa0 con 0x7ff4a40cc770 2024-05-08T20:54:36.227 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.225+0000 7ff48b7fe700 1 -- 172.21.15.183:0/934091687 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7ff498017070 con 0x7ff4a40cc770 2024-05-08T20:54:36.261 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:36.260+0000 7feaa2ced200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:54:36.332 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:36.331+0000 7feaa2ced200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:54:36.339 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:36.338+0000 7fcae8b30200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:54:36.346 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.344+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "438d2541-1287-42d0-936c-21a306edbb55", "id": 3} v 0) v1 -- 0x7ff4a41f2630 con 0x7ff4a40cc770 2024-05-08T20:54:36.353 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.351+0000 7ff48b7fe700 1 -- 172.21.15.183:0/934091687 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "438d2541-1287-42d0-936c-21a306edbb55", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4980125f0 con 0x7ff4a40cc770 2024-05-08T20:54:36.354 INFO:teuthology.orchestra.run.smithi183.stdout:3 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4a40cc770 msgr2=0x7ff4a41f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 --2- 172.21.15.183:0/934091687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4a40cc770 0x7ff4a41f2980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c700 tx=0x7ff49800ca10 comp rx=0 tx=0).stop 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 shutdown_connections 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 --2- 172.21.15.183:0/934091687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff4a4153450 0x7ff4a41477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 --2- 172.21.15.183:0/934091687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a40c6990 0x7ff4a40c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 --2- 172.21.15.183:0/934091687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4a40cc770 0x7ff4a41f2980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 >> 172.21.15.183:0/934091687 conn(0x7ff4a406ec40 msgr2=0x7ff4a41498b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 shutdown_connections 2024-05-08T20:54:36.355 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.352+0000 7ff4a939b700 1 -- 172.21.15.183:0/934091687 wait complete. 2024-05-08T20:54:36.367 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 7678d4c2-301e-4d49-be10-2e9f5b3a78a5 4 2024-05-08T20:54:36.414 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:36.412+0000 7fcae8b30200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:54:36.552 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.547+0000 7fc813378700 1 Processor -- start 2024-05-08T20:54:36.552 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.547+0000 7fc813378700 1 -- start start 2024-05-08T20:54:36.552 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc813378700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc80c1535a0 0x7fc80c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.552 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc813378700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc80c0c47c0 0x7fc80c06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.552 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc813378700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c15c990 con 0x7fc80c0cbf50 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc813378700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c15cbc0 con 0x7fc80c0c47c0 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc813378700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c15ce60 con 0x7fc80c1535a0 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc811114700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc80c1535a0 0x7fc80c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc810913700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc80c0cbf50 0x7fc80c0c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:46932/0 (socket says 172.21.15.183:46932) 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc810913700 1 -- 172.21.15.183:0/3634472062 learned_addr learned my addr 172.21.15.183:0/3634472062 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc811915700 1 --2- 172.21.15.183:0/3634472062 >> v2:172.21.15.135:3300/0 conn(0x7fc80c0c47c0 0x7fc80c06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc811114700 1 -- 172.21.15.183:0/3634472062 >> v2:172.21.15.135:3300/0 conn(0x7fc80c0c47c0 msgr2=0x7fc80c06aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc811114700 1 --2- 172.21.15.183:0/3634472062 >> v2:172.21.15.135:3300/0 conn(0x7fc80c0c47c0 0x7fc80c06aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc811114700 1 -- 172.21.15.183:0/3634472062 >> v1:172.21.15.183:6789/0 conn(0x7fc80c0cbf50 legacy=0x7fc80c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc811114700 1 -- 172.21.15.183:0/3634472062 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c15d140 con 0x7fc80c1535a0 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc803fff700 1 -- 172.21.15.183:0/3634472062 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200143642 0 0) 0x7fc80c15c990 con 0x7fc80c0cbf50 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.548+0000 7fc811915700 1 --2- 172.21.15.183:0/3634472062 >> v2:172.21.15.135:3300/0 conn(0x7fc80c0c47c0 0x7fc80c06aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:36.553 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.549+0000 7fc811114700 1 --2- 172.21.15.183:0/3634472062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c06a960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009840 tx=0x7fc7fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6b8e82eb079e11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.549+0000 7fc803fff700 1 -- 172.21.15.183:0/3634472062 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc011830 con 0x7fc80c1535a0 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.549+0000 7fc803fff700 1 -- 172.21.15.183:0/3634472062 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc011990 con 0x7fc80c1535a0 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.549+0000 7fc803fff700 1 -- 172.21.15.183:0/3634472062 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc011d20 con 0x7fc80c1535a0 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.549+0000 7fc813378700 1 -- 172.21.15.183:0/3634472062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 msgr2=0x7fc80c06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.549+0000 7fc813378700 1 --2- 172.21.15.183:0/3634472062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c06a960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009840 tx=0x7fc7fc009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.550+0000 7fc813378700 1 -- 172.21.15.183:0/3634472062 shutdown_connections 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.550+0000 7fc813378700 1 --2- 172.21.15.183:0/3634472062 >> v2:172.21.15.135:3300/0 conn(0x7fc80c0c47c0 0x7fc80c06aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.550+0000 7fc813378700 1 --2- 172.21.15.183:0/3634472062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c06a960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.550+0000 7fc813378700 1 -- 172.21.15.183:0/3634472062 >> 172.21.15.183:0/3634472062 conn(0x7fc80c06daf0 msgr2=0x7fc80c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.550+0000 7fc813378700 1 -- 172.21.15.183:0/3634472062 shutdown_connections 2024-05-08T20:54:36.554 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.550+0000 7fc813378700 1 -- 172.21.15.183:0/3634472062 wait complete. 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.551+0000 7fc813378700 1 Processor -- start 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.551+0000 7fc813378700 1 -- start start 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.551+0000 7fc813378700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc80c0c47c0 0x7fc80c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.551+0000 7fc813378700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc80c0cbf50 0x7fc80c1eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc813378700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c1f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc813378700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1f2460 con 0x7fc80c0cbf50 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc813378700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0cb050 con 0x7fc80c1535a0 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc813378700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0ca7b0 con 0x7fc80c0c47c0 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811114700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc80c0c47c0 0x7fc80c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811915700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c1f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811114700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc80c0c47c0 0x7fc80c151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:38270/0 (socket says 172.21.15.183:38270) 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811114700 1 -- 172.21.15.183:0/797820674 learned_addr learned my addr 172.21.15.183:0/797820674 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:36.557 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc810913700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc80c0cbf50 0x7fc80c1eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811915700 1 -- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc80c0c47c0 msgr2=0x7fc80c151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811915700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc80c0c47c0 0x7fc80c151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811915700 1 -- 172.21.15.183:0/797820674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc80c0cbf50 msgr2=0x7fc80c1eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811915700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc80c0cbf50 0x7fc80c1eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811915700 1 -- 172.21.15.183:0/797820674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc0094a0 con 0x7fc80c1535a0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811114700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc80c0c47c0 0x7fc80c151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc811915700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c1f2eb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc804007db0 tx=0x7fc80400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc801ffb700 1 -- 172.21.15.183:0/797820674 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400dd20 con 0x7fc80c1535a0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc801ffb700 1 -- 172.21.15.183:0/797820674 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80400f040 con 0x7fc80c1535a0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc801ffb700 1 -- 172.21.15.183:0/797820674 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804003c60 con 0x7fc80c1535a0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c154510 con 0x7fc80c1535a0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc801ffb700 1 -- 172.21.15.183:0/797820674 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc804004330 con 0x7fc80c1535a0 2024-05-08T20:54:36.558 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.552+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c0cb5b0 con 0x7fc80c1535a0 2024-05-08T20:54:36.559 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.553+0000 7fc801ffb700 1 -- 172.21.15.183:0/797820674 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc804004810 con 0x7fc80c1535a0 2024-05-08T20:54:36.559 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.553+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c0c33c0 con 0x7fc80c1535a0 2024-05-08T20:54:36.559 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.555+0000 7fc801ffb700 1 -- 172.21.15.183:0/797820674 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc80401a070 con 0x7fc80c1535a0 2024-05-08T20:54:36.644 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.641+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7678d4c2-301e-4d49-be10-2e9f5b3a78a5", "id": 4} v 0) v1 -- 0x7fc80c067fa0 con 0x7fc80c1535a0 2024-05-08T20:54:36.651 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.649+0000 7fc801ffb700 1 -- 172.21.15.183:0/797820674 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7678d4c2-301e-4d49-be10-2e9f5b3a78a5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc804015620 con 0x7fc80c1535a0 2024-05-08T20:54:36.651 INFO:teuthology.orchestra.run.smithi183.stdout:4 2024-05-08T20:54:36.652 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 msgr2=0x7fc80c1f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c1f2eb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc804007db0 tx=0x7fc80400d3b0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 shutdown_connections 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc80c1535a0 0x7fc80c1f2eb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc80c0c47c0 0x7fc80c151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 --2- 172.21.15.183:0/797820674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc80c0cbf50 0x7fc80c1eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 >> 172.21.15.183:0/797820674 conn(0x7fc80c06daf0 msgr2=0x7fc80c14f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 shutdown_connections 2024-05-08T20:54:36.653 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.650+0000 7fc813378700 1 -- 172.21.15.183:0/797820674 wait complete. 2024-05-08T20:54:36.665 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new cfe0f86c-a074-4e75-be10-ff2d00abd453 5 2024-05-08T20:54:36.706 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:36.703+0000 7feaa2ced200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:54:36.789 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.787+0000 7f917be2d700 1 Processor -- start 2024-05-08T20:54:36.790 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917be2d700 1 -- start start 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917be2d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f91741536d0 0x7f9174159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917be2d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9174072b50 0x7f91740c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917be2d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f917415d2e0 0x7f917406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917be2d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9174153ab0 con 0x7f91741536d0 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917be2d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91740cc8c0 con 0x7f917415d2e0 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917be2d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740cc380 con 0x7f9174072b50 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f917a3ca700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f917415d2e0 0x7f917406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.788+0000 7f91793c8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9174072b50 0x7f91740c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f917a3ca700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f917415d2e0 0x7f917406a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:48454/0 (socket says 172.21.15.183:48454) 2024-05-08T20:54:36.793 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f917a3ca700 1 -- 172.21.15.183:0/1916255507 learned_addr learned my addr 172.21.15.183:0/1916255507 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f9179bc9700 1 --2- 172.21.15.183:0/1916255507 >> v2:172.21.15.135:3300/0 conn(0x7f91741536d0 0x7f9174159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f91793c8700 1 -- 172.21.15.183:0/1916255507 >> v2:172.21.15.183:3300/0 conn(0x7f917415d2e0 msgr2=0x7f917406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f91793c8700 1 --2- 172.21.15.183:0/1916255507 >> v2:172.21.15.183:3300/0 conn(0x7f917415d2e0 0x7f917406a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f91793c8700 1 -- 172.21.15.183:0/1916255507 >> v2:172.21.15.135:3300/0 conn(0x7f91741536d0 msgr2=0x7f9174159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f91793c8700 1 --2- 172.21.15.183:0/1916255507 >> v2:172.21.15.135:3300/0 conn(0x7f91741536d0 0x7f9174159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f91793c8700 1 -- 172.21.15.183:0/1916255507 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740cc620 con 0x7f9174072b50 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f917a3ca700 1 --2- 172.21.15.183:0/1916255507 >> v2:172.21.15.183:3300/0 conn(0x7f917415d2e0 0x7f917406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f91793c8700 1 --2- 172.21.15.183:0/1916255507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9174072b50 0x7f91740c6770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f917406f020 tx=0x7f9164009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ea675446a494bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f9178bc7700 1 -- 172.21.15.183:0/1916255507 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164011830 con 0x7f9174072b50 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f9178bc7700 1 -- 172.21.15.183:0/1916255507 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164011990 con 0x7f9174072b50 2024-05-08T20:54:36.794 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.789+0000 7f9178bc7700 1 -- 172.21.15.183:0/1916255507 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164011d20 con 0x7f9174072b50 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 -- 172.21.15.183:0/1916255507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9174072b50 msgr2=0x7f91740c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 --2- 172.21.15.183:0/1916255507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9174072b50 0x7f91740c6770 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f917406f020 tx=0x7f9164009b20 comp rx=0 tx=0).stop 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 -- 172.21.15.183:0/1916255507 shutdown_connections 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 --2- 172.21.15.183:0/1916255507 >> v2:172.21.15.135:3300/0 conn(0x7f91741536d0 0x7f9174159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 --2- 172.21.15.183:0/1916255507 >> v2:172.21.15.183:3300/0 conn(0x7f917415d2e0 0x7f917406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 --2- 172.21.15.183:0/1916255507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9174072b50 0x7f91740c6770 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 -- 172.21.15.183:0/1916255507 >> 172.21.15.183:0/1916255507 conn(0x7f917406daf0 msgr2=0x7f917406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 -- 172.21.15.183:0/1916255507 shutdown_connections 2024-05-08T20:54:36.795 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.790+0000 7f917be2d700 1 -- 172.21.15.183:0/1916255507 wait complete. 2024-05-08T20:54:36.798 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.791+0000 7f917be2d700 1 Processor -- start 2024-05-08T20:54:36.798 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.791+0000 7f917be2d700 1 -- start start 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f917be2d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174072b50 0x7f917415ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f917be2d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91741536d0 0x7f91741561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f917be2d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917415d2e0 0x7f9174156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f917be2d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91741f26e0 con 0x7f91741536d0 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f917be2d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91741f29c0 con 0x7f9174072b50 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f917be2d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91741f2ca0 con 0x7f917415d2e0 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174072b50 0x7f917415ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174072b50 0x7f917415ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:48462/0 (socket says 172.21.15.183:48462) 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 -- 172.21.15.183:0/2617113695 learned_addr learned my addr 172.21.15.183:0/2617113695 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f917a3ca700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917415d2e0 0x7f9174156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f91793c8700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91741536d0 0x7f91741561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 -- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917415d2e0 msgr2=0x7f9174156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.799 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917415d2e0 0x7f9174156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 -- 172.21.15.183:0/2617113695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91741536d0 msgr2=0x7f91741561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91741536d0 0x7f91741561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 -- 172.21.15.183:0/2617113695 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009b30 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.792+0000 7f9179bc9700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174072b50 0x7f917415ba60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f917000e930 tx=0x7f917000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.793+0000 7f916a7fc700 1 -- 172.21.15.183:0/2617113695 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170013680 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.793+0000 7f916a7fc700 1 -- 172.21.15.183:0/2617113695 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91700137e0 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.793+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91640094a0 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.793+0000 7f916a7fc700 1 -- 172.21.15.183:0/2617113695 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170013b70 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.793+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91741f3260 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.793+0000 7f916a7fc700 1 -- 172.21.15.183:0/2617113695 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f917001c450 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.793+0000 7f916a7fc700 1 -- 172.21.15.183:0/2617113695 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f917000cac0 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.794+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9174067fa0 con 0x7f9174072b50 2024-05-08T20:54:36.800 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.796+0000 7f916a7fc700 1 -- 172.21.15.183:0/2617113695 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f9170021060 con 0x7f9174072b50 2024-05-08T20:54:36.817 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:36.815+0000 7fcae8b30200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:54:36.883 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.881+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cfe0f86c-a074-4e75-be10-ff2d00abd453", "id": 5} v 0) v1 -- 0x7f917415d090 con 0x7f9174072b50 2024-05-08T20:54:36.891 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.889+0000 7f916a7fc700 1 -- 172.21.15.183:0/2617113695 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfe0f86c-a074-4e75-be10-ff2d00abd453", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f917002a0b0 con 0x7f9174072b50 2024-05-08T20:54:36.891 INFO:teuthology.orchestra.run.smithi183.stdout:5 2024-05-08T20:54:36.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174072b50 msgr2=0x7f917415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:36.892 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174072b50 0x7f917415ba60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f917000e930 tx=0x7f917000ec40 comp rx=0 tx=0).stop 2024-05-08T20:54:36.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 shutdown_connections 2024-05-08T20:54:36.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9174072b50 0x7f917415ba60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f917415d2e0 0x7f9174156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 --2- 172.21.15.183:0/2617113695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f91741536d0 0x7f91741561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:36.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 >> 172.21.15.183:0/2617113695 conn(0x7f917406daf0 msgr2=0x7f9174156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:36.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 shutdown_connections 2024-05-08T20:54:36.893 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:36.890+0000 7f917be2d700 1 -- 172.21.15.183:0/2617113695 wait complete. 2024-05-08T20:54:36.904 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 0fb0e4c3-700e-4b11-816d-10cf4523cb95 6 2024-05-08T20:54:37.026 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.024+0000 7f24b6e72700 1 Processor -- start 2024-05-08T20:54:37.026 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.024+0000 7f24b6e72700 1 -- start start 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b6e72700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f24b00c6600 0x7f24b00c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b6e72700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b01508a0 con 0x7f24b00c51e0 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b6e72700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b0072e40 con 0x7f24b01504c0 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b6e72700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b00c2de0 con 0x7f24b00c6600 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b4c0e700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f24b01504c0 0x7f24b0159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:46934/0 (socket says 172.21.15.183:46934) 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b4c0e700 1 -- 172.21.15.183:0/3499678906 learned_addr learned my addr 172.21.15.183:0/3499678906 (peer_addr_for_me v1:172.21.15.183:0/0) 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b540f700 1 --2- 172.21.15.183:0/3499678906 >> v2:172.21.15.135:3300/0 conn(0x7f24b00c6600 0x7f24b00c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24af7fe700 1 -- 172.21.15.183:0/3499678906 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933944914 0 0) 0x7f24b0072e40 con 0x7f24b01504c0 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24af7fe700 1 -- 172.21.15.183:0/3499678906 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a00057c0 con 0x7f24b01504c0 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b540f700 1 -- 172.21.15.183:0/3499678906 >> v1:172.21.15.183:6789/0 conn(0x7f24b01504c0 legacy=0x7f24b0159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.029 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24af7fe700 1 -- 172.21.15.183:0/3499678906 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1315186056 0 0) 0x7f24a00057c0 con 0x7f24b01504c0 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b540f700 1 -- 172.21.15.183:0/3499678906 >> v1:172.21.15.135:6789/0 conn(0x7f24b00c51e0 legacy=0x7f24b0072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b540f700 1 -- 172.21.15.183:0/3499678906 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b00c5940 con 0x7f24b00c6600 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.025+0000 7f24b540f700 1 --2- 172.21.15.183:0/3499678906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b00c6600 0x7f24b00c6a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009d90 tx=0x7f24a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdaebb65be73aa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24af7fe700 1 -- 172.21.15.183:0/3499678906 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800e070 con 0x7f24b00c6600 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24af7fe700 1 -- 172.21.15.183:0/3499678906 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a8003a20 con 0x7f24b00c6600 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24af7fe700 1 -- 172.21.15.183:0/3499678906 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4001670 con 0x7f24b00c6600 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24b6e72700 1 -- 172.21.15.183:0/3499678906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b00c6600 msgr2=0x7f24b00c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24b6e72700 1 --2- 172.21.15.183:0/3499678906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b00c6600 0x7f24b00c6a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009d90 tx=0x7f24a800b330 comp rx=0 tx=0).stop 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24b6e72700 1 -- 172.21.15.183:0/3499678906 shutdown_connections 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24b6e72700 1 --2- 172.21.15.183:0/3499678906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b00c6600 0x7f24b00c6a30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24b6e72700 1 -- 172.21.15.183:0/3499678906 >> 172.21.15.183:0/3499678906 conn(0x7f24b006daf0 msgr2=0x7f24b006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:37.030 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24b6e72700 1 -- 172.21.15.183:0/3499678906 shutdown_connections 2024-05-08T20:54:37.031 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.026+0000 7f24b6e72700 1 -- 172.21.15.183:0/3499678906 wait complete. 2024-05-08T20:54:37.031 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:37.027+0000 7feaa2ced200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.027+0000 7f24b6e72700 1 Processor -- start 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.027+0000 7f24b6e72700 1 -- start start 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b6e72700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b00c51e0 0x7f24b014ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b6e72700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b00c6600 0x7f24b00cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b6e72700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b01504c0 0x7f24b013d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b6e72700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b0158070 con 0x7f24b01504c0 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b6e72700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b006a960 con 0x7f24b00c6600 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b6e72700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b006c480 con 0x7f24b00c51e0 2024-05-08T20:54:37.034 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b4c0e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b00c51e0 0x7f24b014ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24affff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b00c6600 0x7f24b00cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b4c0e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b00c51e0 0x7f24b014ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:38294/0 (socket says 172.21.15.183:38294) 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b4c0e700 1 -- 172.21.15.183:0/1699171062 learned_addr learned my addr 172.21.15.183:0/1699171062 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.028+0000 7f24b540f700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b01504c0 0x7f24b013d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b4c0e700 1 -- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b00c6600 msgr2=0x7f24b00cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b4c0e700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b00c6600 0x7f24b00cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b4c0e700 1 -- 172.21.15.183:0/1699171062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b01504c0 msgr2=0x7f24b013d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b4c0e700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b01504c0 0x7f24b013d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b4c0e700 1 -- 172.21.15.183:0/1699171062 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8009a70 con 0x7f24b00c51e0 2024-05-08T20:54:37.035 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24affff700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b00c6600 0x7f24b00cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b4c0e700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b00c51e0 0x7f24b014ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c750 tx=0x7f24a400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24ad7fa700 1 -- 172.21.15.183:0/1699171062 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4004c80 con 0x7f24b00c51e0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24ad7fa700 1 -- 172.21.15.183:0/1699171062 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a4004de0 con 0x7f24b00c51e0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b006ab70 con 0x7f24b00c51e0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24ad7fa700 1 -- 172.21.15.183:0/1699171062 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4007310 con 0x7f24b00c51e0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b006b130 con 0x7f24b00c51e0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24ad7fa700 1 -- 172.21.15.183:0/1699171062 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f24a401d3f0 con 0x7f24b00c51e0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.029+0000 7f24ad7fa700 1 -- 172.21.15.183:0/1699171062 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f24a4013aa0 con 0x7f24b00c51e0 2024-05-08T20:54:37.036 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.030+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b0067fa0 con 0x7f24b00c51e0 2024-05-08T20:54:37.037 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.032+0000 7f24ad7fa700 1 -- 172.21.15.183:0/1699171062 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f24a4013dc0 con 0x7f24b00c51e0 2024-05-08T20:54:37.120 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.118+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0fb0e4c3-700e-4b11-816d-10cf4523cb95", "id": 6} v 0) v1 -- 0x7f24b00c27d0 con 0x7f24b00c51e0 2024-05-08T20:54:37.128 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.126+0000 7f24ad7fa700 1 -- 172.21.15.183:0/1699171062 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fb0e4c3-700e-4b11-816d-10cf4523cb95", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24a40134b0 con 0x7f24b00c51e0 2024-05-08T20:54:37.128 INFO:teuthology.orchestra.run.smithi183.stdout:6 2024-05-08T20:54:37.129 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b00c51e0 msgr2=0x7f24b014ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b00c51e0 0x7f24b014ac00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24a400c750 tx=0x7f24a400ca60 comp rx=0 tx=0).stop 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 shutdown_connections 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24b01504c0 0x7f24b013d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f24b00c51e0 0x7f24b014ac00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 --2- 172.21.15.183:0/1699171062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f24b00c6600 0x7f24b00cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 >> 172.21.15.183:0/1699171062 conn(0x7f24b006daf0 msgr2=0x7f24b0073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 shutdown_connections 2024-05-08T20:54:37.130 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.127+0000 7f24b6e72700 1 -- 172.21.15.183:0/1699171062 wait complete. 2024-05-08T20:54:37.141 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 26b42625-d983-4f0e-9ca6-ba6c7f2e148d 7 2024-05-08T20:54:37.161 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:37.159+0000 7fcae8b30200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:54:37.190 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:37.189+0000 7feaa2ced200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T20:54:37.263 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.261+0000 7f70c45f8700 1 Processor -- start 2024-05-08T20:54:37.263 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.261+0000 7f70c45f8700 1 -- start start 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c45f8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c51e0 0x7f70bc072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c45f8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f70bc0c6600 0x7f70bc0c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c45f8700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70bc1508a0 con 0x7f70bc1504c0 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c45f8700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70bc0c2de0 con 0x7f70bc0c6600 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c45f8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc159d80 con 0x7f70bc0c51e0 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c51e0 0x7f70bc072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c51e0 0x7f70bc072730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:38306/0 (socket says 172.21.15.183:38306) 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 -- 172.21.15.183:0/4050745788 learned_addr learned my addr 172.21.15.183:0/4050745788 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:37.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c2b95700 1 --2- 172.21.15.183:0/4050745788 >> v2:172.21.15.135:3300/0 conn(0x7f70bc0c6600 0x7f70bc0c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 -- 172.21.15.183:0/4050745788 >> v2:172.21.15.135:3300/0 conn(0x7f70bc0c6600 msgr2=0x7f70bc0c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 --2- 172.21.15.183:0/4050745788 >> v2:172.21.15.135:3300/0 conn(0x7f70bc0c6600 0x7f70bc0c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 -- 172.21.15.183:0/4050745788 >> v1:172.21.15.135:6789/0 conn(0x7f70bc1504c0 legacy=0x7f70bc159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 -- 172.21.15.183:0/4050745788 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc0c5940 con 0x7f70bc0c51e0 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1b93700 1 --2- 172.21.15.183:0/4050745788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c51e0 0x7f70bc072730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0098f0 tx=0x7f70ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57701e09a5fd7d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1392700 1 -- 172.21.15.183:0/4050745788 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac011830 con 0x7f70bc0c51e0 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1392700 1 -- 172.21.15.183:0/4050745788 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac011990 con 0x7f70bc0c51e0 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.262+0000 7f70c1392700 1 -- 172.21.15.183:0/4050745788 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac011d20 con 0x7f70bc0c51e0 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 -- 172.21.15.183:0/4050745788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c51e0 msgr2=0x7f70bc072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.267 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 --2- 172.21.15.183:0/4050745788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c51e0 0x7f70bc072730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0098f0 tx=0x7f70ac009c00 comp rx=0 tx=0).stop 2024-05-08T20:54:37.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 -- 172.21.15.183:0/4050745788 shutdown_connections 2024-05-08T20:54:37.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 --2- 172.21.15.183:0/4050745788 >> v2:172.21.15.135:3300/0 conn(0x7f70bc0c6600 0x7f70bc0c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 --2- 172.21.15.183:0/4050745788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c51e0 0x7f70bc072730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 -- 172.21.15.183:0/4050745788 >> 172.21.15.183:0/4050745788 conn(0x7f70bc06daf0 msgr2=0x7f70bc06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:37.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 -- 172.21.15.183:0/4050745788 shutdown_connections 2024-05-08T20:54:37.268 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.263+0000 7f70c45f8700 1 -- 172.21.15.183:0/4050745788 wait complete. 2024-05-08T20:54:37.270 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.264+0000 7f70c45f8700 1 Processor -- start 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.264+0000 7f70c45f8700 1 -- start start 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c45f8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc0c51e0 0x7f70bc06a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c45f8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c6600 0x7f70bc0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c45f8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70bc1504c0 0x7f70bc14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c45f8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc14b220 con 0x7f70bc0c51e0 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c45f8700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1593b0 con 0x7f70bc1504c0 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c45f8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc0c9720 con 0x7f70bc0c6600 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c1b93700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c6600 0x7f70bc0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c2394700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc0c51e0 0x7f70bc06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c1b93700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c6600 0x7f70bc0ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:38308/0 (socket says 172.21.15.183:38308) 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c1b93700 1 -- 172.21.15.183:0/2635115299 learned_addr learned my addr 172.21.15.183:0/2635115299 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.265+0000 7f70c2b95700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70bc1504c0 0x7f70bc14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.271 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c2394700 1 -- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c6600 msgr2=0x7f70bc0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c2394700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c6600 0x7f70bc0ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c2394700 1 -- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70bc1504c0 msgr2=0x7f70bc14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c2394700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70bc1504c0 0x7f70bc14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c2394700 1 -- 172.21.15.183:0/2635115299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac009550 con 0x7f70bc0c51e0 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c1b93700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c6600 0x7f70bc0ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c2b95700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70bc1504c0 0x7f70bc14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c2394700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc0c51e0 0x7f70bc06a960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70b8000f60 tx=0x7f70b800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70b2ffd700 1 -- 172.21.15.183:0/2635115299 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b80052d0 con 0x7f70bc0c51e0 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70b2ffd700 1 -- 172.21.15.183:0/2635115299 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b8005430 con 0x7f70bc0c51e0 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc14b430 con 0x7f70bc0c51e0 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70b2ffd700 1 -- 172.21.15.183:0/2635115299 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b80038c0 con 0x7f70bc0c51e0 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc0c99c0 con 0x7f70bc0c51e0 2024-05-08T20:54:37.272 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70b2ffd700 1 -- 172.21.15.183:0/2635115299 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f70b801c440 con 0x7f70bc0c51e0 2024-05-08T20:54:37.273 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.266+0000 7f70b2ffd700 1 -- 172.21.15.183:0/2635115299 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f70b8012a80 con 0x7f70bc0c51e0 2024-05-08T20:54:37.273 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.267+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70bc14ede0 con 0x7f70bc0c51e0 2024-05-08T20:54:37.273 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:37.267+0000 7feaa2ced200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:54:37.273 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.271+0000 7f70b2ffd700 1 -- 172.21.15.183:0/2635115299 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f70b8017070 con 0x7f70bc0c51e0 2024-05-08T20:54:37.329 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:37.327+0000 7fcae8b30200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T20:54:37.357 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.355+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26b42625-d983-4f0e-9ca6-ba6c7f2e148d", "id": 7} v 0) v1 -- 0x7f70bc0c3c70 con 0x7f70bc0c51e0 2024-05-08T20:54:37.364 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.362+0000 7f70b2ffd700 1 -- 172.21.15.183:0/2635115299 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26b42625-d983-4f0e-9ca6-ba6c7f2e148d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70b8012420 con 0x7f70bc0c51e0 2024-05-08T20:54:37.365 INFO:teuthology.orchestra.run.smithi183.stdout:7 2024-05-08T20:54:37.366 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.363+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc0c51e0 msgr2=0x7f70bc06a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.366 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.363+0000 7f70c45f8700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc0c51e0 0x7f70bc06a960 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f70b8000f60 tx=0x7f70b800c6e0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.366 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.363+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 shutdown_connections 2024-05-08T20:54:37.367 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.363+0000 7f70c45f8700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70bc1504c0 0x7f70bc14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.367 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.363+0000 7f70c45f8700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70bc0c51e0 0x7f70bc06a960 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.367 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.363+0000 7f70c45f8700 1 --2- 172.21.15.183:0/2635115299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70bc0c6600 0x7f70bc0ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.367 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.363+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 >> 172.21.15.183:0/2635115299 conn(0x7f70bc06daf0 msgr2=0x7f70bc0725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:37.367 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.364+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 shutdown_connections 2024-05-08T20:54:37.367 INFO:teuthology.orchestra.run.smithi183.stderr:2024-05-08T20:54:37.364+0000 7f70c45f8700 1 -- 172.21.15.183:0/2635115299 wait complete. 2024-05-08T20:54:37.378 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T20:54:37.378 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T20:54:37.380 INFO:tasks.ceph.osd.0:Started 2024-05-08T20:54:37.380 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T20:54:37.380 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T20:54:37.382 INFO:tasks.ceph.osd.1:Started 2024-05-08T20:54:37.382 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T20:54:37.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T20:54:37.384 INFO:tasks.ceph.osd.2:Started 2024-05-08T20:54:37.385 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T20:54:37.385 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T20:54:37.387 INFO:tasks.ceph.osd.3:Started 2024-05-08T20:54:37.387 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T20:54:37.387 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T20:54:37.410 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:37.407+0000 7fcae8b30200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:54:37.411 INFO:tasks.ceph.osd.4:Started 2024-05-08T20:54:37.411 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T20:54:37.411 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T20:54:37.413 INFO:tasks.ceph.osd.5:Started 2024-05-08T20:54:37.413 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T20:54:37.413 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T20:54:37.415 INFO:tasks.ceph.osd.6:Started 2024-05-08T20:54:37.415 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T20:54:37.416 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T20:54:37.418 INFO:tasks.ceph.osd.7:Started 2024-05-08T20:54:37.418 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.565+0000 7fd0afab7700 1 Processor -- start 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.566+0000 7fd0afab7700 1 -- start start 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.566+0000 7fd0afab7700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0a81514b0 0x7fd0a8157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.566+0000 7fd0afab7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a8157e50 0x7fd0a80c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.566+0000 7fd0afab7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd0a80c8ec0 0x7fd0a80cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.566+0000 7fd0afab7700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a81571e0 con 0x7fd0a81514b0 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.566+0000 7fd0afab7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80c8780 con 0x7fd0a80c8ec0 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.566+0000 7fd0afab7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815b790 con 0x7fd0a8157e50 2024-05-08T20:54:37.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0a81514b0 0x7fd0a8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd0a81514b0 0x7fd0a8157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33902/0 (socket says 172.21.15.135:33902) 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 -- 172.21.15.135:0/1543332720 learned_addr learned my addr 172.21.15.135:0/1543332720 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad052700 1 --2- 172.21.15.135:0/1543332720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a8157e50 0x7fd0a80c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ae054700 1 --2- 172.21.15.135:0/1543332720 >> v2:172.21.15.183:3300/0 conn(0x7fd0a80c8ec0 0x7fd0a80cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 -- 172.21.15.135:0/1543332720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a8157e50 msgr2=0x7fd0a80c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 --2- 172.21.15.135:0/1543332720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a8157e50 0x7fd0a80c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 -- 172.21.15.135:0/1543332720 >> v2:172.21.15.183:3300/0 conn(0x7fd0a80c8ec0 msgr2=0x7fd0a80cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 --2- 172.21.15.135:0/1543332720 >> v2:172.21.15.183:3300/0 conn(0x7fd0a80c8ec0 0x7fd0a80cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 -- 172.21.15.135:0/1543332720 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a815ac10 con 0x7fd0a81514b0 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ad853700 1 --2- 172.21.15.135:0/1543332720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a81514b0 0x7fd0a8157910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80c83c0 tx=0x7fd0a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5596299894eca43 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ac851700 1 -- 172.21.15.135:0/1543332720 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4011830 con 0x7fd0a81514b0 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ac851700 1 -- 172.21.15.135:0/1543332720 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a4011990 con 0x7fd0a81514b0 2024-05-08T20:54:37.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.567+0000 7fd0ac851700 1 -- 172.21.15.135:0/1543332720 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4011d20 con 0x7fd0a81514b0 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 -- 172.21.15.135:0/1543332720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a81514b0 msgr2=0x7fd0a8157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 --2- 172.21.15.135:0/1543332720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a81514b0 0x7fd0a8157910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80c83c0 tx=0x7fd0a4009bd0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 -- 172.21.15.135:0/1543332720 shutdown_connections 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 --2- 172.21.15.135:0/1543332720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a81514b0 0x7fd0a8157910 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 --2- 172.21.15.135:0/1543332720 >> v2:172.21.15.183:3300/0 conn(0x7fd0a80c8ec0 0x7fd0a80cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 --2- 172.21.15.135:0/1543332720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a8157e50 0x7fd0a80c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 -- 172.21.15.135:0/1543332720 >> 172.21.15.135:0/1543332720 conn(0x7fd0a806a960 msgr2=0x7fd0a806ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 -- 172.21.15.135:0/1543332720 shutdown_connections 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.568+0000 7fd0afab7700 1 -- 172.21.15.135:0/1543332720 wait complete. 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.569+0000 7fd0afab7700 1 Processor -- start 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.569+0000 7fd0afab7700 1 -- start start 2024-05-08T20:54:37.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0afab7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a80c8ec0 0x7fd0a81ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0afab7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0a81514b0 0x7fd0a8158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0afab7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8157e50 0x7fd0a814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0afab7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81593c0 con 0x7fd0a8157e50 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0afab7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815a270 con 0x7fd0a81514b0 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0afab7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815a550 con 0x7fd0a80c8ec0 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8157e50 0x7fd0a814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8157e50 0x7fd0a814a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33908/0 (socket says 172.21.15.135:33908) 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 -- 172.21.15.135:0/3826320380 learned_addr learned my addr 172.21.15.135:0/3826320380 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ad052700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0a81514b0 0x7fd0a8158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ad853700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a80c8ec0 0x7fd0a81ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 -- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a80c8ec0 msgr2=0x7fd0a81ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a80c8ec0 0x7fd0a81ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 -- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0a81514b0 msgr2=0x7fd0a8158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0a81514b0 0x7fd0a8158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 -- 172.21.15.135:0/3826320380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4009550 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd0ae054700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8157e50 0x7fd0a814a1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000eed0 tx=0x7fd0a000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd09e7fc700 1 -- 172.21.15.135:0/3826320380 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0010040 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.570+0000 7fd09e7fc700 1 -- 172.21.15.135:0/3826320380 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a000b9f0 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.571+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a815a830 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.571+0000 7fd09e7fc700 1 -- 172.21.15.135:0/3826320380 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000bda0 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.571+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a8158680 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.571+0000 7fd09e7fc700 1 -- 172.21.15.135:0/3826320380 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd0a001d700 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.571+0000 7fd09e7fc700 1 -- 172.21.15.135:0/3826320380 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd0a001c3b0 con 0x7fd0a8157e50 2024-05-08T20:54:37.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.571+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a8067fa0 con 0x7fd0a8157e50 2024-05-08T20:54:37.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.573+0000 7fd09e7fc700 1 -- 172.21.15.135:0/3826320380 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fd0a0018020 con 0x7fd0a8157e50 2024-05-08T20:54:37.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.644+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0a8154a40 con 0x7fd0a8157e50 2024-05-08T20:54:37.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.644+0000 7fd09e7fc700 1 -- 172.21.15.135:0/3826320380 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd0a001dbe0 con 0x7fd0a8157e50 2024-05-08T20:54:37.646 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:37.646 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:54:37.356826+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:37.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8157e50 msgr2=0x7fd0a814a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:37.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8157e50 0x7fd0a814a1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000eed0 tx=0x7fd0a000ef00 comp rx=0 tx=0).stop 2024-05-08T20:54:37.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 shutdown_connections 2024-05-08T20:54:37.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0a8157e50 0x7fd0a814a1b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0a80c8ec0 0x7fd0a81ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 --2- 172.21.15.135:0/3826320380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0a81514b0 0x7fd0a8158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:37.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 >> 172.21.15.135:0/3826320380 conn(0x7fd0a806a960 msgr2=0x7fd0a806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:37.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 shutdown_connections 2024-05-08T20:54:37.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:37.645+0000 7fd0afab7700 1 -- 172.21.15.135:0/3826320380 wait complete. 2024-05-08T20:54:37.660 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T20:54:37.660 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T20:54:37.995 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-08T20:54:37.993+0000 7f6dc834c7c0 -1 Falling back to public interface 2024-05-08T20:54:38.009 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-08T20:54:38.007+0000 7f27ba9f07c0 -1 Falling back to public interface 2024-05-08T20:54:38.010 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-08T20:54:38.008+0000 7f40a16bf7c0 -1 Falling back to public interface 2024-05-08T20:54:38.013 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-08T20:54:38.011+0000 7f0164c877c0 -1 Falling back to public interface 2024-05-08T20:54:38.016 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T20:54:38.014+0000 7f9028cca7c0 -1 Falling back to public interface 2024-05-08T20:54:38.019 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:38.017+0000 7feaa2ced200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:54:38.020 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T20:54:38.018+0000 7f92b1ee97c0 -1 Falling back to public interface 2024-05-08T20:54:38.045 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T20:54:38.043+0000 7f4683c057c0 -1 Falling back to public interface 2024-05-08T20:54:38.048 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T20:54:38.046+0000 7f532ff877c0 -1 Falling back to public interface 2024-05-08T20:54:38.102 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:38.100+0000 7feaa2ced200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:54:38.147 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:38.145+0000 7fcae8b30200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:54:38.229 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:38.226+0000 7fcae8b30200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:54:38.233 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:38.231+0000 7feaa2ced200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:54:38.362 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:38.360+0000 7fcae8b30200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:54:38.466 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:38.580 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.578+0000 7f3750797700 1 Processor -- start 2024-05-08T20:54:38.580 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.578+0000 7f3750797700 1 -- start start 2024-05-08T20:54:38.582 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f3750797700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f37480c9570 0x7f37480c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.582 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f3750797700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37480c7790 0x7f37480c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f3750797700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37480c9ae0 con 0x7f37481536f0 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f3750797700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374815a480 con 0x7f37480c7790 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f3750797700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37480c9dc0 con 0x7f37480c9570 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374ed34700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37480c7790 0x7f37480c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374ed34700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f37480c7790 0x7f37480c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33910/0 (socket says 172.21.15.135:33910) 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374ed34700 1 -- 172.21.15.135:0/3038231061 learned_addr learned my addr 172.21.15.135:0/3038231061 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374dd32700 1 --2- 172.21.15.135:0/3038231061 >> v2:172.21.15.183:3300/0 conn(0x7f37480c9570 0x7f37480c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374ed34700 1 -- 172.21.15.135:0/3038231061 >> v2:172.21.15.183:3300/0 conn(0x7f37480c9570 msgr2=0x7f37480c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374ed34700 1 --2- 172.21.15.135:0/3038231061 >> v2:172.21.15.183:3300/0 conn(0x7f37480c9570 0x7f37480c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.583 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374ed34700 1 -- 172.21.15.135:0/3038231061 >> v1:172.21.15.183:6789/0 conn(0x7f37481536f0 legacy=0x7f3748159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.579+0000 7f374ed34700 1 -- 172.21.15.135:0/3038231061 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480ca0a0 con 0x7f37480c7790 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f374ed34700 1 --2- 172.21.15.135:0/3038231061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37480c7790 0x7f37480c7be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37480c7720 tx=0x7f374000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1b8a7e01d4e1ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f374d531700 1 -- 172.21.15.135:0/3038231061 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000e070 con 0x7f37480c7790 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f374d531700 1 -- 172.21.15.135:0/3038231061 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374000b910 con 0x7f37480c7790 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f374d531700 1 -- 172.21.15.135:0/3038231061 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000bcc0 con 0x7f37480c7790 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 -- 172.21.15.135:0/3038231061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37480c7790 msgr2=0x7f37480c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 --2- 172.21.15.135:0/3038231061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37480c7790 0x7f37480c7be0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37480c7720 tx=0x7f374000b330 comp rx=0 tx=0).stop 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 -- 172.21.15.135:0/3038231061 shutdown_connections 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 --2- 172.21.15.135:0/3038231061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37480c7790 0x7f37480c7be0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 --2- 172.21.15.135:0/3038231061 >> v2:172.21.15.183:3300/0 conn(0x7f37480c9570 0x7f37480c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 -- 172.21.15.135:0/3038231061 >> 172.21.15.135:0/3038231061 conn(0x7f3748070bc0 msgr2=0x7f3748070fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 -- 172.21.15.135:0/3038231061 shutdown_connections 2024-05-08T20:54:38.584 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.580+0000 7f3750797700 1 -- 172.21.15.135:0/3038231061 wait complete. 2024-05-08T20:54:38.587 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.581+0000 7f3750797700 1 Processor -- start 2024-05-08T20:54:38.587 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f3750797700 1 -- start start 2024-05-08T20:54:38.587 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f3750797700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37480c7790 0x7f3748156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.587 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f3750797700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37480c9570 0x7f37481f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f3750797700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37481536f0 0x7f374814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f3750797700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37480c5810 con 0x7f37481536f0 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f3750797700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37480c6b00 con 0x7f37480c9570 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f3750797700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37480c5a60 con 0x7f37480c7790 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f374ed34700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37481536f0 0x7f374814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f374ed34700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37481536f0 0x7f374814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33912/0 (socket says 172.21.15.135:33912) 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f374ed34700 1 -- 172.21.15.135:0/1514019084 learned_addr learned my addr 172.21.15.135:0/1514019084 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f374dd32700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37480c9570 0x7f37481f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.582+0000 7f374e533700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37480c7790 0x7f3748156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f374ed34700 1 -- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37480c7790 msgr2=0x7f3748156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f374ed34700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37480c7790 0x7f3748156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.588 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f374ed34700 1 -- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37480c9570 msgr2=0x7f37481f03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f374ed34700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37480c9570 0x7f37481f03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f374ed34700 1 -- 172.21.15.135:0/1514019084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009b30 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f374ed34700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37481536f0 0x7f374814e0f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3748071780 tx=0x7f3740004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f373effd700 1 -- 172.21.15.135:0/1514019084 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740004880 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f373effd700 1 -- 172.21.15.135:0/1514019084 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400099b0 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f373effd700 1 -- 172.21.15.135:0/1514019084 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374001b670 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37480c5d40 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37480c6300 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f373effd700 1 -- 172.21.15.135:0/1514019084 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f374001bad0 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.583+0000 7f373effd700 1 -- 172.21.15.135:0/1514019084 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3740026d60 con 0x7f37481536f0 2024-05-08T20:54:38.589 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.584+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37480c91c0 con 0x7f37481536f0 2024-05-08T20:54:38.590 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.586+0000 7f373effd700 1 -- 172.21.15.135:0/1514019084 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f3740026690 con 0x7f37481536f0 2024-05-08T20:54:38.658 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.657+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3748067fa0 con 0x7f37481536f0 2024-05-08T20:54:38.659 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.657+0000 7f373effd700 1 -- 172.21.15.135:0/1514019084 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3740026830 con 0x7f37481536f0 2024-05-08T20:54:38.659 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-08T20:54:38.659 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":10,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:54:37.356826+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.658+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37481536f0 msgr2=0x7f374814e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.658+0000 7f3750797700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37481536f0 0x7f374814e0f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3748071780 tx=0x7f3740004ad0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.658+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 shutdown_connections 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.658+0000 7f3750797700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37481536f0 0x7f374814e0f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.658+0000 7f3750797700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37480c7790 0x7f3748156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.658+0000 7f3750797700 1 --2- 172.21.15.135:0/1514019084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37480c9570 0x7f37481f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.658+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 >> 172.21.15.135:0/1514019084 conn(0x7f3748070bc0 msgr2=0x7f37480c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.659+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 shutdown_connections 2024-05-08T20:54:38.661 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:38.659+0000 7f3750797700 1 -- 172.21.15.135:0/1514019084 wait complete. 2024-05-08T20:54:38.671 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T20:54:38.797 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:38.795+0000 7feaa2ced200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T20:54:38.920 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:38.918+0000 7fcae8b30200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T20:54:38.964 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:38.963+0000 7feaa2ced200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:54:39.092 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:39.090+0000 7fcae8b30200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:54:39.129 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:39.128+0000 7feaa2ced200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:54:39.259 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:39.256+0000 7fcae8b30200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:54:39.954 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:39.952+0000 7feaa2ced200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:54:40.077 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:40.075+0000 7fcae8b30200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:54:40.193 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:40.191+0000 7feaa2ced200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:54:40.269 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:40.267+0000 7feaa2ced200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:54:40.316 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:40.314+0000 7fcae8b30200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:54:40.390 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:40.388+0000 7fcae8b30200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:54:40.434 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:40.432+0000 7feaa2ced200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:54:40.574 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-05-08T20:54:40.572+0000 7fcae8b30200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:54:41.457 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:41.455+0000 7fea5df89700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T20:54:41.634 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T20:54:41.500+0000 7f9028cca7c0 -1 osd.4 0 log_to_monitors true 2024-05-08T20:54:41.634 INFO:tasks.ceph.mgr.y.smithi135.stderr:2024-05-08T20:54:41.458+0000 7fea5df89700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T20:54:41.635 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T20:54:41.535+0000 7f92b1ee97c0 -1 osd.7 0 log_to_monitors true 2024-05-08T20:54:41.635 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-08T20:54:41.502+0000 7f6dc834c7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T20:54:41.635 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T20:54:41.547+0000 7f4683c057c0 -1 osd.6 0 log_to_monitors true 2024-05-08T20:54:41.636 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-08T20:54:41.546+0000 7f27ba9f07c0 -1 osd.1 0 log_to_monitors true 2024-05-08T20:54:41.636 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T20:54:41.564+0000 7f532ff877c0 -1 osd.5 0 log_to_monitors true 2024-05-08T20:54:41.636 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-08T20:54:41.568+0000 7f0164c877c0 -1 osd.0 0 log_to_monitors true 2024-05-08T20:54:41.636 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-08T20:54:41.568+0000 7f40a16bf7c0 -1 osd.2 0 log_to_monitors true 2024-05-08T20:54:45.477 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:45.538 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T20:54:45.536+0000 7f901d080700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T20:54:45.541 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-08T20:54:45.539+0000 7f015903d700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T20:54:45.541 INFO:tasks.ceph.osd.4.smithi183.stderr:2024-05-08T20:54:45.540+0000 7f9014c5a700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.542 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T20:54:45.541+0000 7f92a629f700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T20:54:45.546 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-05-08T20:54:45.544+0000 7f929de79700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.557 INFO:tasks.ceph.osd.0.smithi135.stderr:2024-05-08T20:54:45.556+0000 7f0150c17700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.558 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T20:54:45.556+0000 7f4677fbb700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T20:54:45.574 INFO:tasks.ceph.osd.6.smithi183.stderr:2024-05-08T20:54:45.572+0000 7f466fb95700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.575 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T20:54:45.573+0000 7f532433d700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T20:54:45.582 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-08T20:54:45.580+0000 7f27aeda6700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T20:54:45.587 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-08T20:54:45.584+0000 7f6dbc702700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T20:54:45.588 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-08T20:54:45.586+0000 7f4095a75700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T20:54:45.590 INFO:tasks.ceph.osd.5.smithi183.stderr:2024-05-08T20:54:45.588+0000 7f531bf17700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.599 INFO:tasks.ceph.osd.1.smithi135.stderr:2024-05-08T20:54:45.598+0000 7f27a6980700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.600 INFO:tasks.ceph.osd.3.smithi135.stderr:2024-05-08T20:54:45.598+0000 7f6db42dc700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.604 INFO:tasks.ceph.osd.2.smithi135.stderr:2024-05-08T20:54:45.603+0000 7f408d64f700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:54:45.663 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.661+0000 7f8cb7c56700 1 Processor -- start 2024-05-08T20:54:45.663 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.661+0000 7f8cb7c56700 1 -- start start 2024-05-08T20:54:45.665 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb7c56700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cb01598c0 0x7f8cb0164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.665 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb7c56700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb015d2d0 con 0x7f8cb00c99e0 2024-05-08T20:54:45.665 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb7c56700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb00c8fe0 con 0x7f8cb0159430 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb7c56700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00cbca0 con 0x7f8cb01598c0 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb61f3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cb01598c0 0x7f8cb0164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb61f3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8cb01598c0 0x7f8cb0164ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37092/0 (socket says 172.21.15.135:37092) 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb59f2700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8cb00c99e0 0x7f8cb00ce290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:39010/0 (socket says 172.21.15.135:39010) 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb61f3700 1 -- 172.21.15.135:0/2508773295 learned_addr learned my addr 172.21.15.135:0/2508773295 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb61f3700 1 -- 172.21.15.135:0/2508773295 >> v1:172.21.15.183:6789/0 conn(0x7f8cb0159430 legacy=0x7f8cb00ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb61f3700 1 -- 172.21.15.135:0/2508773295 >> v1:172.21.15.135:6789/0 conn(0x7f8cb00c99e0 legacy=0x7f8cb00ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.662+0000 7f8cb61f3700 1 -- 172.21.15.135:0/2508773295 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00cbf80 con 0x7f8cb01598c0 2024-05-08T20:54:45.666 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb61f3700 1 --2- 172.21.15.135:0/2508773295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb01598c0 0x7f8cb0164ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009e50 tx=0x7f8ca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e753a9c8ae146ce0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb49f0700 1 -- 172.21.15.135:0/2508773295 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800e070 con 0x7f8cb01598c0 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb49f0700 1 -- 172.21.15.135:0/2508773295 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca800b9c0 con 0x7f8cb01598c0 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb49f0700 1 -- 172.21.15.135:0/2508773295 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca800bd70 con 0x7f8cb01598c0 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb7c56700 1 -- 172.21.15.135:0/2508773295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb01598c0 msgr2=0x7f8cb0164ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/2508773295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb01598c0 0x7f8cb0164ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009e50 tx=0x7f8ca800b330 comp rx=0 tx=0).stop 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb7c56700 1 -- 172.21.15.135:0/2508773295 shutdown_connections 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/2508773295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb01598c0 0x7f8cb0164ce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb7c56700 1 -- 172.21.15.135:0/2508773295 >> 172.21.15.135:0/2508773295 conn(0x7f8cb00720f0 msgr2=0x7f8cb0072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb7c56700 1 -- 172.21.15.135:0/2508773295 shutdown_connections 2024-05-08T20:54:45.667 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.663+0000 7f8cb7c56700 1 -- 172.21.15.135:0/2508773295 wait complete. 2024-05-08T20:54:45.670 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 Processor -- start 2024-05-08T20:54:45.670 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 -- start start 2024-05-08T20:54:45.670 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb00c99e0 0x7f8cb00c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.670 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0159430 0x7f8cb01ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.670 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb01598c0 0x7f8cb01efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0154890 con 0x7f8cb0159430 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb01ef150 con 0x7f8cb01598c0 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb7c56700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0153da0 con 0x7f8cb00c99e0 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb51f1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0159430 0x7f8cb01ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb51f1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0159430 0x7f8cb01ef5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37108/0 (socket says 172.21.15.135:37108) 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.665+0000 7f8cb51f1700 1 -- 172.21.15.135:0/749768596 learned_addr learned my addr 172.21.15.135:0/749768596 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb61f3700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb01598c0 0x7f8cb01efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb59f2700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb00c99e0 0x7f8cb00c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb51f1700 1 -- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb00c99e0 msgr2=0x7f8cb00c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb51f1700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb00c99e0 0x7f8cb00c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb51f1700 1 -- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb01598c0 msgr2=0x7f8cb01efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb51f1700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb01598c0 0x7f8cb01efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.671 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb51f1700 1 -- 172.21.15.135:0/749768596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8009b30 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb61f3700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb01598c0 0x7f8cb01efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb59f2700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb00c99e0 0x7f8cb00c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb51f1700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0159430 0x7f8cb01ef5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c4e0 tx=0x7f8cac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8ca67fc700 1 -- 172.21.15.135:0/749768596 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0052d0 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8ca67fc700 1 -- 172.21.15.135:0/749768596 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac005430 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb00b44d0 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8ca67fc700 1 -- 172.21.15.135:0/749768596 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0038c0 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.666+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb0153ff0 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.667+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb01ef2c0 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.667+0000 7f8ca67fc700 1 -- 172.21.15.135:0/749768596 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f8cac003a20 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.668+0000 7f8ca67fc700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8c9406ac00 0x7f8c9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.668+0000 7f8ca67fc700 1 -- 172.21.15.135:0/749768596 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8cac087950 con 0x7f8cb0159430 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.668+0000 7f8cb59f2700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8c9406ac00 0x7f8c9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:45.672 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.668+0000 7f8cb59f2700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8c9406ac00 0x7f8c9406d0c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0000f60 tx=0x7f8ca0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:45.674 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.673+0000 7f8ca67fc700 1 -- 172.21.15.135:0/749768596 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8cb01ef2c0 con 0x7f8cb0159430 2024-05-08T20:54:45.869 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.866+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cb01ef2c0 con 0x7f8cb0159430 2024-05-08T20:54:45.869 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.867+0000 7f8ca67fc700 1 -- 172.21.15.135:0/749768596 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8cb01ef2c0 con 0x7f8cb0159430 2024-05-08T20:54:45.870 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-08T20:54:45.870 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":12,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:54:43.510145+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:45.872 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8c9406ac00 msgr2=0x7f8c9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.872 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8c9406ac00 0x7f8c9406d0c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0000f60 tx=0x7f8ca0009040 comp rx=0 tx=0).stop 2024-05-08T20:54:45.872 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0159430 msgr2=0x7f8cb01ef5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:45.872 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0159430 0x7f8cb01ef5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00c4e0 tx=0x7f8cac00c8a0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.872 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 shutdown_connections 2024-05-08T20:54:45.872 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8c9406ac00 0x7f8c9406d0c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.873 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cb01598c0 0x7f8cb01efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.873 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cb00c99e0 0x7f8cb00c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.873 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 --2- 172.21.15.135:0/749768596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0159430 0x7f8cb01ef5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:45.873 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 >> 172.21.15.135:0/749768596 conn(0x7f8cb00720f0 msgr2=0x7f8cb01530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:45.873 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 shutdown_connections 2024-05-08T20:54:45.873 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:45.869+0000 7f8cb7c56700 1 -- 172.21.15.135:0/749768596 wait complete. 2024-05-08T20:54:45.883 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T20:54:52.690 DEBUG:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:52.815 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.812+0000 7f326cf04700 1 Processor -- start 2024-05-08T20:54:52.815 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.812+0000 7f326cf04700 1 -- start start 2024-05-08T20:54:52.817 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f326cf04700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f32680c6400 0x7f32680c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f326cf04700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f32681571a0 0x7f32681575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f326cf04700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326806c580 con 0x7f3268151470 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f326cf04700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3268157fa0 con 0x7f32681571a0 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f326cf04700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326806c7d0 con 0x7f32680c6400 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f3266d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f32681571a0 0x7f32681575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f326659c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f3268151470 0x7f32680c7610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55244/0 (socket says 172.21.15.135:55244) 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f326659c700 1 -- 172.21.15.135:0/1239154911 learned_addr learned my addr 172.21.15.135:0/1239154911 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.813+0000 7f3265d9b700 1 --2- 172.21.15.135:0/1239154911 >> v2:172.21.15.183:3300/0 conn(0x7f32680c6400 0x7f32680c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f3266d9d700 1 -- 172.21.15.135:0/1239154911 >> v2:172.21.15.183:3300/0 conn(0x7f32680c6400 msgr2=0x7f32680c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f3266d9d700 1 --2- 172.21.15.135:0/1239154911 >> v2:172.21.15.183:3300/0 conn(0x7f32680c6400 0x7f32680c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f3266d9d700 1 -- 172.21.15.135:0/1239154911 >> v1:172.21.15.135:6789/0 conn(0x7f3268151470 legacy=0x7f32680c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:52.818 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326559a700 1 -- 172.21.15.135:0/1239154911 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99103248 0 0) 0x7f326806c580 con 0x7f3268151470 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f3266d9d700 1 -- 172.21.15.135:0/1239154911 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326806cab0 con 0x7f32681571a0 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f3266d9d700 1 --2- 172.21.15.135:0/1239154911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f32681575b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f326806fa00 tx=0x7f326000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e434ae84eca5a0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326559a700 1 -- 172.21.15.135:0/1239154911 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326000e070 con 0x7f32681571a0 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326559a700 1 -- 172.21.15.135:0/1239154911 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326000bbd0 con 0x7f32681571a0 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326559a700 1 -- 172.21.15.135:0/1239154911 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260012430 con 0x7f32681571a0 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326cf04700 1 -- 172.21.15.135:0/1239154911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 msgr2=0x7f32681575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326cf04700 1 --2- 172.21.15.135:0/1239154911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f32681575b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f326806fa00 tx=0x7f326000b330 comp rx=0 tx=0).stop 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326cf04700 1 -- 172.21.15.135:0/1239154911 shutdown_connections 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.814+0000 7f326cf04700 1 --2- 172.21.15.135:0/1239154911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f32681575b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.815+0000 7f326cf04700 1 --2- 172.21.15.135:0/1239154911 >> v2:172.21.15.183:3300/0 conn(0x7f32680c6400 0x7f32680c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.815+0000 7f326cf04700 1 -- 172.21.15.135:0/1239154911 >> 172.21.15.135:0/1239154911 conn(0x7f326806b3d0 msgr2=0x7f326806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.815+0000 7f326cf04700 1 -- 172.21.15.135:0/1239154911 shutdown_connections 2024-05-08T20:54:52.819 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.815+0000 7f326cf04700 1 -- 172.21.15.135:0/1239154911 wait complete. 2024-05-08T20:54:52.822 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.816+0000 7f326cf04700 1 Processor -- start 2024-05-08T20:54:52.822 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.816+0000 7f326cf04700 1 -- start start 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32680c6400 0x7f3268156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3268151470 0x7f32681ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f3268142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3268147c00 con 0x7f32681571a0 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32681ecb20 con 0x7f32680c6400 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32680ca880 con 0x7f3268151470 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f3268142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f3268142f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41336/0 (socket says 172.21.15.135:41336) 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 -- 172.21.15.135:0/996548776 learned_addr learned my addr 172.21.15.135:0/996548776 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326659c700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32680c6400 0x7f3268156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 -- 172.21.15.135:0/996548776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3268151470 msgr2=0x7f32681ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:52.823 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3268151470 0x7f32681ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 -- 172.21.15.135:0/996548776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32680c6400 msgr2=0x7f3268156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32680c6400 0x7f3268156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 -- 172.21.15.135:0/996548776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260009a70 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3266d9d700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f3268142f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f326806da90 tx=0x7f3260004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3256ffd700 1 -- 172.21.15.135:0/996548776 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260012430 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3256ffd700 1 -- 172.21.15.135:0/996548776 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260020070 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32681ecdc0 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f3256ffd700 1 -- 172.21.15.135:0/996548776 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260004280 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.817+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32680ca5c0 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.818+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32681ecf50 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.819+0000 7f3256ffd700 1 -- 172.21.15.135:0/996548776 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32600043e0 con 0x7f32681571a0 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.819+0000 7f3256ffd700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f324806ac90 0x7f324806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:52.824 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.819+0000 7f3256ffd700 1 -- 172.21.15.135:0/996548776 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3260022070 con 0x7f32681571a0 2024-05-08T20:54:52.825 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.819+0000 7f326659c700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f324806ac90 0x7f324806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:52.825 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.820+0000 7f326659c700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f324806ac90 0x7f324806d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f325c000f60 tx=0x7f325c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:52.826 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:52.824+0000 7f3256ffd700 1 -- 172.21.15.135:0/996548776 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3260056500 con 0x7f32681571a0 2024-05-08T20:54:53.025 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.022+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3268067890 con 0x7f32681571a0 2024-05-08T20:54:53.026 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.023+0000 7f3256ffd700 1 -- 172.21.15.135:0/996548776 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f3260059b20 con 0x7f32681571a0 2024-05-08T20:54:53.026 INFO:teuthology.misc.health.smithi135.stdout: 2024-05-08T20:54:53.026 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":17,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:54:50.568536+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:53.028 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f324806ac90 msgr2=0x7f324806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.028 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f324806ac90 0x7f324806d150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f325c000f60 tx=0x7f325c009040 comp rx=0 tx=0).stop 2024-05-08T20:54:53.028 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 msgr2=0x7f3268142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f3268142f60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f326806da90 tx=0x7f3260004ad0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 shutdown_connections 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f324806ac90 0x7f324806d150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32680c6400 0x7f3268156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32681571a0 0x7f3268142f60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 --2- 172.21.15.135:0/996548776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3268151470 0x7f32681ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 >> 172.21.15.135:0/996548776 conn(0x7f326806b3d0 msgr2=0x7f32680c6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 shutdown_connections 2024-05-08T20:54:53.029 INFO:teuthology.misc.health.smithi135.stderr:2024-05-08T20:54:53.025+0000 7f326cf04700 1 -- 172.21.15.135:0/996548776 wait complete. 2024-05-08T20:54:53.039 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T20:54:53.039 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T20:54:53.040 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T20:54:53.040 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T20:54:53.042 INFO:tasks.ceph.mds.a:Started 2024-05-08T20:54:53.042 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T20:54:53.042 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T20:54:53.044 INFO:tasks.ceph.mds.c:Started 2024-05-08T20:54:53.044 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-08T20:54:53.045 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-08T20:54:53.046 INFO:tasks.ceph.mds.e:Started 2024-05-08T20:54:53.047 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T20:54:53.047 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T20:54:53.049 INFO:tasks.ceph.mds.b:Started 2024-05-08T20:54:53.050 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T20:54:53.050 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T20:54:53.052 INFO:tasks.ceph.mds.d:Started 2024-05-08T20:54:53.052 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-08T20:54:53.052 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-08T20:54:53.054 INFO:tasks.ceph.mds.f:Started 2024-05-08T20:54:53.054 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T20:54:53.055 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:53.126 INFO:tasks.ceph.mds.c.smithi135.stdout:starting mds.c at 2024-05-08T20:54:53.126 INFO:tasks.ceph.mds.a.smithi135.stdout:starting mds.a at 2024-05-08T20:54:53.131 INFO:tasks.ceph.mds.e.smithi135.stdout:starting mds.e at 2024-05-08T20:54:53.143 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2024-05-08T20:54:53.144 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2024-05-08T20:54:53.144 INFO:tasks.ceph.mds.f.smithi183.stdout:starting mds.f at 2024-05-08T20:54:53.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.185+0000 7f29cef9f700 1 Processor -- start 2024-05-08T20:54:53.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.185+0000 7f29cef9f700 1 -- start start 2024-05-08T20:54:53.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29cef9f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c81534b0 0x7f29c80c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29cef9f700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f29c806c040 0x7f29c80cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29cef9f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c80c80a0 con 0x7f29c80c7700 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29cef9f700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c80c2940 con 0x7f29c806c040 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29cef9f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80c2c20 con 0x7f29c81534b0 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29cd53c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f29c80c7700 0x7f29c81595d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55286/0 (socket says 172.21.15.135:55286) 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29cd53c700 1 -- 172.21.15.135:0/3564406542 learned_addr learned my addr 172.21.15.135:0/3564406542 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29ccd3b700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c81534b0 0x7f29c80c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c7fff700 1 --2- 172.21.15.135:0/3564406542 >> v2:172.21.15.183:3300/0 conn(0x7f29c806c040 0x7f29c80cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576430591 0 0) 0x7f29c80c80a0 con 0x7f29c80c7700 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b80035b0 con 0x7f29c80c7700 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 440600814 0 0) 0x7f29b80035b0 con 0x7f29c80c7700 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c81534b0 msgr2=0x7f29c80c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c81534b0 0x7f29c80c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 >> v2:172.21.15.183:3300/0 conn(0x7f29c806c040 msgr2=0x7f29c80cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 --2- 172.21.15.135:0/3564406542 >> v2:172.21.15.183:3300/0 conn(0x7f29c806c040 0x7f29c80cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c80c2f00 con 0x7f29c80c7700 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f29c00019f0 con 0x7f29c80c7700 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 >> v1:172.21.15.135:6789/0 conn(0x7f29c80c7700 legacy=0x7f29c81595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.186+0000 7f29c77fe700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b8003a00 0x7f29b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29b80048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b8004f40 0x7f29b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80c2940 con 0x7f29b80043f0 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80c2c20 con 0x7f29b8004f40 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b800bf50 con 0x7f29b8003a00 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29ccd3b700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c81534b0 0x7f29c80c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 --2- 172.21.15.135:0/3564406542 >> v2:172.21.15.183:3300/0 conn(0x7f29c806c040 0x7f29c80cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29b80048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29cd53c700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b8004f40 0x7f29b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29ccd3b700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b8003a00 0x7f29b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 -- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b8003a00 msgr2=0x7f29b8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b8003a00 0x7f29b8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 -- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b8004f40 msgr2=0x7f29b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b8004f40 0x7f29b800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 -- 172.21.15.135:0/3564406542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b80035b0 con 0x7f29b80043f0 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29cd53c700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b8004f40 0x7f29b800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c7fff700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29b80048d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d40 tx=0x7f29b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2888394aecb29d8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4009e90 con 0x7f29b80043f0 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400e9a0 con 0x7f29b80043f0 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.187+0000 7f29c77fe700 1 -- 172.21.15.135:0/3564406542 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400ed10 con 0x7f29b80043f0 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.188+0000 7f29cef9f700 1 -- 172.21.15.135:0/3564406542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 msgr2=0x7f29b80048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.188+0000 7f29cef9f700 1 --2- 172.21.15.135:0/3564406542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29b80048d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d40 tx=0x7f29b8005880 comp rx=0 tx=0).stop 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.188+0000 7f29cd53c700 1 -- 172.21.15.135:0/3564406542 reap_dead start 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.188+0000 7f29cef9f700 1 -- 172.21.15.135:0/3564406542 shutdown_connections 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.188+0000 7f29cef9f700 1 -- 172.21.15.135:0/3564406542 >> 172.21.15.135:0/3564406542 conn(0x7f29c806f2d0 msgr2=0x7f29c8070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.188+0000 7f29cef9f700 1 -- 172.21.15.135:0/3564406542 shutdown_connections 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.188+0000 7f29cef9f700 1 -- 172.21.15.135:0/3564406542 wait complete. 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.189+0000 7f29cef9f700 1 Processor -- start 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.189+0000 7f29cef9f700 1 -- start start 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cef9f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29c8155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cef9f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29c81552d0 0x7f29c8154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cef9f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c8158590 0x7f29c80add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cef9f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8154660 con 0x7f29b80043f0 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cef9f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80af720 con 0x7f29c81552d0 2024-05-08T20:54:53.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cef9f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8153d50 con 0x7f29c8158590 2024-05-08T20:54:53.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29c8155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29c8155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41416/0 (socket says 172.21.15.135:41416) 2024-05-08T20:54:53.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 -- 172.21.15.135:0/719789864 learned_addr learned my addr 172.21.15.135:0/719789864 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:53.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cd53c700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c8158590 0x7f29c80add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29c7fff700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29c81552d0 0x7f29c8154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 -- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c8158590 msgr2=0x7f29c80add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c8158590 0x7f29c80add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 -- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29c81552d0 msgr2=0x7f29c8154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29c81552d0 0x7f29c8154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 -- 172.21.15.135:0/719789864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c80acba0 con 0x7f29b80043f0 2024-05-08T20:54:53.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29ccd3b700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29c8155890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29bc011c00 tx=0x7f29bc011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29c57fa700 1 -- 172.21.15.135:0/719789864 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00f980 con 0x7f29b80043f0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29c57fa700 1 -- 172.21.15.135:0/719789864 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00fae0 con 0x7f29b80043f0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.190+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c80ace80 con 0x7f29b80043f0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.191+0000 7f29c57fa700 1 -- 172.21.15.135:0/719789864 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00fe50 con 0x7f29b80043f0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.191+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c8154280 con 0x7f29b80043f0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.192+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c81547a0 con 0x7f29b80043f0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.192+0000 7f29c57fa700 1 -- 172.21.15.135:0/719789864 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f29bc014440 con 0x7f29b80043f0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.192+0000 7f29c57fa700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f29ac06ac90 0x7f29ac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.192+0000 7f29c7fff700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f29ac06ac90 0x7f29ac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.192+0000 7f29c57fa700 1 -- 172.21.15.135:0/719789864 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f29bc089770 con 0x7f29b80043f0 2024-05-08T20:54:53.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.193+0000 7f29c7fff700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f29ac06ac90 0x7f29ac06d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29b80047d0 tx=0x7f29b401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.197+0000 7f29c57fa700 1 -- 172.21.15.135:0/719789864 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f29c81547a0 con 0x7f29b80043f0 2024-05-08T20:54:53.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.392+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c81547a0 con 0x7f29b80043f0 2024-05-08T20:54:53.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.393+0000 7f29c57fa700 1 -- 172.21.15.135:0/719789864 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f29c81547a0 con 0x7f29b80043f0 2024-05-08T20:54:53.396 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:53.396 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:54:50.568536+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f29ac06ac90 msgr2=0x7f29ac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f29ac06ac90 0x7f29ac06d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29b80047d0 tx=0x7f29b401d040 comp rx=0 tx=0).stop 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 msgr2=0x7f29c8155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29c8155890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29bc011c00 tx=0x7f29bc011f10 comp rx=0 tx=0).stop 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 shutdown_connections 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f29ac06ac90 0x7f29ac06d150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29c8158590 0x7f29c80add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29b80043f0 0x7f29c8155890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 --2- 172.21.15.135:0/719789864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29c81552d0 0x7f29c8154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.395+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 >> 172.21.15.135:0/719789864 conn(0x7f29c806f2d0 msgr2=0x7f29c8151170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:53.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.396+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 shutdown_connections 2024-05-08T20:54:53.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.396+0000 7f29cef9f700 1 -- 172.21.15.135:0/719789864 wait complete. 2024-05-08T20:54:53.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:54:53.411 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:54:53.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.532+0000 7feac9724700 1 Processor -- start 2024-05-08T20:54:53.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.532+0000 7feac9724700 1 -- start start 2024-05-08T20:54:53.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.533+0000 7feac9724700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feac4072390 0x7feac40c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.533+0000 7feac9724700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac40cc7e0 0x7feac40cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.533+0000 7feac9724700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac40cc4b0 con 0x7feac4072770 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.533+0000 7feac9724700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac40cc2b0 con 0x7feac4072390 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.533+0000 7feac9724700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac415a360 con 0x7feac40cc7e0 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.533+0000 7feac37fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7feac4072770 0x7feac4159c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55292/0 (socket says 172.21.15.135:55292) 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.533+0000 7feac37fe700 1 -- 172.21.15.135:0/1421046224 learned_addr learned my addr 172.21.15.135:0/1421046224 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac27fc700 1 --2- 172.21.15.135:0/1421046224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac40cc7e0 0x7feac40cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac2ffd700 1 --2- 172.21.15.135:0/1421046224 >> v2:172.21.15.183:3300/0 conn(0x7feac4072390 0x7feac40c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac1ffb700 1 -- 172.21.15.135:0/1421046224 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273314150 0 0) 0x7feac40cc4b0 con 0x7feac4072770 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac1ffb700 1 -- 172.21.15.135:0/1421046224 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaac0035b0 con 0x7feac4072770 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac27fc700 1 -- 172.21.15.135:0/1421046224 >> v2:172.21.15.183:3300/0 conn(0x7feac4072390 msgr2=0x7feac40c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac27fc700 1 --2- 172.21.15.135:0/1421046224 >> v2:172.21.15.183:3300/0 conn(0x7feac4072390 0x7feac40c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac27fc700 1 -- 172.21.15.135:0/1421046224 >> v1:172.21.15.135:6789/0 conn(0x7feac4072770 legacy=0x7feac4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac1ffb700 1 -- 172.21.15.135:0/1421046224 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1644900292 0 0) 0x7feaac0035b0 con 0x7feac4072770 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac27fc700 1 -- 172.21.15.135:0/1421046224 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac406b150 con 0x7feac40cc7e0 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac27fc700 1 --2- 172.21.15.135:0/1421046224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac40cc7e0 0x7feac40cbd70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feab4009840 tx=0x7feab4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d91534c89a3f23f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac1ffb700 1 -- 172.21.15.135:0/1421046224 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0019f0 con 0x7feac40cc7e0 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac1ffb700 1 -- 172.21.15.135:0/1421046224 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab4004030 con 0x7feac40cc7e0 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.534+0000 7feac1ffb700 1 -- 172.21.15.135:0/1421046224 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40043c0 con 0x7feac40cc7e0 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 -- 172.21.15.135:0/1421046224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac40cc7e0 msgr2=0x7feac40cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 --2- 172.21.15.135:0/1421046224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac40cc7e0 0x7feac40cbd70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feab4009840 tx=0x7feab4009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:53.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 -- 172.21.15.135:0/1421046224 shutdown_connections 2024-05-08T20:54:53.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 --2- 172.21.15.135:0/1421046224 >> v2:172.21.15.183:3300/0 conn(0x7feac4072390 0x7feac40c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 --2- 172.21.15.135:0/1421046224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac40cc7e0 0x7feac40cbd70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 -- 172.21.15.135:0/1421046224 >> 172.21.15.135:0/1421046224 conn(0x7feac406ec40 msgr2=0x7feac406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:53.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 -- 172.21.15.135:0/1421046224 shutdown_connections 2024-05-08T20:54:53.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.535+0000 7feac9724700 1 -- 172.21.15.135:0/1421046224 wait complete. 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.536+0000 7feac9724700 1 Processor -- start 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.536+0000 7feac9724700 1 -- start start 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.537+0000 7feac9724700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac4072390 0x7feac4153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.537+0000 7feac9724700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feac4072770 0x7feac41eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.537+0000 7feac9724700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac40cc7e0 0x7feac4157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.537+0000 7feac9724700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac4153070 con 0x7feac40cc7e0 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.537+0000 7feac9724700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac4154000 con 0x7feac4072770 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.537+0000 7feac9724700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac414dac0 con 0x7feac4072390 2024-05-08T20:54:53.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.537+0000 7feac37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac40cc7e0 0x7feac4157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac40cc7e0 0x7feac4157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41432/0 (socket says 172.21.15.135:41432) 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 -- 172.21.15.135:0/250581645 learned_addr learned my addr 172.21.15.135:0/250581645 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac2ffd700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac4072390 0x7feac4153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac27fc700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feac4072770 0x7feac41eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 -- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac4072390 msgr2=0x7feac4153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac4072390 0x7feac4153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 -- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feac4072770 msgr2=0x7feac41eea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feac4072770 0x7feac41eea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 -- 172.21.15.135:0/250581645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab40094a0 con 0x7feac40cc7e0 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac2ffd700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac4072390 0x7feac4153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac37fe700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac40cc7e0 0x7feac4157f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feabc001ba0 tx=0x7feabc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feaab7fe700 1 -- 172.21.15.135:0/250581645 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc00ac20 con 0x7feac40cc7e0 2024-05-08T20:54:53.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feaab7fe700 1 -- 172.21.15.135:0/250581645 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc00ada0 con 0x7feac40cc7e0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac41ef260 con 0x7feac40cc7e0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feaab7fe700 1 -- 172.21.15.135:0/250581645 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc007310 con 0x7feac40cc7e0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.538+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac41ef820 con 0x7feac40cc7e0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.539+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac4067fa0 con 0x7feac40cc7e0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.540+0000 7feaab7fe700 1 -- 172.21.15.135:0/250581645 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feabc007470 con 0x7feac40cc7e0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.540+0000 7feaab7fe700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feab006ac90 0x7feab006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.540+0000 7feaab7fe700 1 -- 172.21.15.135:0/250581645 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feabc088ff0 con 0x7feac40cc7e0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.540+0000 7feac2ffd700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feab006ac90 0x7feab006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.540+0000 7feac2ffd700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feab006ac90 0x7feab006d150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feab8009b90 tx=0x7feab8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.545+0000 7feaab7fe700 1 -- 172.21.15.135:0/250581645 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feabc054490 con 0x7feac40cc7e0 2024-05-08T20:54:53.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.740+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feac40c6da0 con 0x7feac40cc7e0 2024-05-08T20:54:53.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.741+0000 7feaab7fe700 1 -- 172.21.15.135:0/250581645 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7feabc018020 con 0x7feac40cc7e0 2024-05-08T20:54:53.744 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feab006ac90 msgr2=0x7feab006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feab006ac90 0x7feab006d150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feab8009b90 tx=0x7feab8008040 comp rx=0 tx=0).stop 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac40cc7e0 msgr2=0x7feac4157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac40cc7e0 0x7feac4157f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feabc001ba0 tx=0x7feabc00a060 comp rx=0 tx=0).stop 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 shutdown_connections 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feab006ac90 0x7feab006d150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feac40cc7e0 0x7feac4157f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feac4072390 0x7feac4153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 --2- 172.21.15.135:0/250581645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feac4072770 0x7feac41eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 >> 172.21.15.135:0/250581645 conn(0x7feac406ec40 msgr2=0x7feac406ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:53.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 shutdown_connections 2024-05-08T20:54:53.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.743+0000 7feac9724700 1 -- 172.21.15.135:0/250581645 wait complete. 2024-05-08T20:54:53.762 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:54:53.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.880+0000 7fe2c783f700 1 Processor -- start 2024-05-08T20:54:53.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.880+0000 7fe2c783f700 1 -- start start 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c783f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe2c01533a0 0x7fe2c006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c783f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c00c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c783f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c015d640 con 0x7fe2c00c45f0 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c783f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00c4a80 con 0x7fe2c01533a0 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c783f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c015ca70 con 0x7fe2c006aea0 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c55db700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe2c01533a0 0x7fe2c006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c5ddc700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe2c00c45f0 0x7fe2c01593e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55308/0 (socket says 172.21.15.135:55308) 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c55db700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe2c01533a0 0x7fe2c006a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41434/0 (socket says 172.21.15.135:41434) 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c5ddc700 1 -- 172.21.15.135:0/459994443 learned_addr learned my addr 172.21.15.135:0/459994443 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.881+0000 7fe2c4dda700 1 --2- 172.21.15.135:0/459994443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c00c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2c55db700 1 -- 172.21.15.135:0/459994443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 msgr2=0x7fe2c00c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2c55db700 1 --2- 172.21.15.135:0/459994443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c00c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2c55db700 1 -- 172.21.15.135:0/459994443 >> v1:172.21.15.135:6789/0 conn(0x7fe2c00c45f0 legacy=0x7fe2c01593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2c55db700 1 -- 172.21.15.135:0/459994443 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c015cd10 con 0x7fe2c01533a0 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2c55db700 1 --2- 172.21.15.135:0/459994443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c01533a0 0x7fe2c006a960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009840 tx=0x7fe2b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a534c173c0461f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2b7fff700 1 -- 172.21.15.135:0/459994443 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0004230 con 0x7fe2c01533a0 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2b7fff700 1 -- 172.21.15.135:0/459994443 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b0004390 con 0x7fe2c01533a0 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2b7fff700 1 -- 172.21.15.135:0/459994443 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00036a0 con 0x7fe2c01533a0 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2c783f700 1 -- 172.21.15.135:0/459994443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c01533a0 msgr2=0x7fe2c006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.882+0000 7fe2c783f700 1 --2- 172.21.15.135:0/459994443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c01533a0 0x7fe2c006a960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009840 tx=0x7fe2b0009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.883+0000 7fe2c783f700 1 -- 172.21.15.135:0/459994443 shutdown_connections 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.883+0000 7fe2c783f700 1 --2- 172.21.15.135:0/459994443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c01533a0 0x7fe2c006a960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.883+0000 7fe2c783f700 1 --2- 172.21.15.135:0/459994443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c00c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.883+0000 7fe2c783f700 1 -- 172.21.15.135:0/459994443 >> 172.21.15.135:0/459994443 conn(0x7fe2c006fac0 msgr2=0x7fe2c006fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:53.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.883+0000 7fe2c783f700 1 -- 172.21.15.135:0/459994443 shutdown_connections 2024-05-08T20:54:53.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.883+0000 7fe2c783f700 1 -- 172.21.15.135:0/459994443 wait complete. 2024-05-08T20:54:53.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.884+0000 7fe2c783f700 1 Processor -- start 2024-05-08T20:54:53.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.884+0000 7fe2c783f700 1 -- start start 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.884+0000 7fe2c783f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c01f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.884+0000 7fe2c783f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c00c45f0 0x7fe2c006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c783f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2c01533a0 0x7fe2c006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c783f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c01f2900 con 0x7fe2c00c45f0 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c783f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c7fd0 con 0x7fe2c01533a0 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c783f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c01f2590 con 0x7fe2c006aea0 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c00c45f0 0x7fe2c006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c00c45f0 0x7fe2c006ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41438/0 (socket says 172.21.15.135:41438) 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 -- 172.21.15.135:0/2057768991 learned_addr learned my addr 172.21.15.135:0/2057768991 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c55db700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c01f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c5ddc700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2c01533a0 0x7fe2c006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 -- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 msgr2=0x7fe2c01f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c01f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 -- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2c01533a0 msgr2=0x7fe2c006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2c01533a0 0x7fe2c006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 -- 172.21.15.135:0/2057768991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00094a0 con 0x7fe2c00c45f0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c55db700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c01f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c4dda700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c00c45f0 0x7fe2c006ba70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d7d0 tx=0x7fe2bc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2b5ffb700 1 -- 172.21.15.135:0/2057768991 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0125f0 con 0x7fe2c00c45f0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2b5ffb700 1 -- 172.21.15.135:0/2057768991 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc012750 con 0x7fe2c00c45f0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2b5ffb700 1 -- 172.21.15.135:0/2057768991 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc012b00 con 0x7fe2c00c45f0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c01509f0 con 0x7fe2c00c45f0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.885+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c014ef10 con 0x7fe2c00c45f0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.886+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c01f2a40 con 0x7fe2c00c45f0 2024-05-08T20:54:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.887+0000 7fe2b5ffb700 1 -- 172.21.15.135:0/2057768991 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe2bc012c60 con 0x7fe2c00c45f0 2024-05-08T20:54:53.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.887+0000 7fe2b5ffb700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe2a406ac90 0x7fe2a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:53.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.887+0000 7fe2b5ffb700 1 -- 172.21.15.135:0/2057768991 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2bc0890f0 con 0x7fe2c00c45f0 2024-05-08T20:54:53.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.887+0000 7fe2c55db700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe2a406ac90 0x7fe2a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:53.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.887+0000 7fe2c55db700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe2a406ac90 0x7fe2a406d150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00090b0 tx=0x7fe2b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:53.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:53.891+0000 7fe2b5ffb700 1 -- 172.21.15.135:0/2057768991 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe2c01f2a40 con 0x7fe2c00c45f0 2024-05-08T20:54:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.131+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2c01f2a40 con 0x7fe2c00c45f0 2024-05-08T20:54:54.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.131+0000 7fe2b5ffb700 1 -- 172.21.15.135:0/2057768991 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fe2c01f2a40 con 0x7fe2c00c45f0 2024-05-08T20:54:54.134 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:54.134 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T20:54:54.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe2a406ac90 msgr2=0x7fe2a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:54.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe2a406ac90 0x7fe2a406d150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2b00090b0 tx=0x7fe2b0008030 comp rx=0 tx=0).stop 2024-05-08T20:54:54.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c00c45f0 msgr2=0x7fe2c006ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:54.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c00c45f0 0x7fe2c006ba70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d7d0 tx=0x7fe2bc00db90 comp rx=0 tx=0).stop 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 shutdown_connections 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe2a406ac90 0x7fe2a406d150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2c01533a0 0x7fe2c006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2c006aea0 0x7fe2c01f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 --2- 172.21.15.135:0/2057768991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2c00c45f0 0x7fe2c006ba70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 >> 172.21.15.135:0/2057768991 conn(0x7fe2c006fac0 msgr2=0x7fe2c00ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 shutdown_connections 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:54.133+0000 7fe2c783f700 1 -- 172.21.15.135:0/2057768991 wait complete. 2024-05-08T20:54:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 2 2024-05-08T20:54:56.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:54:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.282+0000 7f5c81841700 1 Processor -- start 2024-05-08T20:54:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.282+0000 7f5c81841700 1 -- start start 2024-05-08T20:54:56.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.283+0000 7f5c81841700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5c7c1536d0 0x7f5c7c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.283+0000 7f5c81841700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c0cc8c0 con 0x7f5c7c072b50 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.283+0000 7f5c81841700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c0c6c00 con 0x7f5c7c0c6770 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.283+0000 7f5c81841700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c153ab0 con 0x7f5c7c1536d0 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.283+0000 7f5c7affd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5c7c1536d0 0x7f5c7c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.283+0000 7f5c7a7fc700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f5c7c072b50 0x7f5c7c15d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55314/0 (socket says 172.21.15.135:55314) 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.283+0000 7f5c7a7fc700 1 -- 172.21.15.135:0/2346972403 learned_addr learned my addr 172.21.15.135:0/2346972403 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c7affd700 1 -- 172.21.15.135:0/2346972403 >> v1:172.21.15.183:6789/0 conn(0x7f5c7c0c6770 legacy=0x7f5c7c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c7affd700 1 -- 172.21.15.135:0/2346972403 >> v1:172.21.15.135:6789/0 conn(0x7f5c7c072b50 legacy=0x7f5c7c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c79ffb700 1 -- 172.21.15.135:0/2346972403 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268234889 0 0) 0x7f5c7c0cc8c0 con 0x7f5c7c072b50 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c7affd700 1 -- 172.21.15.135:0/2346972403 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c0cc380 con 0x7f5c7c1536d0 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c7affd700 1 --2- 172.21.15.135:0/2346972403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c1536d0 0x7f5c7c159f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009840 tx=0x7f5c70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a46a7007fe34d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c79ffb700 1 -- 172.21.15.135:0/2346972403 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011830 con 0x7f5c7c1536d0 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c79ffb700 1 -- 172.21.15.135:0/2346972403 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70011990 con 0x7f5c7c1536d0 2024-05-08T20:54:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.284+0000 7f5c79ffb700 1 -- 172.21.15.135:0/2346972403 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70011d20 con 0x7f5c7c1536d0 2024-05-08T20:54:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.285+0000 7f5c81841700 1 -- 172.21.15.135:0/2346972403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c1536d0 msgr2=0x7f5c7c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.285+0000 7f5c81841700 1 --2- 172.21.15.135:0/2346972403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c1536d0 0x7f5c7c159f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009840 tx=0x7f5c70009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.285+0000 7f5c81841700 1 -- 172.21.15.135:0/2346972403 shutdown_connections 2024-05-08T20:54:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.285+0000 7f5c81841700 1 --2- 172.21.15.135:0/2346972403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c1536d0 0x7f5c7c159f90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.285+0000 7f5c81841700 1 -- 172.21.15.135:0/2346972403 >> 172.21.15.135:0/2346972403 conn(0x7f5c7c06daf0 msgr2=0x7f5c7c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.285+0000 7f5c81841700 1 -- 172.21.15.135:0/2346972403 shutdown_connections 2024-05-08T20:54:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.285+0000 7f5c81841700 1 -- 172.21.15.135:0/2346972403 wait complete. 2024-05-08T20:54:56.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.286+0000 7f5c81841700 1 Processor -- start 2024-05-08T20:54:56.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.286+0000 7f5c81841700 1 -- start start 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c81841700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c7c072b50 0x7f5c7c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c81841700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c0c6770 0x7f5c7c1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c81841700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c7c1536d0 0x7f5c7c1456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c81841700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c2d00 con 0x7f5c7c0c6770 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c81841700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c1efb20 con 0x7f5c7c072b50 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c81841700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0c8de0 con 0x7f5c7c1536d0 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c0c6770 0x7f5c7c1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c0c6770 0x7f5c7c1451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41460/0 (socket says 172.21.15.135:41460) 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 -- 172.21.15.135:0/2519410330 learned_addr learned my addr 172.21.15.135:0/2519410330 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7affd700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c7c072b50 0x7f5c7c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7b7fe700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c7c1536d0 0x7f5c7c1456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 -- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c7c1536d0 msgr2=0x7f5c7c1456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c7c1536d0 0x7f5c7c1456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 -- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c7c072b50 msgr2=0x7f5c7c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c7c072b50 0x7f5c7c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 -- 172.21.15.135:0/2519410330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c700094a0 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c7a7fc700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c0c6770 0x7f5c7c1451a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00c550 tx=0x7f5c6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c63fff700 1 -- 172.21.15.135:0/2519410330 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c004c80 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c63fff700 1 -- 172.21.15.135:0/2519410330 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c004e00 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c1ef840 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.287+0000 7f5c63fff700 1 -- 172.21.15.135:0/2519410330 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c007310 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.288+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c0c2a20 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.288+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c067fa0 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.289+0000 7f5c63fff700 1 -- 172.21.15.135:0/2519410330 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c6c007470 con 0x7f5c7c0c6770 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.289+0000 7f5c63fff700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5c6806ac90 0x7f5c6806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.289+0000 7f5c63fff700 1 -- 172.21.15.135:0/2519410330 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c6c088c50 con 0x7f5c7c0c6770 2024-05-08T20:54:56.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.289+0000 7f5c7affd700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5c6806ac90 0x7f5c6806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.290+0000 7f5c7affd700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5c6806ac90 0x7f5c6806d150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c700090b0 tx=0x7f5c7001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:56.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.294+0000 7f5c63fff700 1 -- 172.21.15.135:0/2519410330 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5c6c0540f0 con 0x7f5c7c0c6770 2024-05-08T20:54:56.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.536+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c7c156d50 con 0x7f5c7c0c6770 2024-05-08T20:54:56.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.536+0000 7f5c63fff700 1 -- 172.21.15.135:0/2519410330 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f5c6c057710 con 0x7f5c7c0c6770 2024-05-08T20:54:56.540 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:56.540 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4299,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-08T20:54:56.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5c6806ac90 msgr2=0x7f5c6806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5c6806ac90 0x7f5c6806d150 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c700090b0 tx=0x7f5c7001c040 comp rx=0 tx=0).stop 2024-05-08T20:54:56.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c0c6770 msgr2=0x7f5c7c1451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c0c6770 0x7f5c7c1451a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c00c550 tx=0x7f5c6c00c860 comp rx=0 tx=0).stop 2024-05-08T20:54:56.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 shutdown_connections 2024-05-08T20:54:56.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5c6806ac90 0x7f5c6806d150 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c7c072b50 0x7f5c7c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c7c1536d0 0x7f5c7c1456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 --2- 172.21.15.135:0/2519410330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c7c0c6770 0x7f5c7c1451a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 >> 172.21.15.135:0/2519410330 conn(0x7f5c7c06daf0 msgr2=0x7f5c7c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:56.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 shutdown_connections 2024-05-08T20:54:56.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.538+0000 7f5c81841700 1 -- 172.21.15.135:0/2519410330 wait complete. 2024-05-08T20:54:56.544 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 3 2024-05-08T20:54:56.554 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:54:56.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.673+0000 7fad97860700 1 Processor -- start 2024-05-08T20:54:56.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.673+0000 7fad97860700 1 -- start start 2024-05-08T20:54:56.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad97860700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad9006baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad97860700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fad900ca0e0 0x7fad900c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad97860700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad90159590 con 0x7fad900c9b50 2024-05-08T20:54:56.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad97860700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9006c350 con 0x7fad900ca0e0 2024-05-08T20:54:56.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad97860700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad90159850 con 0x7fad900ce380 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fad900ca0e0 0x7fad900c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fad900ca0e0 0x7fad900c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41468/0 (socket says 172.21.15.135:41468) 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 -- 172.21.15.135:0/978326216 learned_addr learned my addr 172.21.15.135:0/978326216 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad955fc700 1 --2- 172.21.15.135:0/978326216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad9006baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 -- 172.21.15.135:0/978326216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 msgr2=0x7fad9006baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 --2- 172.21.15.135:0/978326216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad9006baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 -- 172.21.15.135:0/978326216 >> v1:172.21.15.183:6789/0 conn(0x7fad900c9b50 legacy=0x7fad900cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 -- 172.21.15.135:0/978326216 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90159b30 con 0x7fad900ca0e0 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad94dfb700 1 --2- 172.21.15.135:0/978326216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900ca0e0 0x7fad900c9610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad800098f0 tx=0x7fad80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed612c8f57e8159c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad87fff700 1 -- 172.21.15.135:0/978326216 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80011830 con 0x7fad900ca0e0 2024-05-08T20:54:56.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad87fff700 1 -- 172.21.15.135:0/978326216 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80011990 con 0x7fad900ca0e0 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.674+0000 7fad87fff700 1 -- 172.21.15.135:0/978326216 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80011d20 con 0x7fad900ca0e0 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 -- 172.21.15.135:0/978326216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900ca0e0 msgr2=0x7fad900c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 --2- 172.21.15.135:0/978326216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900ca0e0 0x7fad900c9610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fad800098f0 tx=0x7fad80009c00 comp rx=0 tx=0).stop 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 -- 172.21.15.135:0/978326216 shutdown_connections 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 --2- 172.21.15.135:0/978326216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad9006baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 --2- 172.21.15.135:0/978326216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900ca0e0 0x7fad900c9610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 -- 172.21.15.135:0/978326216 >> 172.21.15.135:0/978326216 conn(0x7fad900cec90 msgr2=0x7fad900cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 -- 172.21.15.135:0/978326216 shutdown_connections 2024-05-08T20:54:56.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.675+0000 7fad97860700 1 -- 172.21.15.135:0/978326216 wait complete. 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.676+0000 7fad97860700 1 Processor -- start 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.676+0000 7fad97860700 1 -- start start 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad97860700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900c9b50 0x7fad901579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad97860700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad900ca0e0 0x7fad900b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad97860700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad901524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad97860700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad900b39e0 con 0x7fad900c9b50 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad97860700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad901f0020 con 0x7fad900ca0e0 2024-05-08T20:54:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad97860700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad901f02c0 con 0x7fad900ce380 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900c9b50 0x7fad901579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900c9b50 0x7fad901579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41480/0 (socket says 172.21.15.135:41480) 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 -- 172.21.15.135:0/159027956 learned_addr learned my addr 172.21.15.135:0/159027956 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad95dfd700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad901524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad94dfb700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad900ca0e0 0x7fad900b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 -- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 msgr2=0x7fad901524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad901524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 -- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad900ca0e0 msgr2=0x7fad900b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad900ca0e0 0x7fad900b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad955fc700 1 -- 172.21.15.135:0/159027956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80009550 con 0x7fad900c9b50 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.677+0000 7fad95dfd700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad901524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.678+0000 7fad955fc700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900c9b50 0x7fad901579a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e870 tx=0x7fad8c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.678+0000 7fad85ffb700 1 -- 172.21.15.135:0/159027956 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c009590 con 0x7fad900c9b50 2024-05-08T20:54:56.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.678+0000 7fad85ffb700 1 -- 172.21.15.135:0/159027956 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c013680 con 0x7fad900c9b50 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.678+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad900b3c30 con 0x7fad900c9b50 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.678+0000 7fad85ffb700 1 -- 172.21.15.135:0/159027956 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0139f0 con 0x7fad900c9b50 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.678+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad901529e0 con 0x7fad900c9b50 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.679+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad901571e0 con 0x7fad900c9b50 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.679+0000 7fad85ffb700 1 -- 172.21.15.135:0/159027956 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad8c013b50 con 0x7fad900c9b50 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.680+0000 7fad85ffb700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad7406ac90 0x7fad7406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.680+0000 7fad94dfb700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad7406ac90 0x7fad7406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.680+0000 7fad85ffb700 1 -- 172.21.15.135:0/159027956 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad8c089340 con 0x7fad900c9b50 2024-05-08T20:54:56.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.680+0000 7fad94dfb700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad7406ac90 0x7fad7406d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad80014040 tx=0x7fad80008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:56.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.684+0000 7fad85ffb700 1 -- 172.21.15.135:0/159027956 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fad8c0547d0 con 0x7fad900c9b50 2024-05-08T20:54:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.882+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad900c90a0 con 0x7fad900c9b50 2024-05-08T20:54:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.883+0000 7fad85ffb700 1 -- 172.21.15.135:0/159027956 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fad8c057df0 con 0x7fad900c9b50 2024-05-08T20:54:56.886 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:56.886 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:54:50.568536+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:54:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad7406ac90 msgr2=0x7fad7406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad7406ac90 0x7fad7406d150 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad80014040 tx=0x7fad80008030 comp rx=0 tx=0).stop 2024-05-08T20:54:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900c9b50 msgr2=0x7fad901579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900c9b50 0x7fad901579a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e870 tx=0x7fad8c00eb80 comp rx=0 tx=0).stop 2024-05-08T20:54:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 shutdown_connections 2024-05-08T20:54:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad7406ac90 0x7fad7406d150 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad900ce380 0x7fad901524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad900c9b50 0x7fad901579a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 --2- 172.21.15.135:0/159027956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad900ca0e0 0x7fad900b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 >> 172.21.15.135:0/159027956 conn(0x7fad900cec90 msgr2=0x7fad90153080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 shutdown_connections 2024-05-08T20:54:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:56.885+0000 7fad97860700 1 -- 172.21.15.135:0/159027956 wait complete. 2024-05-08T20:54:56.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:54:56.901 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:54:57.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.024+0000 7fa15ca47700 1 Processor -- start 2024-05-08T20:54:57.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.024+0000 7fa15ca47700 1 -- start start 2024-05-08T20:54:57.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.025+0000 7fa15ca47700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa158153270 0x7fa1580c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.025+0000 7fa15ca47700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa158159570 con 0x7fa158153650 2024-05-08T20:54:57.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.025+0000 7fa15ca47700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1581597c0 con 0x7fa1580c9da0 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.025+0000 7fa15ca47700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15815a160 con 0x7fa158153270 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15659c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa158153270 0x7fa1580c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa155d9b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa158153650 0x7fa158070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55318/0 (socket says 172.21.15.135:55318) 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa155d9b700 1 -- 172.21.15.135:0/2952461204 learned_addr learned my addr 172.21.15.135:0/2952461204 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15659c700 1 -- 172.21.15.135:0/2952461204 >> v1:172.21.15.183:6789/0 conn(0x7fa1580c9da0 legacy=0x7fa15815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15659c700 1 -- 172.21.15.135:0/2952461204 >> v1:172.21.15.135:6789/0 conn(0x7fa158153650 legacy=0x7fa158070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15659c700 1 -- 172.21.15.135:0/2952461204 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158159aa0 con 0x7fa158153270 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15659c700 1 --2- 172.21.15.135:0/2952461204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa158153270 0x7fa1580c9080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa148009840 tx=0x7fa148009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440f539a84378692 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15559a700 1 -- 172.21.15.135:0/2952461204 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148004230 con 0x7fa158153270 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15559a700 1 -- 172.21.15.135:0/2952461204 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148004390 con 0x7fa158153270 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.026+0000 7fa15559a700 1 -- 172.21.15.135:0/2952461204 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480036a0 con 0x7fa158153270 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.027+0000 7fa15ca47700 1 -- 172.21.15.135:0/2952461204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa158153270 msgr2=0x7fa1580c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.027+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2952461204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa158153270 0x7fa1580c9080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa148009840 tx=0x7fa148009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.027+0000 7fa15ca47700 1 -- 172.21.15.135:0/2952461204 shutdown_connections 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.027+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2952461204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa158153270 0x7fa1580c9080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.027+0000 7fa15ca47700 1 -- 172.21.15.135:0/2952461204 >> 172.21.15.135:0/2952461204 conn(0x7fa158066d70 msgr2=0x7fa15806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.027+0000 7fa15ca47700 1 -- 172.21.15.135:0/2952461204 shutdown_connections 2024-05-08T20:54:57.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.027+0000 7fa15ca47700 1 -- 172.21.15.135:0/2952461204 wait complete. 2024-05-08T20:54:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.028+0000 7fa15ca47700 1 Processor -- start 2024-05-08T20:54:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.028+0000 7fa15ca47700 1 -- start start 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15ca47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1580c9da0 0x7fa158148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15ca47700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa158153270 0x7fa1580cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15ca47700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158153650 0x7fa1580cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15ca47700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581ef7a0 con 0x7fa1580c9da0 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15ca47700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581ee930 con 0x7fa158153270 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15ca47700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581eeb20 con 0x7fa158153650 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1580c9da0 0x7fa158148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15659c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1580c9da0 0x7fa158148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41490/0 (socket says 172.21.15.135:41490) 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.029+0000 7fa15659c700 1 -- 172.21.15.135:0/2254728468 learned_addr learned my addr 172.21.15.135:0/2254728468 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa155d9b700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa158153270 0x7fa1580cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15659c700 1 -- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158153650 msgr2=0x7fa1580cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15659c700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158153650 0x7fa1580cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15659c700 1 -- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa158153270 msgr2=0x7fa1580cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15659c700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa158153270 0x7fa1580cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15659c700 1 -- 172.21.15.135:0/2254728468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480094a0 con 0x7fa1580c9da0 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa155d9b700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa158153270 0x7fa1580cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15659c700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1580c9da0 0x7fa158148670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1480090b0 tx=0x7fa148004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa14effd700 1 -- 172.21.15.135:0/2254728468 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148011830 con 0x7fa1580c9da0 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa14effd700 1 -- 172.21.15.135:0/2254728468 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14801e070 con 0x7fa1580c9da0 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa14effd700 1 -- 172.21.15.135:0/2254728468 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148011bf0 con 0x7fa1580c9da0 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1581eee00 con 0x7fa1580c9da0 2024-05-08T20:54:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.030+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1581ef3c0 con 0x7fa1580c9da0 2024-05-08T20:54:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.031+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa158067fa0 con 0x7fa1580c9da0 2024-05-08T20:54:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.031+0000 7fa14effd700 1 -- 172.21.15.135:0/2254728468 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa148011d50 con 0x7fa1580c9da0 2024-05-08T20:54:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.032+0000 7fa14effd700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa13806ac90 0x7fa13806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.032+0000 7fa14effd700 1 -- 172.21.15.135:0/2254728468 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa14808a3b0 con 0x7fa1580c9da0 2024-05-08T20:54:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.032+0000 7fa155d9b700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa13806ac90 0x7fa13806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.032+0000 7fa155d9b700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa13806ac90 0x7fa13806d150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa158148ec0 tx=0x7fa140009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.036+0000 7fa14effd700 1 -- 172.21.15.135:0/2254728468 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa1480558d0 con 0x7fa1580c9da0 2024-05-08T20:54:57.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.232+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa158149010 con 0x7fa1580c9da0 2024-05-08T20:54:57.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.232+0000 7fa14effd700 1 -- 172.21.15.135:0/2254728468 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1480200a0 con 0x7fa1580c9da0 2024-05-08T20:54:57.235 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T20:54:57.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa13806ac90 msgr2=0x7fa13806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa13806ac90 0x7fa13806d150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa158148ec0 tx=0x7fa140009040 comp rx=0 tx=0).stop 2024-05-08T20:54:57.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1580c9da0 msgr2=0x7fa158148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1580c9da0 0x7fa158148670 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1480090b0 tx=0x7fa148004750 comp rx=0 tx=0).stop 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 shutdown_connections 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa13806ac90 0x7fa13806d150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa158153650 0x7fa1580cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1580c9da0 0x7fa158148670 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 --2- 172.21.15.135:0/2254728468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa158153270 0x7fa1580cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 >> 172.21.15.135:0/2254728468 conn(0x7fa158066d70 msgr2=0x7fa158150e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 shutdown_connections 2024-05-08T20:54:57.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.234+0000 7fa15ca47700 1 -- 172.21.15.135:0/2254728468 wait complete. 2024-05-08T20:54:57.249 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T20:54:57.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.368+0000 7f6f50714700 1 Processor -- start 2024-05-08T20:54:57.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.368+0000 7f6f50714700 1 -- start start 2024-05-08T20:54:57.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.369+0000 7f6f50714700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6f480c47c0 0x7f6f48164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.369+0000 7f6f50714700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4815c990 con 0x7f6f480cbf50 2024-05-08T20:54:57.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.369+0000 7f6f50714700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4815cbc0 con 0x7f6f481535a0 2024-05-08T20:54:57.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.369+0000 7f6f50714700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4815ce60 con 0x7f6f480c47c0 2024-05-08T20:54:57.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4dcaf700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f6f480cbf50 0x7f6f480c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55326/0 (socket says 172.21.15.135:55326) 2024-05-08T20:54:57.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4dcaf700 1 -- 172.21.15.135:0/1295531606 learned_addr learned my addr 172.21.15.135:0/1295531606 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:57.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4ecb1700 1 --2- 172.21.15.135:0/1295531606 >> v2:172.21.15.183:3300/0 conn(0x7f6f480c47c0 0x7f6f48164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200664400 0 0) 0x7f6f4815c990 con 0x7f6f480cbf50 2024-05-08T20:54:57.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f340035b0 con 0x7f6f480cbf50 2024-05-08T20:54:57.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 759538959 0 0) 0x7f6f340035b0 con 0x7f6f480cbf50 2024-05-08T20:54:57.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 >> v2:172.21.15.183:3300/0 conn(0x7f6f480c47c0 msgr2=0x7f6f48164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:57.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 --2- 172.21.15.135:0/1295531606 >> v2:172.21.15.183:3300/0 conn(0x7f6f480c47c0 0x7f6f48164c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 >> v1:172.21.15.183:6789/0 conn(0x7f6f481535a0 legacy=0x7f6f4806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4815d140 con 0x7f6f480cbf50 2024-05-08T20:54:57.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f6f44001670 con 0x7f6f480cbf50 2024-05-08T20:54:57.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 >> v1:172.21.15.135:6789/0 conn(0x7f6f480cbf50 legacy=0x7f6f480c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f34003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f34004850 0x7f6f34004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f34005210 0x7f6f3400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4815ce60 con 0x7f6f34003a00 2024-05-08T20:54:57.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3400c0c0 con 0x7f6f34005210 2024-05-08T20:54:57.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3400c280 con 0x7f6f34004850 2024-05-08T20:54:57.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4e4b0700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f34003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4ecb1700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f34005210 0x7f6f3400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.370+0000 7f6f4dcaf700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f34004850 0x7f6f34004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4e4b0700 1 -- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f34004850 msgr2=0x7f6f34004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:57.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4e4b0700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f34004850 0x7f6f34004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4e4b0700 1 -- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f34005210 msgr2=0x7f6f3400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:57.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4e4b0700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f34005210 0x7f6f3400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4e4b0700 1 -- 172.21.15.135:0/1295531606 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340035b0 con 0x7f6f34003a00 2024-05-08T20:54:57.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4ecb1700 1 -- 172.21.15.135:0/1295531606 reap_dead start 2024-05-08T20:54:57.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4e4b0700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f34003e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0017c0 tx=0x7f6f34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5baa4a2ea4c06c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0052d0 con 0x7f6f34003a00 2024-05-08T20:54:57.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c005450 con 0x7f6f34003a00 2024-05-08T20:54:57.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f4d4ae700 1 -- 172.21.15.135:0/1295531606 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0038c0 con 0x7f6f34003a00 2024-05-08T20:54:57.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f50714700 1 -- 172.21.15.135:0/1295531606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 msgr2=0x7f6f34003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f50714700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f34003e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0017c0 tx=0x7f6f34005880 comp rx=0 tx=0).stop 2024-05-08T20:54:57.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f50714700 1 -- 172.21.15.135:0/1295531606 shutdown_connections 2024-05-08T20:54:57.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f50714700 1 --2- 172.21.15.135:0/1295531606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f34003e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f50714700 1 -- 172.21.15.135:0/1295531606 >> 172.21.15.135:0/1295531606 conn(0x7f6f4806daf0 msgr2=0x7f6f4806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:57.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f50714700 1 -- 172.21.15.135:0/1295531606 shutdown_connections 2024-05-08T20:54:57.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.371+0000 7f6f50714700 1 -- 172.21.15.135:0/1295531606 wait complete. 2024-05-08T20:54:57.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 Processor -- start 2024-05-08T20:54:57.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 -- start start 2024-05-08T20:54:57.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f481efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f480cb2d0 0x7f6f4814a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f4806abd0 0x7f6f481461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4814c020 con 0x7f6f34003a00 2024-05-08T20:54:57.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4814c300 con 0x7f6f4806abd0 2024-05-08T20:54:57.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f50714700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481ef1c0 con 0x7f6f480cb2d0 2024-05-08T20:54:57.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f4e4b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f481efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f4e4b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f481efca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41504/0 (socket says 172.21.15.135:41504) 2024-05-08T20:54:57.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.373+0000 7f6f4e4b0700 1 -- 172.21.15.135:0/20241370 learned_addr learned my addr 172.21.15.135:0/20241370 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:57.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4dcaf700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f480cb2d0 0x7f6f4814a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4ecb1700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f4806abd0 0x7f6f481461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4e4b0700 1 -- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f480cb2d0 msgr2=0x7f6f4814a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4e4b0700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f480cb2d0 0x7f6f4814a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4e4b0700 1 -- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f4806abd0 msgr2=0x7f6f481461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4e4b0700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f4806abd0 0x7f6f481461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4e4b0700 1 -- 172.21.15.135:0/20241370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f481ef4a0 con 0x7f6f34003a00 2024-05-08T20:54:57.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f4e4b0700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f481efca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c000c00 tx=0x7f6f3c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f3affd700 1 -- 172.21.15.135:0/20241370 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c001290 con 0x7f6f34003a00 2024-05-08T20:54:57.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f3affd700 1 -- 172.21.15.135:0/20241370 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c007040 con 0x7f6f34003a00 2024-05-08T20:54:57.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f481ef780 con 0x7f6f34003a00 2024-05-08T20:54:57.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f3affd700 1 -- 172.21.15.135:0/20241370 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0073f0 con 0x7f6f34003a00 2024-05-08T20:54:57.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.374+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4814e240 con 0x7f6f34003a00 2024-05-08T20:54:57.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.375+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f480cb6b0 con 0x7f6f34003a00 2024-05-08T20:54:57.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.375+0000 7f6f3affd700 1 -- 172.21.15.135:0/20241370 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f3c007550 con 0x7f6f34003a00 2024-05-08T20:54:57.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.376+0000 7f6f3affd700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6f2c06ac90 0x7f6f2c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.376+0000 7f6f4dcaf700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6f2c06ac90 0x7f6f2c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.376+0000 7f6f3affd700 1 -- 172.21.15.135:0/20241370 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f3c089a20 con 0x7f6f34003a00 2024-05-08T20:54:57.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.376+0000 7f6f4dcaf700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6f2c06ac90 0x7f6f2c06d150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f481ecce0 tx=0x7f6f44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.380+0000 7f6f3affd700 1 -- 172.21.15.135:0/20241370 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6f3c055100 con 0x7f6f34003a00 2024-05-08T20:54:57.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.581+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6f4804f180 con 0x7f6f34003a00 2024-05-08T20:54:57.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.581+0000 7f6f3affd700 1 -- 172.21.15.135:0/20241370 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6f3c017060 con 0x7f6f34003a00 2024-05-08T20:54:57.584 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:54:57.584 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-05-08T20:54:57.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-05-08T20:54:57.585 INFO:teuthology.orchestra.run.smithi135.stdout: "poolnum": 1, 2024-05-08T20:54:57.585 INFO:teuthology.orchestra.run.smithi135.stdout: "poolname": ".mgr" 2024-05-08T20:54:57.585 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T20:54:57.585 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6f2c06ac90 msgr2=0x7f6f2c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6f2c06ac90 0x7f6f2c06d150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f481ecce0 tx=0x7f6f44009040 comp rx=0 tx=0).stop 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 msgr2=0x7f6f481efca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f481efca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c000c00 tx=0x7f6f3c001120 comp rx=0 tx=0).stop 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 shutdown_connections 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6f2c06ac90 0x7f6f2c06d150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f4806abd0 0x7f6f481461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f34003a00 0x7f6f481efca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.583+0000 7f6f50714700 1 --2- 172.21.15.135:0/20241370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f480cb2d0 0x7f6f4814a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.584+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 >> 172.21.15.135:0/20241370 conn(0x7f6f4806daf0 msgr2=0x7f6f4806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:57.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.584+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 shutdown_connections 2024-05-08T20:54:57.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.584+0000 7f6f50714700 1 -- 172.21.15.135:0/20241370 wait complete. 2024-05-08T20:54:57.598 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T20:54:57.599 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T20:54:57.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.721+0000 7fb352d56700 1 Processor -- start 2024-05-08T20:54:57.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.721+0000 7fb352d56700 1 -- start start 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb352d56700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c157920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb352d56700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb34c157e60 0x7fb34c06f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb352d56700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c06ace0 con 0x7fb34c15a800 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb352d56700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c157210 con 0x7fb34c157e60 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb352d56700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c15acb0 con 0x7fb34c13ceb0 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb350af2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb3512f3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb34c157e60 0x7fb34c06f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb350af2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:52866/0 (socket says 172.21.15.135:52866) 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb3512f3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb34c157e60 0x7fb34c06f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:48366/0 (socket says 172.21.15.135:48366) 2024-05-08T20:54:57.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.722+0000 7fb350af2700 1 -- 172.21.15.135:0/1191237557 learned_addr learned my addr 172.21.15.135:0/1191237557 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb3512f3700 1 -- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 msgr2=0x7fb34c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb3512f3700 1 --2- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb3512f3700 1 -- 172.21.15.135:0/1191237557 >> v1:172.21.15.183:6789/0 conn(0x7fb34c15a800 legacy=0x7fb34c0c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb3512f3700 1 -- 172.21.15.135:0/1191237557 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c15af90 con 0x7fb34c157e60 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb350af2700 1 --2- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb3512f3700 1 --2- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c157e60 0x7fb34c06f390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5deab916c291ac95 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb34b7fe700 1 -- 172.21.15.135:0/1191237557 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400e070 con 0x7fb34c157e60 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb34b7fe700 1 -- 172.21.15.135:0/1191237557 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400bb20 con 0x7fb34c157e60 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb34b7fe700 1 -- 172.21.15.135:0/1191237557 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344012430 con 0x7fb34c157e60 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 -- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c157e60 msgr2=0x7fb34c06f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 --2- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c157e60 0x7fb34c06f390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb344009d90 tx=0x7fb34400b330 comp rx=0 tx=0).stop 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 -- 172.21.15.135:0/1191237557 shutdown_connections 2024-05-08T20:54:57.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 --2- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c157e60 0x7fb34c06f390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 --2- 172.21.15.135:0/1191237557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 -- 172.21.15.135:0/1191237557 >> 172.21.15.135:0/1191237557 conn(0x7fb34c06d620 msgr2=0x7fb34c06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:57.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 -- 172.21.15.135:0/1191237557 shutdown_connections 2024-05-08T20:54:57.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.723+0000 7fb352d56700 1 -- 172.21.15.135:0/1191237557 wait complete. 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 Processor -- start 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 -- start start 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c157e60 0x7fb34c14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c15a800 0x7fb34c1ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c1378d0 con 0x7fb34c157e60 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c138830 con 0x7fb34c15a800 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.725+0000 7fb352d56700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c1ed970 con 0x7fb34c13ceb0 2024-05-08T20:54:57.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c157e60 0x7fb34c14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c157e60 0x7fb34c14ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41518/0 (socket says 172.21.15.135:41518) 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 -- 172.21.15.135:0/1720120008 learned_addr learned my addr 172.21.15.135:0/1720120008 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb3512f3700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c15a800 0x7fb34c1ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb350af2700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 -- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 msgr2=0x7fb34c137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c137d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 -- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c15a800 msgr2=0x7fb34c1ecbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c15a800 0x7fb34c1ecbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 -- 172.21.15.135:0/1720120008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009550 con 0x7fb34c157e60 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb350af2700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c137d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb34bfff700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c157e60 0x7fb34c14ff80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c420 tx=0x7fb33800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb3497fa700 1 -- 172.21.15.135:0/1720120008 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380052d0 con 0x7fb34c157e60 2024-05-08T20:54:57.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb3497fa700 1 -- 172.21.15.135:0/1720120008 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb338005430 con 0x7fb34c157e60 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb3497fa700 1 -- 172.21.15.135:0/1720120008 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380038c0 con 0x7fb34c157e60 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb344009a70 con 0x7fb34c157e60 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.726+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c133670 con 0x7fb34c157e60 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.727+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c0c7120 con 0x7fb34c157e60 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.728+0000 7fb3497fa700 1 -- 172.21.15.135:0/1720120008 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb338003a20 con 0x7fb34c157e60 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.728+0000 7fb3497fa700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb33006ac90 0x7fb33006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.728+0000 7fb3497fa700 1 -- 172.21.15.135:0/1720120008 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb338088370 con 0x7fb34c157e60 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.728+0000 7fb350af2700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb33006ac90 0x7fb33006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:57.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.728+0000 7fb350af2700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb33006ac90 0x7fb33006d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb340009ce0 tx=0x7fb340008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:57.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.732+0000 7fb3497fa700 1 -- 172.21.15.135:0/1720120008 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb338053930 con 0x7fb34c157e60 2024-05-08T20:54:57.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:57.929+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb34c067fa0 con 0x7fb34c157e60 2024-05-08T20:54:58.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.598+0000 7fb3497fa700 1 -- 172.21.15.135:0/1720120008 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb338056f50 con 0x7fb34c157e60 2024-05-08T20:54:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.604+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb33006ac90 msgr2=0x7fb33006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.604+0000 7fb352d56700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb33006ac90 0x7fb33006d150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb340009ce0 tx=0x7fb340008040 comp rx=0 tx=0).stop 2024-05-08T20:54:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.604+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c157e60 msgr2=0x7fb34c14ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.604+0000 7fb352d56700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c157e60 0x7fb34c14ff80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb33800c420 tx=0x7fb33800c7e0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.605+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 shutdown_connections 2024-05-08T20:54:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.605+0000 7fb352d56700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb33006ac90 0x7fb33006d150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.605+0000 7fb352d56700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb34c15a800 0x7fb34c1ecbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.605+0000 7fb352d56700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb34c13ceb0 0x7fb34c137d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.605+0000 7fb352d56700 1 --2- 172.21.15.135:0/1720120008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb34c157e60 0x7fb34c14ff80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.605+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 >> 172.21.15.135:0/1720120008 conn(0x7fb34c06d620 msgr2=0x7fb34c13b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.606+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 shutdown_connections 2024-05-08T20:54:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.606+0000 7fb352d56700 1 -- 172.21.15.135:0/1720120008 wait complete. 2024-05-08T20:54:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' created 2024-05-08T20:54:58.623 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-08T20:54:58.645 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:58.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:54:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.757+0000 7fcae0a39700 1 Processor -- start 2024-05-08T20:54:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.757+0000 7fcae0a39700 1 -- start start 2024-05-08T20:54:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcae0a39700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 0x7fcadc0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcae0a39700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcadc072b80 0x7fcadc15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcae0a39700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc15ad20 con 0x7fcadc0c9740 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcae0a39700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0c86d0 con 0x7fcadc072b80 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcae0a39700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0ca690 con 0x7fcadc151480 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcadad9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fcadc0c9740 0x7fcadc0c4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55330/0 (socket says 172.21.15.135:55330) 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcadad9d700 1 -- 172.21.15.135:0/1655622061 learned_addr learned my addr 172.21.15.135:0/1655622061 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730562172 0 0) 0x7fcadc15ad20 con 0x7fcadc0c9740 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad9d9b700 1 --2- 172.21.15.135:0/1655622061 >> v2:172.21.15.183:3300/0 conn(0x7fcadc072b80 0x7fcadc15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcada59c700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 0x7fcadc0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac40035b0 con 0x7fcadc0c9740 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1460529283 0 0) 0x7fcac40035b0 con 0x7fcadc0c9740 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 msgr2=0x7fcadc0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 0x7fcadc0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 >> v2:172.21.15.183:3300/0 conn(0x7fcadc072b80 msgr2=0x7fcadc15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 --2- 172.21.15.135:0/1655622061 >> v2:172.21.15.183:3300/0 conn(0x7fcadc072b80 0x7fcadc15a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0ca0d0 con 0x7fcadc0c9740 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7fcad40019f0 con 0x7fcadc0c9740 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 >> v1:172.21.15.135:6789/0 conn(0x7fcadc0c9740 legacy=0x7fcadc0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac4003a00 0x7fcac4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 0x7fcac4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcac4004d90 0x7fcac4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c86d0 con 0x7fcac4003a00 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0ca690 con 0x7fcac4004d90 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.758+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac400ba10 con 0x7fcadc151480 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcada59c700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac4003a00 0x7fcac4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcad9d9b700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 0x7fcac4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcadad9d700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcac4004d90 0x7fcac4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcada59c700 1 -- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 msgr2=0x7fcac4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcada59c700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc151480 0x7fcac4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcada59c700 1 -- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcac4004d90 msgr2=0x7fcac4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcada59c700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcac4004d90 0x7fcac4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcada59c700 1 -- 172.21.15.135:0/1655622061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40035b0 con 0x7fcac4003a00 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcada59c700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac4003a00 0x7fcac4003e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009b60 tx=0x7fcac4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5d8a2adabe5134 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00e6c0 con 0x7fcac4003a00 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00e820 con 0x7fcac4003a00 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.759+0000 7fcad959a700 1 -- 172.21.15.135:0/1655622061 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00eb90 con 0x7fcac4003a00 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.760+0000 7fcae0a39700 1 -- 172.21.15.135:0/1655622061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac4003a00 msgr2=0x7fcac4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.760+0000 7fcae0a39700 1 --2- 172.21.15.135:0/1655622061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcac4003a00 0x7fcac4003e20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009b60 tx=0x7fcac4005880 comp rx=0 tx=0).stop 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.760+0000 7fcadad9d700 1 -- 172.21.15.135:0/1655622061 reap_dead start 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.760+0000 7fcae0a39700 1 -- 172.21.15.135:0/1655622061 shutdown_connections 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.760+0000 7fcae0a39700 1 -- 172.21.15.135:0/1655622061 >> 172.21.15.135:0/1655622061 conn(0x7fcadc06fac0 msgr2=0x7fcadc06fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.760+0000 7fcae0a39700 1 -- 172.21.15.135:0/1655622061 shutdown_connections 2024-05-08T20:54:58.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.760+0000 7fcae0a39700 1 -- 172.21.15.135:0/1655622061 wait complete. 2024-05-08T20:54:58.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.761+0000 7fcae0a39700 1 Processor -- start 2024-05-08T20:54:58.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.761+0000 7fcae0a39700 1 -- start start 2024-05-08T20:54:58.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcae0a39700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcac4003a00 0x7fcadc1eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcae0a39700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc14fd90 0x7fcadc159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcae0a39700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcadc158860 0x7fcadc1f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcae0a39700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c4e00 con 0x7fcadc158860 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcae0a39700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc1f2f10 con 0x7fcadc14fd90 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcae0a39700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c3fb0 con 0x7fcac4003a00 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcadc158860 0x7fcadc1f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcada59c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcac4003a00 0x7fcadc1eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcadc158860 0x7fcadc1f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41546/0 (socket says 172.21.15.135:41546) 2024-05-08T20:54:58.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 -- 172.21.15.135:0/2270069203 learned_addr learned my addr 172.21.15.135:0/2270069203 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcad9d9b700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc14fd90 0x7fcadc159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 -- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcac4003a00 msgr2=0x7fcadc1eeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcac4003a00 0x7fcadc1eeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 -- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc14fd90 msgr2=0x7fcadc159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc14fd90 0x7fcadc159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 -- 172.21.15.135:0/2270069203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0c4250 con 0x7fcadc158860 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcada59c700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcac4003a00 0x7fcadc1eeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcadad9d700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcadc158860 0x7fcadc1f29d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcadc06d640 tx=0x7fcad400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcacaffd700 1 -- 172.21.15.135:0/2270069203 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400ad30 con 0x7fcadc158860 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcacaffd700 1 -- 172.21.15.135:0/2270069203 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400ae90 con 0x7fcadc158860 2024-05-08T20:54:58.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0c4840 con 0x7fcadc158860 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.762+0000 7fcacaffd700 1 -- 172.21.15.135:0/2270069203 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4013630 con 0x7fcadc158860 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.763+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc0c4530 con 0x7fcadc158860 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.764+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc067fa0 con 0x7fcadc158860 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.764+0000 7fcacaffd700 1 -- 172.21.15.135:0/2270069203 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcad4013790 con 0x7fcadc158860 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.765+0000 7fcacaffd700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcabc06ac90 0x7fcabc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.765+0000 7fcada59c700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcabc06ac90 0x7fcabc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.765+0000 7fcacaffd700 1 -- 172.21.15.135:0/2270069203 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fcad4089b00 con 0x7fcadc158860 2024-05-08T20:54:58.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.765+0000 7fcada59c700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcabc06ac90 0x7fcabc06d150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0090b0 tx=0x7fcacc01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:58.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.769+0000 7fcacaffd700 1 -- 172.21.15.135:0/2270069203 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcad4054f50 con 0x7fcadc158860 2024-05-08T20:54:58.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:58.970+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fcadc154e40 con 0x7fcadc158860 2024-05-08T20:54:59.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.608+0000 7fcacaffd700 1 -- 172.21.15.135:0/2270069203 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fcad4017070 con 0x7fcadc158860 2024-05-08T20:54:59.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcabc06ac90 msgr2=0x7fcabc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:59.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcabc06ac90 0x7fcabc06d150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0090b0 tx=0x7fcacc01f040 comp rx=0 tx=0).stop 2024-05-08T20:54:59.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcadc158860 msgr2=0x7fcadc1f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:59.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcadc158860 0x7fcadc1f29d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcadc06d640 tx=0x7fcad400a640 comp rx=0 tx=0).stop 2024-05-08T20:54:59.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 shutdown_connections 2024-05-08T20:54:59.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcabc06ac90 0x7fcabc06d150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcadc158860 0x7fcadc1f29d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcac4003a00 0x7fcadc1eeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 --2- 172.21.15.135:0/2270069203 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc14fd90 0x7fcadc159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.614+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 >> 172.21.15.135:0/2270069203 conn(0x7fcadc06fac0 msgr2=0x7fcadc14e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:59.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.615+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 shutdown_connections 2024-05-08T20:54:59.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.615+0000 7fcae0a39700 1 -- 172.21.15.135:0/2270069203 wait complete. 2024-05-08T20:54:59.622 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' created 2024-05-08T20:54:59.641 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T20:54:59.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.811+0000 7f50a8109700 1 Processor -- start 2024-05-08T20:54:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.811+0000 7f50a8109700 1 -- start start 2024-05-08T20:54:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a8109700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a0072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a8109700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50a00c6600 0x7f50a00c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a8109700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a01508a0 con 0x7f50a01504c0 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a8109700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00c2de0 con 0x7f50a00c6600 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a8109700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0159d80 con 0x7f50a00c51e0 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a5ea5700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f50a01504c0 0x7f50a0159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:55344/0 (socket says 172.21.15.135:55344) 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a5ea5700 1 -- 172.21.15.135:0/1281327660 learned_addr learned my addr 172.21.15.135:0/1281327660 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a56a4700 1 --2- 172.21.15.135:0/1281327660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a0072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a66a6700 1 --2- 172.21.15.135:0/1281327660 >> v2:172.21.15.183:3300/0 conn(0x7f50a00c6600 0x7f50a00c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a4ea3700 1 -- 172.21.15.135:0/1281327660 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484716489 0 0) 0x7f50a01508a0 con 0x7f50a01504c0 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a4ea3700 1 -- 172.21.15.135:0/1281327660 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f508c0035b0 con 0x7f50a01504c0 2024-05-08T20:54:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a4ea3700 1 -- 172.21.15.135:0/1281327660 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 499111323 0 0) 0x7f508c0035b0 con 0x7f50a01504c0 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a56a4700 1 -- 172.21.15.135:0/1281327660 >> v2:172.21.15.183:3300/0 conn(0x7f50a00c6600 msgr2=0x7f50a00c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a56a4700 1 --2- 172.21.15.135:0/1281327660 >> v2:172.21.15.183:3300/0 conn(0x7f50a00c6600 0x7f50a00c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a56a4700 1 -- 172.21.15.135:0/1281327660 >> v1:172.21.15.135:6789/0 conn(0x7f50a01504c0 legacy=0x7f50a0159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a56a4700 1 -- 172.21.15.135:0/1281327660 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00c5940 con 0x7f50a00c51e0 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.812+0000 7f50a66a6700 1 --2- 172.21.15.135:0/1281327660 >> v2:172.21.15.183:3300/0 conn(0x7f50a00c6600 0x7f50a00c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a56a4700 1 --2- 172.21.15.135:0/1281327660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a0072730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f509c009840 tx=0x7f509c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7ab8d4b40e6f1db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a4ea3700 1 -- 172.21.15.135:0/1281327660 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090001670 con 0x7f50a00c51e0 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a4ea3700 1 -- 172.21.15.135:0/1281327660 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c004030 con 0x7f50a00c51e0 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a4ea3700 1 -- 172.21.15.135:0/1281327660 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c0043c0 con 0x7f50a00c51e0 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 -- 172.21.15.135:0/1281327660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 msgr2=0x7f50a0072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 --2- 172.21.15.135:0/1281327660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a0072730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f509c009840 tx=0x7f509c009b50 comp rx=0 tx=0).stop 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 -- 172.21.15.135:0/1281327660 shutdown_connections 2024-05-08T20:54:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 --2- 172.21.15.135:0/1281327660 >> v2:172.21.15.183:3300/0 conn(0x7f50a00c6600 0x7f50a00c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 --2- 172.21.15.135:0/1281327660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a0072730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 -- 172.21.15.135:0/1281327660 >> 172.21.15.135:0/1281327660 conn(0x7f50a006daf0 msgr2=0x7f50a006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:54:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 -- 172.21.15.135:0/1281327660 shutdown_connections 2024-05-08T20:54:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.813+0000 7f50a8109700 1 -- 172.21.15.135:0/1281327660 wait complete. 2024-05-08T20:54:59.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.815+0000 7f50a8109700 1 Processor -- start 2024-05-08T20:54:59.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.815+0000 7f50a8109700 1 -- start start 2024-05-08T20:54:59.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a8109700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a01447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:59.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a8109700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50a00c6600 0x7f50a0142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:59.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a8109700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a01504c0 0x7f50a0142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:59.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a8109700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01ef0a0 con 0x7f50a01504c0 2024-05-08T20:54:59.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a8109700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0145090 con 0x7f50a00c6600 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a8109700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01ef2d0 con 0x7f50a00c51e0 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a01504c0 0x7f50a0142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a01504c0 0x7f50a0142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41556/0 (socket says 172.21.15.135:41556) 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 -- 172.21.15.135:0/1751605287 learned_addr learned my addr 172.21.15.135:0/1751605287 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a56a4700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50a00c6600 0x7f50a0142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a5ea5700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a01447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 -- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 msgr2=0x7f50a01447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a01447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 -- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50a00c6600 msgr2=0x7f50a0142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:54:59.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50a00c6600 0x7f50a0142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 -- 172.21.15.135:0/1751605287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098009a70 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50a66a6700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a01504c0 0x7f50a0142890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f509800efc0 tx=0x7f509800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50967fc700 1 -- 172.21.15.135:0/1751605287 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509800cb40 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50967fc700 1 -- 172.21.15.135:0/1751605287 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509800f040 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.816+0000 7f50967fc700 1 -- 172.21.15.135:0/1751605287 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098003a20 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.817+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c0094a0 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.817+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a01ef890 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.817+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a0067fa0 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.818+0000 7f50967fc700 1 -- 172.21.15.135:0/1751605287 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5098014480 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.818+0000 7f50967fc700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f508406ac90 0x7f508406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.818+0000 7f50967fc700 1 -- 172.21.15.135:0/1751605287 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5098089d60 con 0x7f50a01504c0 2024-05-08T20:54:59.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.818+0000 7f50a5ea5700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f508406ac90 0x7f508406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:54:59.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.819+0000 7f50a5ea5700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f508406ac90 0x7f508406d150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5090001eb0 tx=0x7f5090001c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:54:59.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:54:59.823+0000 7f50967fc700 1 -- 172.21.15.135:0/1751605287 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5098054e70 con 0x7f50a01504c0 2024-05-08T20:55:00.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.064+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f50a004ec60 con 0x7f50a01504c0 2024-05-08T20:55:00.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.075+0000 7f50967fc700 1 -- 172.21.15.135:0/1751605287 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5098018020 con 0x7f50a01504c0 2024-05-08T20:55:00.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.084+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f508406ac90 msgr2=0x7f508406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.084+0000 7f50a8109700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f508406ac90 0x7f508406d150 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5090001eb0 tx=0x7f5090001c40 comp rx=0 tx=0).stop 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.084+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a01504c0 msgr2=0x7f50a0142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.084+0000 7f50a8109700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a01504c0 0x7f50a0142890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f509800efc0 tx=0x7f509800c3a0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.085+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 shutdown_connections 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.085+0000 7f50a8109700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f508406ac90 0x7f508406d150 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.085+0000 7f50a8109700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50a01504c0 0x7f50a0142890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.085+0000 7f50a8109700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50a00c51e0 0x7f50a01447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.085+0000 7f50a8109700 1 --2- 172.21.15.135:0/1751605287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50a00c6600 0x7f50a0142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.085+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 >> 172.21.15.135:0/1751605287 conn(0x7f50a006daf0 msgr2=0x7f50a00725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:00.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.085+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 shutdown_connections 2024-05-08T20:55:00.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.086+0000 7f50a8109700 1 -- 172.21.15.135:0/1751605287 wait complete. 2024-05-08T20:55:00.095 INFO:teuthology.orchestra.run.smithi135.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T20:55:00.107 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-08T20:55:00.107 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-08T20:55:00.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.232+0000 7fc1502ec700 1 Processor -- start 2024-05-08T20:55:00.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.232+0000 7fc1502ec700 1 -- start start 2024-05-08T20:55:00.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc1502ec700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1480cbf50 0x7fc1480c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc1502ec700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc148072ae0 0x7fc1480c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc1502ec700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14815c990 con 0x7fc1481535a0 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc1502ec700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14815cbc0 con 0x7fc1480cbf50 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc1502ec700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14815ce60 con 0x7fc148072ae0 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1480cbf50 0x7fc1480c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc1480cbf50 0x7fc1480c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41568/0 (socket says 172.21.15.135:41568) 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 -- 172.21.15.135:0/2913635304 learned_addr learned my addr 172.21.15.135:0/2913635304 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 -- 172.21.15.135:0/2913635304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc148072ae0 msgr2=0x7fc1480c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 --2- 172.21.15.135:0/2913635304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc148072ae0 0x7fc1480c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 -- 172.21.15.135:0/2913635304 >> v1:172.21.15.183:6789/0 conn(0x7fc1481535a0 legacy=0x7fc14806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 -- 172.21.15.135:0/2913635304 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14815d140 con 0x7fc1480cbf50 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.233+0000 7fc14d887700 1 --2- 172.21.15.135:0/2913635304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1480cbf50 0x7fc1480c40b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1440098f0 tx=0x7fc144009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854efb9b7397a1bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc14d086700 1 -- 172.21.15.135:0/2913635304 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc144004230 con 0x7fc1480cbf50 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc14d086700 1 -- 172.21.15.135:0/2913635304 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc144004390 con 0x7fc1480cbf50 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc14d086700 1 -- 172.21.15.135:0/2913635304 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440036a0 con 0x7fc1480cbf50 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 -- 172.21.15.135:0/2913635304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1480cbf50 msgr2=0x7fc1480c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2913635304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1480cbf50 0x7fc1480c40b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1440098f0 tx=0x7fc144009c00 comp rx=0 tx=0).stop 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 -- 172.21.15.135:0/2913635304 shutdown_connections 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2913635304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc148072ae0 0x7fc1480c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2913635304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1480cbf50 0x7fc1480c40b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 -- 172.21.15.135:0/2913635304 >> 172.21.15.135:0/2913635304 conn(0x7fc14806daf0 msgr2=0x7fc14806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:00.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 -- 172.21.15.135:0/2913635304 shutdown_connections 2024-05-08T20:55:00.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.234+0000 7fc1502ec700 1 -- 172.21.15.135:0/2913635304 wait complete. 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.235+0000 7fc1502ec700 1 Processor -- start 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.235+0000 7fc1502ec700 1 -- start start 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc1502ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148072ae0 0x7fc1481f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc1502ec700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1480cbf50 0x7fc1481eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc1502ec700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1481535a0 0x7fc1480cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc1502ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1481f29e0 con 0x7fc148072ae0 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc1502ec700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1481e3540 con 0x7fc1481535a0 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc1502ec700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1481e2a90 con 0x7fc1480cbf50 2024-05-08T20:55:00.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc14e088700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148072ae0 0x7fc1481f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc14e088700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148072ae0 0x7fc1481f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41572/0 (socket says 172.21.15.135:41572) 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc14e088700 1 -- 172.21.15.135:0/2419211073 learned_addr learned my addr 172.21.15.135:0/2419211073 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc14d887700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1480cbf50 0x7fc1481eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.236+0000 7fc14e889700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1481535a0 0x7fc1480cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc14e088700 1 -- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1480cbf50 msgr2=0x7fc1481eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc14e088700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1480cbf50 0x7fc1481eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc14e088700 1 -- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1481535a0 msgr2=0x7fc1480cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc14e088700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1481535a0 0x7fc1480cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc14e088700 1 -- 172.21.15.135:0/2419211073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144009550 con 0x7fc148072ae0 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc14e088700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148072ae0 0x7fc1481f2e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc13800b4a0 tx=0x7fc13800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:00.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc13effd700 1 -- 172.21.15.135:0/2419211073 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138011830 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc13effd700 1 -- 172.21.15.135:0/2419211073 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138011990 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1481e2d70 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc13effd700 1 -- 172.21.15.135:0/2419211073 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc138011d40 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.237+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1481f2600 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.238+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1481f2b20 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.238+0000 7fc13effd700 1 -- 172.21.15.135:0/2419211073 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc13801a400 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.239+0000 7fc13effd700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc12c06acc0 0x7fc12c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.239+0000 7fc13effd700 1 -- 172.21.15.135:0/2419211073 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc138088ec0 con 0x7fc148072ae0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.239+0000 7fc14d887700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc12c06acc0 0x7fc12c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:00.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.239+0000 7fc14d887700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc12c06acc0 0x7fc12c06d180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc144009130 tx=0x7fc144008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:00.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.243+0000 7fc13effd700 1 -- 172.21.15.135:0/2419211073 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc138054130 con 0x7fc148072ae0 2024-05-08T20:55:00.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:00.451+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc148067fa0 con 0x7fc148072ae0 2024-05-08T20:55:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.072+0000 7fc13effd700 1 -- 172.21.15.135:0/2419211073 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc1380150e0 con 0x7fc148072ae0 2024-05-08T20:55:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc12c06acc0 msgr2=0x7fc12c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc12c06acc0 0x7fc12c06d180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc144009130 tx=0x7fc144008030 comp rx=0 tx=0).stop 2024-05-08T20:55:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148072ae0 msgr2=0x7fc1481f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148072ae0 0x7fc1481f2e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc13800b4a0 tx=0x7fc13800b7b0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 shutdown_connections 2024-05-08T20:55:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc12c06acc0 0x7fc12c06d180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1481535a0 0x7fc1480cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc148072ae0 0x7fc1481f2e00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 --2- 172.21.15.135:0/2419211073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1480cbf50 0x7fc1481eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 >> 172.21.15.135:0/2419211073 conn(0x7fc14806daf0 msgr2=0x7fc148151280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 shutdown_connections 2024-05-08T20:55:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.075+0000 7fc1502ec700 1 -- 172.21.15.135:0/2419211073 wait complete. 2024-05-08T20:55:01.092 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T20:55:01.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.223+0000 7f61282ec700 1 Processor -- start 2024-05-08T20:55:01.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.223+0000 7f61282ec700 1 -- start start 2024-05-08T20:55:01.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f61282ec700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6120153680 0x7f61200c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:01.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f61282ec700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f61200c9180 0x7f612006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:01.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f61282ec700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612015a460 con 0x7f612006f1f0 2024-05-08T20:55:01.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f61282ec700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612006f600 con 0x7f61200c9180 2024-05-08T20:55:01.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f61282ec700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61201598e0 con 0x7f6120153680 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6126088700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6120153680 0x7f61200c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6125887700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f61200c9180 0x7f612006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6126088700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6120153680 0x7f61200c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:52956/0 (socket says 172.21.15.135:52956) 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6125887700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f61200c9180 0x7f612006ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:48446/0 (socket says 172.21.15.135:48446) 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6126088700 1 -- 172.21.15.135:0/1176664206 learned_addr learned my addr 172.21.15.135:0/1176664206 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6125887700 1 -- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6120153680 msgr2=0x7f61200c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6125887700 1 --2- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6120153680 0x7f61200c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6125887700 1 -- 172.21.15.135:0/1176664206 >> v1:172.21.15.183:6789/0 conn(0x7f612006f1f0 legacy=0x7f612015d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:01.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.224+0000 7f6125887700 1 -- 172.21.15.135:0/1176664206 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120159bc0 con 0x7f61200c9180 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f6126088700 1 --2- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6120153680 0x7f61200c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f6125887700 1 --2- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61200c9180 0x7f612006ecb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6110009840 tx=0x7f6110009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d16bb2fca5bc59ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f6125086700 1 -- 172.21.15.135:0/1176664206 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110011830 con 0x7f61200c9180 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f6125086700 1 -- 172.21.15.135:0/1176664206 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110011990 con 0x7f61200c9180 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f6125086700 1 -- 172.21.15.135:0/1176664206 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110011d20 con 0x7f61200c9180 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f61282ec700 1 -- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61200c9180 msgr2=0x7f612006ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f61282ec700 1 --2- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61200c9180 0x7f612006ecb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6110009840 tx=0x7f6110009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f61282ec700 1 -- 172.21.15.135:0/1176664206 shutdown_connections 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f61282ec700 1 --2- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6120153680 0x7f61200c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f61282ec700 1 --2- 172.21.15.135:0/1176664206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61200c9180 0x7f612006ecb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.225+0000 7f61282ec700 1 -- 172.21.15.135:0/1176664206 >> 172.21.15.135:0/1176664206 conn(0x7f612006a960 msgr2=0x7f612006ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:01.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.226+0000 7f61282ec700 1 -- 172.21.15.135:0/1176664206 shutdown_connections 2024-05-08T20:55:01.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.226+0000 7f61282ec700 1 -- 172.21.15.135:0/1176664206 wait complete. 2024-05-08T20:55:01.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 Processor -- start 2024-05-08T20:55:01.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 -- start start 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612006f1f0 0x7f61201f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200c9180 0x7f61201f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6120153680 0x7f61201f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200cb9b0 con 0x7f612006f1f0 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200cd080 con 0x7f6120153680 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.227+0000 7f61282ec700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61200c8ec0 con 0x7f61200c9180 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612006f1f0 0x7f61201f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:01.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612006f1f0 0x7f61201f04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41578/0 (socket says 172.21.15.135:41578) 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 -- 172.21.15.135:0/3430601809 learned_addr learned my addr 172.21.15.135:0/3430601809 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126889700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6120153680 0x7f61201f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6125887700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200c9180 0x7f61201f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 -- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200c9180 msgr2=0x7f61201f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200c9180 0x7f61201f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 -- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6120153680 msgr2=0x7f61201f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6120153680 0x7f61201f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 -- 172.21.15.135:0/3430601809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c009550 con 0x7f612006f1f0 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6126088700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612006f1f0 0x7f61201f04a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f611c00ebe0 tx=0x7f611c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6116ffd700 1 -- 172.21.15.135:0/3430601809 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00c850 con 0x7f612006f1f0 2024-05-08T20:55:01.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6116ffd700 1 -- 172.21.15.135:0/3430601809 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00c9b0 con 0x7f612006f1f0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f6116ffd700 1 -- 172.21.15.135:0/3430601809 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00cd40 con 0x7f612006f1f0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61100094a0 con 0x7f612006f1f0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.228+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61201f3310 con 0x7f612006f1f0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.229+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6120067fa0 con 0x7f612006f1f0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.230+0000 7f6116ffd700 1 -- 172.21.15.135:0/3430601809 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f611c013470 con 0x7f612006f1f0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.230+0000 7f6116ffd700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f610406ac90 0x7f610406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.230+0000 7f6125887700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f610406ac90 0x7f610406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.230+0000 7f6116ffd700 1 -- 172.21.15.135:0/3430601809 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f611c089860 con 0x7f612006f1f0 2024-05-08T20:55:01.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.231+0000 7f6125887700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f610406ac90 0x7f610406d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6110000c00 tx=0x7f611001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:01.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.235+0000 7f6116ffd700 1 -- 172.21.15.135:0/3430601809 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f611c0549f0 con 0x7f612006f1f0 2024-05-08T20:55:01.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:01.432+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f61200c2930 con 0x7f612006f1f0 2024-05-08T20:55:03.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.084+0000 7f6116ffd700 1 -- 172.21.15.135:0/3430601809 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f611c017100 con 0x7f612006f1f0 2024-05-08T20:55:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f610406ac90 msgr2=0x7f610406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f610406ac90 0x7f610406d150 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6110000c00 tx=0x7f611001c040 comp rx=0 tx=0).stop 2024-05-08T20:55:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612006f1f0 msgr2=0x7f61201f04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612006f1f0 0x7f61201f04a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f611c00ebe0 tx=0x7f611c00eef0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 shutdown_connections 2024-05-08T20:55:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f610406ac90 0x7f610406d150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6120153680 0x7f61201f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f612006f1f0 0x7f61201f04a0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f611c00ebe0 tx=0x7f611c00eef0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 --2- 172.21.15.135:0/3430601809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61200c9180 0x7f61201f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.089+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 >> 172.21.15.135:0/3430601809 conn(0x7f612006a960 msgr2=0x7f61200c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.091+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 shutdown_connections 2024-05-08T20:55:03.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.091+0000 7f61282ec700 1 -- 172.21.15.135:0/3430601809 wait complete. 2024-05-08T20:55:03.100 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data_ec' created 2024-05-08T20:55:03.114 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-08T20:55:03.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.242+0000 7faa6bb26700 1 Processor -- start 2024-05-08T20:55:03.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.242+0000 7faa6bb26700 1 -- start start 2024-05-08T20:55:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa6bb26700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faa6406f930 0x7faa6406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa6bb26700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa640c3c10 con 0x7faa64153030 2024-05-08T20:55:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa6bb26700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa64159c70 con 0x7faa6406f550 2024-05-08T20:55:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa6bb26700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa64159f50 con 0x7faa6406f930 2024-05-08T20:55:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa6a0c3700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7faa64153030 0x7faa640c4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:47942/0 (socket says 172.21.15.135:47942) 2024-05-08T20:55:03.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa6a0c3700 1 -- 172.21.15.135:0/2618031750 learned_addr learned my addr 172.21.15.135:0/2618031750 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525639884 0 0) 0x7faa640c3c10 con 0x7faa64153030 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa500035b0 con 0x7faa64153030 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa690c1700 1 --2- 172.21.15.135:0/2618031750 >> v2:172.21.15.183:3300/0 conn(0x7faa6406f930 0x7faa6406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669164359 0 0) 0x7faa500035b0 con 0x7faa64153030 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 >> v2:172.21.15.183:3300/0 conn(0x7faa6406f930 msgr2=0x7faa6406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 --2- 172.21.15.135:0/2618031750 >> v2:172.21.15.183:3300/0 conn(0x7faa6406f930 0x7faa6406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 >> v1:172.21.15.183:6789/0 conn(0x7faa6406f550 legacy=0x7faa64159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6415a230 con 0x7faa64153030 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.243+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7faa5c0019f0 con 0x7faa64153030 2024-05-08T20:55:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 >> v1:172.21.15.135:6789/0 conn(0x7faa64153030 legacy=0x7faa640c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50003a00 0x7faa50003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa50004850 0x7faa50004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50005210 0x7faa5000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64159f50 con 0x7faa50005210 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5000c0f0 con 0x7faa50003a00 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5000c2b0 con 0x7faa50004850 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50005210 0x7faa5000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa698c2700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50003a00 0x7faa50003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa690c1700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa50004850 0x7faa50004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 -- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa50004850 msgr2=0x7faa50004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:03.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa50004850 0x7faa50004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 -- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50003a00 msgr2=0x7faa50003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50003a00 0x7faa50003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 -- 172.21.15.135:0/2618031750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500035b0 con 0x7faa50005210 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa690c1700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa50004850 0x7faa50004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 -- 172.21.15.135:0/2618031750 reap_dead start 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa6a0c3700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50005210 0x7faa5000ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00a920 tx=0x7faa50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d1804ec138937b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00a360 con 0x7faa50005210 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c012640 con 0x7faa50005210 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.244+0000 7faa688c0700 1 -- 172.21.15.135:0/2618031750 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c0129f0 con 0x7faa50005210 2024-05-08T20:55:03.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.245+0000 7faa6bb26700 1 -- 172.21.15.135:0/2618031750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50005210 msgr2=0x7faa5000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.245+0000 7faa6bb26700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50005210 0x7faa5000ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00a920 tx=0x7faa50005880 comp rx=0 tx=0).stop 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.245+0000 7faa6bb26700 1 -- 172.21.15.135:0/2618031750 shutdown_connections 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.245+0000 7faa6bb26700 1 --2- 172.21.15.135:0/2618031750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa50005210 0x7faa5000ba10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.245+0000 7faa6bb26700 1 -- 172.21.15.135:0/2618031750 >> 172.21.15.135:0/2618031750 conn(0x7faa6406d620 msgr2=0x7faa6406da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.245+0000 7faa6bb26700 1 -- 172.21.15.135:0/2618031750 shutdown_connections 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.245+0000 7faa6bb26700 1 -- 172.21.15.135:0/2618031750 wait complete. 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.246+0000 7faa6bb26700 1 Processor -- start 2024-05-08T20:55:03.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.246+0000 7faa6bb26700 1 -- start start 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6bb26700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50005210 0x7faa641df500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6bb26700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64157720 0x7faa641ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6bb26700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa641f2cc0 0x7faa641e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6bb26700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64155ee0 con 0x7faa64157720 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6bb26700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64157bb0 con 0x7faa50005210 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6bb26700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64157e90 con 0x7faa641f2cc0 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64157720 0x7faa641ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64157720 0x7faa641ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50326/0 (socket says 172.21.15.135:50326) 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 -- 172.21.15.135:0/3669535699 learned_addr learned my addr 172.21.15.135:0/3669535699 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa698c2700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50005210 0x7faa641df500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6a0c3700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa641f2cc0 0x7faa641e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 -- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa641f2cc0 msgr2=0x7faa641e5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa641f2cc0 0x7faa641e5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 -- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50005210 msgr2=0x7faa641df500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50005210 0x7faa641df500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 -- 172.21.15.135:0/3669535699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64158170 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa690c1700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64157720 0x7faa641ef850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faa54010890 tx=0x7faa54010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa5a7fc700 1 -- 172.21.15.135:0/3669535699 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54015680 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa5a7fc700 1 -- 172.21.15.135:0/3669535699 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5400c050 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.247+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa641ef050 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.248+0000 7faa5a7fc700 1 -- 172.21.15.135:0/3669535699 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54015a20 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.248+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa641587e0 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.248+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa641ef570 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.249+0000 7faa5a7fc700 1 -- 172.21.15.135:0/3669535699 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa54015b80 con 0x7faa64157720 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.249+0000 7faa5a7fc700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa4806ac90 0x7faa4806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.249+0000 7faa5a7fc700 1 -- 172.21.15.135:0/3669535699 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7faa54089a20 con 0x7faa64157720 2024-05-08T20:55:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.249+0000 7faa698c2700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa4806ac90 0x7faa4806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.250+0000 7faa698c2700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa4806ac90 0x7faa4806d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa60007fd0 tx=0x7faa60007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.254+0000 7faa5a7fc700 1 -- 172.21.15.135:0/3669535699 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faa641ef570 con 0x7faa64157720 2024-05-08T20:55:03.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:03.448+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7faa641ef570 con 0x7faa64157720 2024-05-08T20:55:04.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.090+0000 7faa5a7fc700 1 -- 172.21.15.135:0/3669535699 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7faa641ef570 con 0x7faa64157720 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.097+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa4806ac90 msgr2=0x7faa4806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.097+0000 7faa6bb26700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa4806ac90 0x7faa4806d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa60007fd0 tx=0x7faa60007d50 comp rx=0 tx=0).stop 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.097+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64157720 msgr2=0x7faa641ef850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.097+0000 7faa6bb26700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64157720 0x7faa641ef850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faa54010890 tx=0x7faa54010ba0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.098+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 shutdown_connections 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.098+0000 7faa6bb26700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa4806ac90 0x7faa4806d150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.098+0000 7faa6bb26700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa50005210 0x7faa641df500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.098+0000 7faa6bb26700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa641f2cc0 0x7faa641e5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.098+0000 7faa6bb26700 1 --2- 172.21.15.135:0/3669535699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa64157720 0x7faa641ef850 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faa54010890 tx=0x7faa54010ba0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.098+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 >> 172.21.15.135:0/3669535699 conn(0x7faa6406d620 msgr2=0x7faa640c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:04.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.100+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 shutdown_connections 2024-05-08T20:55:04.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.100+0000 7faa6bb26700 1 -- 172.21.15.135:0/3669535699 wait complete. 2024-05-08T20:55:04.108 INFO:teuthology.orchestra.run.smithi135.stderr:set pool 4 allow_ec_overwrites to true 2024-05-08T20:55:04.125 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-08T20:55:04.144 INFO:tasks.ceph.mds.f.smithi183.stderr:2024-05-08T20:55:04.141+0000 7f1badca6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T20:55:04.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.251+0000 7f72e9638700 1 Processor -- start 2024-05-08T20:55:04.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.251+0000 7f72e9638700 1 -- start start 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e9638700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e9638700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f72e406aea0 0x7f72e40c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e9638700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f72e40c45f0 0x7f72e41593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e9638700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e415d640 con 0x7f72e40c45f0 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e9638700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e40c4a80 con 0x7f72e406aea0 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e9638700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e415ca70 con 0x7f72e41533a0 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f72e40c45f0 0x7f72e41593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f72e40c45f0 0x7f72e41593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50332/0 (socket says 172.21.15.135:50332) 2024-05-08T20:55:04.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 -- 172.21.15.135:0/2320624751 learned_addr learned my addr 172.21.15.135:0/2320624751 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e27fc700 1 --2- 172.21.15.135:0/2320624751 >> v2:172.21.15.183:3300/0 conn(0x7f72e406aea0 0x7f72e40c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e2ffd700 1 --2- 172.21.15.135:0/2320624751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 -- 172.21.15.135:0/2320624751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 msgr2=0x7f72e406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 --2- 172.21.15.135:0/2320624751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e406a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 -- 172.21.15.135:0/2320624751 >> v2:172.21.15.183:3300/0 conn(0x7f72e406aea0 msgr2=0x7f72e40c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 --2- 172.21.15.135:0/2320624751 >> v2:172.21.15.183:3300/0 conn(0x7f72e406aea0 0x7f72e40c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 -- 172.21.15.135:0/2320624751 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e415cd10 con 0x7f72e40c45f0 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e2ffd700 1 --2- 172.21.15.135:0/2320624751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:04.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e27fc700 1 --2- 172.21.15.135:0/2320624751 >> v2:172.21.15.183:3300/0 conn(0x7f72e406aea0 0x7f72e40c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.252+0000 7f72e37fe700 1 --2- 172.21.15.135:0/2320624751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e40c45f0 0x7f72e41593e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72e4071650 tx=0x7f72dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a92595f9265e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e1ffb700 1 -- 172.21.15.135:0/2320624751 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc00e070 con 0x7f72e40c45f0 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e1ffb700 1 -- 172.21.15.135:0/2320624751 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc00b9c0 con 0x7f72e40c45f0 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e1ffb700 1 -- 172.21.15.135:0/2320624751 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc00bd70 con 0x7f72e40c45f0 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 -- 172.21.15.135:0/2320624751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e40c45f0 msgr2=0x7f72e41593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 --2- 172.21.15.135:0/2320624751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e40c45f0 0x7f72e41593e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72e4071650 tx=0x7f72dc00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 -- 172.21.15.135:0/2320624751 shutdown_connections 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 --2- 172.21.15.135:0/2320624751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e40c45f0 0x7f72e41593e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 --2- 172.21.15.135:0/2320624751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 --2- 172.21.15.135:0/2320624751 >> v2:172.21.15.183:3300/0 conn(0x7f72e406aea0 0x7f72e40c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 -- 172.21.15.135:0/2320624751 >> 172.21.15.135:0/2320624751 conn(0x7f72e406fac0 msgr2=0x7f72e406fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:04.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 -- 172.21.15.135:0/2320624751 shutdown_connections 2024-05-08T20:55:04.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.253+0000 7f72e9638700 1 -- 172.21.15.135:0/2320624751 wait complete. 2024-05-08T20:55:04.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 Processor -- start 2024-05-08T20:55:04.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 -- start start 2024-05-08T20:55:04.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e406aea0 0x7f72e406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72e40c45f0 0x7f72e40c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e40c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c6090 con 0x7f72e406aea0 2024-05-08T20:55:04.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40cbd00 con 0x7f72e40c45f0 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e9638700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41ef5e0 con 0x7f72e41533a0 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e406aea0 0x7f72e406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e406aea0 0x7f72e406bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50338/0 (socket says 172.21.15.135:50338) 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.255+0000 7f72e2ffd700 1 -- 172.21.15.135:0/2350741356 learned_addr learned my addr 172.21.15.135:0/2350741356 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e27fc700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72e40c45f0 0x7f72e40c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e37fe700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e40c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e2ffd700 1 -- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 msgr2=0x7f72e40c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e2ffd700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e40c6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e2ffd700 1 -- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72e40c45f0 msgr2=0x7f72e40c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e2ffd700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72e40c45f0 0x7f72e40c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e2ffd700 1 -- 172.21.15.135:0/2350741356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc009b30 con 0x7f72e406aea0 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e27fc700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72e40c45f0 0x7f72e40c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e2ffd700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e406aea0 0x7f72e406bce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e840 tx=0x7f72d800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72cb7fe700 1 -- 172.21.15.135:0/2350741356 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d800c020 con 0x7f72e406aea0 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72cb7fe700 1 -- 172.21.15.135:0/2350741356 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8004250 con 0x7f72e406aea0 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e41ef8c0 con 0x7f72e406aea0 2024-05-08T20:55:04.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72cb7fe700 1 -- 172.21.15.135:0/2350741356 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d80036a0 con 0x7f72e406aea0 2024-05-08T20:55:04.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.256+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e41efe80 con 0x7f72e406aea0 2024-05-08T20:55:04.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.257+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e4067fa0 con 0x7f72e406aea0 2024-05-08T20:55:04.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.258+0000 7f72cb7fe700 1 -- 172.21.15.135:0/2350741356 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f72d8003800 con 0x7f72e406aea0 2024-05-08T20:55:04.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.258+0000 7f72cb7fe700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f72d006acc0 0x7f72d006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.258+0000 7f72e27fc700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f72d006acc0 0x7f72d006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.258+0000 7f72cb7fe700 1 -- 172.21.15.135:0/2350741356 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f72d8089770 con 0x7f72e406aea0 2024-05-08T20:55:04.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.259+0000 7f72e27fc700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f72d006acc0 0x7f72d006d180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72e4156f80 tx=0x7f72d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:04.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.262+0000 7f72cb7fe700 1 -- 172.21.15.135:0/2350741356 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f72d80581f0 con 0x7f72e406aea0 2024-05-08T20:55:04.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.507+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f72e406b850 con 0x7f72e406aea0 2024-05-08T20:55:04.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.511+0000 7f72cb7fe700 1 -- 172.21.15.135:0/2350741356 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f72d805e030 con 0x7f72e406aea0 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f72d006acc0 msgr2=0x7f72d006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f72d006acc0 0x7f72d006d180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72e4156f80 tx=0x7f72d4008040 comp rx=0 tx=0).stop 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e406aea0 msgr2=0x7f72e406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e406aea0 0x7f72e406bce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e840 tx=0x7f72d800ec00 comp rx=0 tx=0).stop 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 shutdown_connections 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f72d006acc0 0x7f72d006d180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f72e41533a0 0x7f72e40c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e406aea0 0x7f72e406bce0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 --2- 172.21.15.135:0/2350741356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72e40c45f0 0x7f72e40c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 >> 172.21.15.135:0/2350741356 conn(0x7f72e406fac0 msgr2=0x7f72e4151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:04.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 shutdown_connections 2024-05-08T20:55:04.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.514+0000 7f72e9638700 1 -- 172.21.15.135:0/2350741356 wait complete. 2024-05-08T20:55:04.518 INFO:teuthology.orchestra.run.smithi135.stderr:added data pool 4 to fsmap 2024-05-08T20:55:04.529 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:55:04.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.647+0000 7fa7fd44e700 1 Processor -- start 2024-05-08T20:55:04.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.647+0000 7fa7fd44e700 1 -- start start 2024-05-08T20:55:04.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7fd44e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7fd44e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80cae30 0x7fa7f80cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7fd44e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7f80ce090 0x7fa7f80ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7fd44e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f80ce520 con 0x7fa7f80ce090 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7fd44e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f8159400 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7fd44e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80cbec0 con 0x7fa7f80cae30 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7f80ce090 0x7fa7f80ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7f80ce090 0x7fa7f80ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50340/0 (socket says 172.21.15.135:50340) 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 -- 172.21.15.135:0/1869246116 learned_addr learned my addr 172.21.15.135:0/1869246116 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f6ffd700 1 --2- 172.21.15.135:0/1869246116 >> v2:172.21.15.183:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f67fc700 1 --2- 172.21.15.135:0/1869246116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80cae30 0x7fa7f80cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 -- 172.21.15.135:0/1869246116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80cae30 msgr2=0x7fa7f80cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:04.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 --2- 172.21.15.135:0/1869246116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80cae30 0x7fa7f80cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 -- 172.21.15.135:0/1869246116 >> v2:172.21.15.183:3300/0 conn(0x7fa7f80cb5a0 msgr2=0x7fa7f80cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 --2- 172.21.15.135:0/1869246116 >> v2:172.21.15.183:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 -- 172.21.15.135:0/1869246116 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f815a220 con 0x7fa7f80ce090 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f6ffd700 1 --2- 172.21.15.135:0/1869246116 >> v2:172.21.15.183:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.648+0000 7fa7f77fe700 1 --2- 172.21.15.135:0/1869246116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80ce090 0x7fa7f80ccb40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7f806dc50 tx=0x7fa7f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43ecf033e196797 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7f5ffb700 1 -- 172.21.15.135:0/1869246116 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000e070 con 0x7fa7f80ce090 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7f5ffb700 1 -- 172.21.15.135:0/1869246116 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f000b9c0 con 0x7fa7f80ce090 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7f5ffb700 1 -- 172.21.15.135:0/1869246116 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000bd70 con 0x7fa7f80ce090 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 -- 172.21.15.135:0/1869246116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80ce090 msgr2=0x7fa7f80ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/1869246116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80ce090 0x7fa7f80ccb40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa7f806dc50 tx=0x7fa7f000b330 comp rx=0 tx=0).stop 2024-05-08T20:55:04.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 -- 172.21.15.135:0/1869246116 shutdown_connections 2024-05-08T20:55:04.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/1869246116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80ce090 0x7fa7f80ccb40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/1869246116 >> v2:172.21.15.183:3300/0 conn(0x7fa7f80cb5a0 0x7fa7f80cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/1869246116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80cae30 0x7fa7f80cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 -- 172.21.15.135:0/1869246116 >> 172.21.15.135:0/1869246116 conn(0x7fa7f80726c0 msgr2=0x7fa7f80ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:04.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 -- 172.21.15.135:0/1869246116 shutdown_connections 2024-05-08T20:55:04.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.649+0000 7fa7fd44e700 1 -- 172.21.15.135:0/1869246116 wait complete. 2024-05-08T20:55:04.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 Processor -- start 2024-05-08T20:55:04.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 -- start start 2024-05-08T20:55:04.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7f80cae30 0x7fa7f81f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80b42f0 0x7fa7f81ef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80b37a0 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81f3470 con 0x7fa7f80cae30 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7fd44e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80b2520 con 0x7fa7f80b42f0 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7f67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7f67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f814c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50354/0 (socket says 172.21.15.135:50354) 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7f67fc700 1 -- 172.21.15.135:0/3071622987 learned_addr learned my addr 172.21.15.135:0/3071622987 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.651+0000 7fa7f6ffd700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7f80cae30 0x7fa7f81f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7f77fe700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80b42f0 0x7fa7f81ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7f67fc700 1 -- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80b42f0 msgr2=0x7fa7f81ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7f67fc700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80b42f0 0x7fa7f81ef750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7f67fc700 1 -- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7f80cae30 msgr2=0x7fa7f81f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7f67fc700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7f80cae30 0x7fa7f81f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7f67fc700 1 -- 172.21.15.135:0/3071622987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009b30 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7f67fc700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f814c120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800e810 tx=0x7fa7e800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7df7fe700 1 -- 172.21.15.135:0/3071622987 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e800c070 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7df7fe700 1 -- 172.21.15.135:0/3071622987 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8013610 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f81eefb0 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7df7fe700 1 -- 172.21.15.135:0/3071622987 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80139c0 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.652+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f80b1a90 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.653+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f8067890 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.653+0000 7fa7df7fe700 1 -- 172.21.15.135:0/3071622987 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa7e8013b20 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.654+0000 7fa7df7fe700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa7e406acc0 0x7fa7e406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.654+0000 7fa7df7fe700 1 -- 172.21.15.135:0/3071622987 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7e80892b0 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.654+0000 7fa7f6ffd700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa7e406acc0 0x7fa7e406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:04.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.654+0000 7fa7f6ffd700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa7e406acc0 0x7fa7e406d180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0099d0 tx=0x7fa7ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:04.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.658+0000 7fa7df7fe700 1 -- 172.21.15.135:0/3071622987 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa7e80541a0 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.901+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7f80ce6b0 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.902+0000 7fa7df7fe700 1 -- 172.21.15.135:0/3071622987 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6257 (secure 0 0 0) 0x7fa7e80577c0 con 0x7fa7f80cb5a0 2024-05-08T20:55:04.905 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:04.905 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:04.509328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-08T20:55:04.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa7e406acc0 msgr2=0x7fa7e406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa7e406acc0 0x7fa7e406d180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0099d0 tx=0x7fa7ec008040 comp rx=0 tx=0).stop 2024-05-08T20:55:04.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80cb5a0 msgr2=0x7fa7f814c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f814c120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800e810 tx=0x7fa7e800eb20 comp rx=0 tx=0).stop 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 shutdown_connections 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa7e406acc0 0x7fa7e406d180 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7f80cae30 0x7fa7f81f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7f80b42f0 0x7fa7f81ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 --2- 172.21.15.135:0/3071622987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f80cb5a0 0x7fa7f814c120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 >> 172.21.15.135:0/3071622987 conn(0x7fa7f80726c0 msgr2=0x7fa7f80ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 shutdown_connections 2024-05-08T20:55:04.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:04.904+0000 7fa7fd44e700 1 -- 172.21.15.135:0/3071622987 wait complete. 2024-05-08T20:55:04.909 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 7 2024-05-08T20:55:04.919 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:05.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.037+0000 7efd677c2700 1 Processor -- start 2024-05-08T20:55:05.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.037+0000 7efd677c2700 1 -- start start 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd677c2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efd600cd430 0x7efd601530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd677c2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efd600c8b70 0x7efd601535f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd677c2700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd60159300 con 0x7efd600cd050 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd677c2700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd600c7360 con 0x7efd600cd430 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd677c2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd600c7640 con 0x7efd600c8b70 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd64d5d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efd600cd430 0x7efd601530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd64d5d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efd600cd430 0x7efd601530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50368/0 (socket says 172.21.15.135:50368) 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.038+0000 7efd64d5d700 1 -- 172.21.15.135:0/734634449 learned_addr learned my addr 172.21.15.135:0/734634449 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd65d5f700 1 --2- 172.21.15.135:0/734634449 >> v2:172.21.15.183:3300/0 conn(0x7efd600c8b70 0x7efd601535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd64d5d700 1 -- 172.21.15.135:0/734634449 >> v2:172.21.15.183:3300/0 conn(0x7efd600c8b70 msgr2=0x7efd601535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd64d5d700 1 --2- 172.21.15.135:0/734634449 >> v2:172.21.15.183:3300/0 conn(0x7efd600c8b70 0x7efd601535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd64d5d700 1 -- 172.21.15.135:0/734634449 >> v1:172.21.15.183:6789/0 conn(0x7efd600cd050 legacy=0x7efd6015d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd64d5d700 1 -- 172.21.15.135:0/734634449 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6006feb0 con 0x7efd600cd430 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd65d5f700 1 --2- 172.21.15.135:0/734634449 >> v2:172.21.15.183:3300/0 conn(0x7efd600c8b70 0x7efd601535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd64d5d700 1 --2- 172.21.15.135:0/734634449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600cd430 0x7efd601530b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd60070470 tx=0x7efd5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61946559a4c3c4b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd53fff700 1 -- 172.21.15.135:0/734634449 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c004230 con 0x7efd600cd430 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd53fff700 1 -- 172.21.15.135:0/734634449 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c004390 con 0x7efd600cd430 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd53fff700 1 -- 172.21.15.135:0/734634449 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0036a0 con 0x7efd600cd430 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd677c2700 1 -- 172.21.15.135:0/734634449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600cd430 msgr2=0x7efd601530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.039+0000 7efd677c2700 1 --2- 172.21.15.135:0/734634449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600cd430 0x7efd601530b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd60070470 tx=0x7efd5c009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.040+0000 7efd677c2700 1 -- 172.21.15.135:0/734634449 shutdown_connections 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.040+0000 7efd677c2700 1 --2- 172.21.15.135:0/734634449 >> v2:172.21.15.183:3300/0 conn(0x7efd600c8b70 0x7efd601535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.040+0000 7efd677c2700 1 --2- 172.21.15.135:0/734634449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600cd430 0x7efd601530b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.040+0000 7efd677c2700 1 -- 172.21.15.135:0/734634449 >> 172.21.15.135:0/734634449 conn(0x7efd6006ad50 msgr2=0x7efd6006b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.040+0000 7efd677c2700 1 -- 172.21.15.135:0/734634449 shutdown_connections 2024-05-08T20:55:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.040+0000 7efd677c2700 1 -- 172.21.15.135:0/734634449 wait complete. 2024-05-08T20:55:05.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.041+0000 7efd677c2700 1 Processor -- start 2024-05-08T20:55:05.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.041+0000 7efd677c2700 1 -- start start 2024-05-08T20:55:05.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.041+0000 7efd677c2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600c8b70 0x7efd6015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.041+0000 7efd677c2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd600cd050 0x7efd601e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.041+0000 7efd677c2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd600cd430 0x7efd601e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd677c2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6015ab40 con 0x7efd600c8b70 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd677c2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6015cac0 con 0x7efd600cd050 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd677c2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6015cda0 con 0x7efd600cd430 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600c8b70 0x7efd6015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600c8b70 0x7efd6015c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50382/0 (socket says 172.21.15.135:50382) 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 -- 172.21.15.135:0/2144442332 learned_addr learned my addr 172.21.15.135:0/2144442332 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd64d5d700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd600cd050 0x7efd601e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd65d5f700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd600cd430 0x7efd601e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 -- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd600cd430 msgr2=0x7efd601e4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd600cd430 0x7efd601e4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 -- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd600cd050 msgr2=0x7efd601e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd600cd050 0x7efd601e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 -- 172.21.15.135:0/2144442332 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c009550 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd64d5d700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd600cd050 0x7efd601e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd65d5f700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd600cd430 0x7efd601e4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd6555e700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600c8b70 0x7efd6015c430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c4d0 tx=0x7efd5400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd51ffb700 1 -- 172.21.15.135:0/2144442332 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011790 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd51ffb700 1 -- 172.21.15.135:0/2144442332 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd540118f0 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6015ad90 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd51ffb700 1 -- 172.21.15.135:0/2144442332 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54011ca0 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.042+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6015b350 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.043+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd601597a0 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.044+0000 7efd51ffb700 1 -- 172.21.15.135:0/2144442332 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd5401c460 con 0x7efd600c8b70 2024-05-08T20:55:05.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.044+0000 7efd51ffb700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efd4406acc0 0x7efd4406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.044+0000 7efd51ffb700 1 -- 172.21.15.135:0/2144442332 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd540894e0 con 0x7efd600c8b70 2024-05-08T20:55:05.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.044+0000 7efd64d5d700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efd4406acc0 0x7efd4406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.045+0000 7efd64d5d700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efd4406acc0 0x7efd4406d180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd600cd840 tx=0x7efd5c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.049+0000 7efd51ffb700 1 -- 172.21.15.135:0/2144442332 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efd601597a0 con 0x7efd600c8b70 2024-05-08T20:55:05.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.246+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd601597a0 con 0x7efd600c8b70 2024-05-08T20:55:05.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.247+0000 7efd51ffb700 1 -- 172.21.15.135:0/2144442332 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7efd601597a0 con 0x7efd600c8b70 2024-05-08T20:55:05.250 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:05.250 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:05.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.249+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efd4406acc0 msgr2=0x7efd4406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.249+0000 7efd677c2700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efd4406acc0 0x7efd4406d180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd600cd840 tx=0x7efd5c008030 comp rx=0 tx=0).stop 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600c8b70 msgr2=0x7efd6015c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600c8b70 0x7efd6015c430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c4d0 tx=0x7efd5400c890 comp rx=0 tx=0).stop 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 shutdown_connections 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efd4406acc0 0x7efd4406d180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efd600cd430 0x7efd601e4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd600c8b70 0x7efd6015c430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 --2- 172.21.15.135:0/2144442332 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efd600cd050 0x7efd601e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 >> 172.21.15.135:0/2144442332 conn(0x7efd6006ad50 msgr2=0x7efd600c2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 shutdown_connections 2024-05-08T20:55:05.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.250+0000 7efd677c2700 1 -- 172.21.15.135:0/2144442332 wait complete. 2024-05-08T20:55:05.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:05.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.382+0000 7f8709ca1700 1 Processor -- start 2024-05-08T20:55:05.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8709ca1700 1 -- start start 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8709ca1700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87040cbf50 0x7f87040c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8709ca1700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870415c990 con 0x7f8704072ae0 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8709ca1700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870415cbc0 con 0x7f87041535a0 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8709ca1700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870415ce60 con 0x7f87040cbf50 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8702ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87040cbf50 0x7f87040c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8703fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8704072ae0 0x7f8704163c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:47958/0 (socket says 172.21.15.135:47958) 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8702ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f87040cbf50 0x7f87040c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50392/0 (socket says 172.21.15.135:50392) 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.383+0000 7f8703fff700 1 -- 172.21.15.135:0/1456259773 learned_addr learned my addr 172.21.15.135:0/1456259773 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f8702ffd700 1 -- 172.21.15.135:0/1456259773 >> v1:172.21.15.183:6789/0 conn(0x7f87041535a0 legacy=0x7f870406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f8702ffd700 1 -- 172.21.15.135:0/1456259773 >> v1:172.21.15.135:6789/0 conn(0x7f8704072ae0 legacy=0x7f8704163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f87027fc700 1 -- 172.21.15.135:0/1456259773 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796799996 0 0) 0x7f870415c990 con 0x7f8704072ae0 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f8702ffd700 1 -- 172.21.15.135:0/1456259773 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870415d140 con 0x7f87040cbf50 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f8702ffd700 1 --2- 172.21.15.135:0/1456259773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87040cbf50 0x7f87040c40b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009840 tx=0x7f86f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3ab4c9b17e1fad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f87027fc700 1 -- 172.21.15.135:0/1456259773 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011830 con 0x7f87040cbf50 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f87027fc700 1 -- 172.21.15.135:0/1456259773 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8011990 con 0x7f87040cbf50 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.384+0000 7f87027fc700 1 -- 172.21.15.135:0/1456259773 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011d20 con 0x7f87040cbf50 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.385+0000 7f8709ca1700 1 -- 172.21.15.135:0/1456259773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87040cbf50 msgr2=0x7f87040c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.385+0000 7f8709ca1700 1 --2- 172.21.15.135:0/1456259773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87040cbf50 0x7f87040c40b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009840 tx=0x7f86f8009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.385+0000 7f8709ca1700 1 -- 172.21.15.135:0/1456259773 shutdown_connections 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.385+0000 7f8709ca1700 1 --2- 172.21.15.135:0/1456259773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87040cbf50 0x7f87040c40b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.385+0000 7f8709ca1700 1 -- 172.21.15.135:0/1456259773 >> 172.21.15.135:0/1456259773 conn(0x7f870406daf0 msgr2=0x7f870406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.385+0000 7f8709ca1700 1 -- 172.21.15.135:0/1456259773 shutdown_connections 2024-05-08T20:55:05.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.385+0000 7f8709ca1700 1 -- 172.21.15.135:0/1456259773 wait complete. 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.386+0000 7f8709ca1700 1 Processor -- start 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.386+0000 7f8709ca1700 1 -- start start 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8704072ae0 0x7f870406be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87040cbf50 0x7f870414a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87041535a0 0x7f870414a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87041e3ce0 con 0x7f87041535a0 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870414d100 con 0x7f8704072ae0 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870414bb20 con 0x7f87040cbf50 2024-05-08T20:55:05.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87041535a0 0x7f870414a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87041535a0 0x7f870414a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50400/0 (socket says 172.21.15.135:50400) 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 -- 172.21.15.135:0/3148469387 learned_addr learned my addr 172.21.15.135:0/3148469387 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f87037fe700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8704072ae0 0x7f870406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8702ffd700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87040cbf50 0x7f870414a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 -- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87040cbf50 msgr2=0x7f870414a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87040cbf50 0x7f870414a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 -- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8704072ae0 msgr2=0x7f870406be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8704072ae0 0x7f870406be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 -- 172.21.15.135:0/3148469387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80094a0 con 0x7f87041535a0 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8702ffd700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87040cbf50 0x7f870414a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8703fff700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87041535a0 0x7f870414a9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00ccd0 tx=0x7f86fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f86ebfff700 1 -- 172.21.15.135:0/3148469387 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc00abe0 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f86ebfff700 1 -- 172.21.15.135:0/3148469387 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc00ad40 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f86ebfff700 1 -- 172.21.15.135:0/3148469387 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc007310 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870414b840 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.387+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870414cab0 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.388+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870414d2b0 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.389+0000 7f86ebfff700 1 -- 172.21.15.135:0/3148469387 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f86fc007470 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.389+0000 7f86ebfff700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f86f006ac90 0x7f86f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.389+0000 7f87037fe700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f86f006ac90 0x7f86f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.389+0000 7f86ebfff700 1 -- 172.21.15.135:0/3148469387 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86fc089060 con 0x7f87041535a0 2024-05-08T20:55:05.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.390+0000 7f87037fe700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f86f006ac90 0x7f86f006d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86f4007fd0 tx=0x7f86f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.394+0000 7f86ebfff700 1 -- 172.21.15.135:0/3148469387 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f870414d2b0 con 0x7f87041535a0 2024-05-08T20:55:05.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.594+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f870414d2b0 con 0x7f87041535a0 2024-05-08T20:55:05.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.595+0000 7f86ebfff700 1 -- 172.21.15.135:0/3148469387 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f870414d2b0 con 0x7f87041535a0 2024-05-08T20:55:05.598 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:05.598 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:05.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f86f006ac90 msgr2=0x7f86f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f86f006ac90 0x7f86f006d150 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86f4007fd0 tx=0x7f86f4009040 comp rx=0 tx=0).stop 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87041535a0 msgr2=0x7f870414a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87041535a0 0x7f870414a9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00ccd0 tx=0x7f86fc00a060 comp rx=0 tx=0).stop 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 shutdown_connections 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f86f006ac90 0x7f86f006d150 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8704072ae0 0x7f870406be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87041535a0 0x7f870414a9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 --2- 172.21.15.135:0/3148469387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87040cbf50 0x7f870414a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.597+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 >> 172.21.15.135:0/3148469387 conn(0x7f870406daf0 msgr2=0x7f870406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.598+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 shutdown_connections 2024-05-08T20:55:05.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.598+0000 7f8709ca1700 1 -- 172.21.15.135:0/3148469387 wait complete. 2024-05-08T20:55:05.629 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:55:05.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff04248b700 1 Processor -- start 2024-05-08T20:55:05.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff04248b700 1 -- start start 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff04248b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff03c1536d0 0x7ff03c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff04248b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff03c0c6770 0x7ff03c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff04248b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c0cc8c0 con 0x7ff03c072b50 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff04248b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c153ab0 con 0x7ff03c1536d0 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff04248b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c0c6c00 con 0x7ff03c0c6770 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.748+0000 7ff03bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff03c1536d0 0x7ff03c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff03c1536d0 0x7ff03c159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50410/0 (socket says 172.21.15.135:50410) 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03bfff700 1 -- 172.21.15.135:0/4268056853 learned_addr learned my addr 172.21.15.135:0/4268056853 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:05.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff040a28700 1 --2- 172.21.15.135:0/4268056853 >> v2:172.21.15.183:3300/0 conn(0x7ff03c0c6770 0x7ff03c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03bfff700 1 -- 172.21.15.135:0/4268056853 >> v2:172.21.15.183:3300/0 conn(0x7ff03c0c6770 msgr2=0x7ff03c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03bfff700 1 --2- 172.21.15.135:0/4268056853 >> v2:172.21.15.183:3300/0 conn(0x7ff03c0c6770 0x7ff03c06a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03bfff700 1 -- 172.21.15.135:0/4268056853 >> v1:172.21.15.183:6789/0 conn(0x7ff03c072b50 legacy=0x7ff03c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03bfff700 1 -- 172.21.15.135:0/4268056853 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c0cc380 con 0x7ff03c1536d0 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03bfff700 1 --2- 172.21.15.135:0/4268056853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c1536d0 0x7ff03c159f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0cbc00 tx=0x7ff02c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d427649b7bed187 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03affd700 1 -- 172.21.15.135:0/4268056853 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c00b870 con 0x7ff03c1536d0 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03affd700 1 -- 172.21.15.135:0/4268056853 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c00b9d0 con 0x7ff03c1536d0 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.749+0000 7ff03affd700 1 -- 172.21.15.135:0/4268056853 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c00bd60 con 0x7ff03c1536d0 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 -- 172.21.15.135:0/4268056853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c1536d0 msgr2=0x7ff03c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 --2- 172.21.15.135:0/4268056853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c1536d0 0x7ff03c159f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0cbc00 tx=0x7ff02c009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 -- 172.21.15.135:0/4268056853 shutdown_connections 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 --2- 172.21.15.135:0/4268056853 >> v2:172.21.15.183:3300/0 conn(0x7ff03c0c6770 0x7ff03c06a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 --2- 172.21.15.135:0/4268056853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c1536d0 0x7ff03c159f90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 -- 172.21.15.135:0/4268056853 >> 172.21.15.135:0/4268056853 conn(0x7ff03c06daf0 msgr2=0x7ff03c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:05.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 -- 172.21.15.135:0/4268056853 shutdown_connections 2024-05-08T20:55:05.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.750+0000 7ff04248b700 1 -- 172.21.15.135:0/4268056853 wait complete. 2024-05-08T20:55:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.751+0000 7ff04248b700 1 Processor -- start 2024-05-08T20:55:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.751+0000 7ff04248b700 1 -- start start 2024-05-08T20:55:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff04248b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072b50 0x7ff03c1eef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff04248b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff03c0c6770 0x7ff03c0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff04248b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03c1536d0 0x7ff03c14d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff04248b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c155490 con 0x7ff03c072b50 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff04248b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c14faf0 con 0x7ff03c0c6770 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff04248b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c1f2670 con 0x7ff03c1536d0 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff03bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072b50 0x7ff03c1eef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff03bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072b50 0x7ff03c1eef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50422/0 (socket says 172.21.15.135:50422) 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff03bfff700 1 -- 172.21.15.135:0/2724184616 learned_addr learned my addr 172.21.15.135:0/2724184616 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff03b7fe700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff03c0c6770 0x7ff03c0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.752+0000 7ff040a28700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03c1536d0 0x7ff03c14d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff03bfff700 1 -- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03c1536d0 msgr2=0x7ff03c14d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff03bfff700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03c1536d0 0x7ff03c14d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff03bfff700 1 -- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff03c0c6770 msgr2=0x7ff03c0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:05.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff03bfff700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff03c0c6770 0x7ff03c0c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff03bfff700 1 -- 172.21.15.135:0/2724184616 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c009550 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff03bfff700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072b50 0x7ff03c1eef60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff038ff9700 1 -- 172.21.15.135:0/2724184616 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c004310 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff038ff9700 1 -- 172.21.15.135:0/2724184616 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c01e070 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff038ff9700 1 -- 172.21.15.135:0/2724184616 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0036a0 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c1ef4a0 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.753+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c14f810 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.754+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c1f24d0 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.754+0000 7ff038ff9700 1 -- 172.21.15.135:0/2724184616 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff02c020030 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.755+0000 7ff038ff9700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff02806acc0 0x7ff02806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.755+0000 7ff038ff9700 1 -- 172.21.15.135:0/2724184616 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff02c08a530 con 0x7ff03c072b50 2024-05-08T20:55:05.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.755+0000 7ff03b7fe700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff02806acc0 0x7ff02806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:05.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.755+0000 7ff03b7fe700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff02806acc0 0x7ff02806d180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff03c1526b0 tx=0x7ff030009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:05.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:05.759+0000 7ff038ff9700 1 -- 172.21.15.135:0/2724184616 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff03c1f24d0 con 0x7ff03c072b50 2024-05-08T20:55:06.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.000+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff03c1f24d0 con 0x7ff03c072b50 2024-05-08T20:55:06.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.000+0000 7ff038ff9700 1 -- 172.21.15.135:0/2724184616 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6257 (secure 0 0 0) 0x7ff03c1f24d0 con 0x7ff03c072b50 2024-05-08T20:55:06.003 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:06.003 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:04.509328+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-08T20:55:06.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff02806acc0 msgr2=0x7ff02806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff02806acc0 0x7ff02806d180 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff03c1526b0 tx=0x7ff030009040 comp rx=0 tx=0).stop 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072b50 msgr2=0x7ff03c1eef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072b50 0x7ff03c1eef60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff02c000c00 tx=0x7ff02c004750 comp rx=0 tx=0).stop 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 shutdown_connections 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff02806acc0 0x7ff02806d180 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03c1536d0 0x7ff03c14d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff03c072b50 0x7ff03c1eef60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 --2- 172.21.15.135:0/2724184616 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff03c0c6770 0x7ff03c0c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 >> 172.21.15.135:0/2724184616 conn(0x7ff03c06daf0 msgr2=0x7ff03c156f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.002+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 shutdown_connections 2024-05-08T20:55:06.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.003+0000 7ff04248b700 1 -- 172.21.15.135:0/2724184616 wait complete. 2024-05-08T20:55:06.007 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 7 2024-05-08T20:55:06.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:06.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.136+0000 7f4d257ad700 1 Processor -- start 2024-05-08T20:55:06.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.137+0000 7f4d257ad700 1 -- start start 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.137+0000 7f4d257ad700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d200cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.137+0000 7f4d257ad700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4d200cae30 0x7f4d200cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.137+0000 7f4d257ad700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2015a220 con 0x7f4d200ce090 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.137+0000 7f4d257ad700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d200ce520 con 0x7f4d200cae30 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.137+0000 7f4d257ad700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20159400 con 0x7f4d200cb5a0 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1f7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f4d200ce090 0x7f4d200ccb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:47970/0 (socket says 172.21.15.135:47970) 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1f7fe700 1 -- 172.21.15.135:0/960340968 learned_addr learned my addr 172.21.15.135:0/960340968 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1effd700 1 --2- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d200cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1e7fc700 1 --2- 172.21.15.135:0/960340968 >> v2:172.21.15.183:3300/0 conn(0x7f4d200cae30 0x7f4d200cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1dffb700 1 -- 172.21.15.135:0/960340968 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571541488 0 0) 0x7f4d2015a220 con 0x7f4d200ce090 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1dffb700 1 -- 172.21.15.135:0/960340968 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d080035b0 con 0x7f4d200ce090 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1e7fc700 1 -- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 msgr2=0x7f4d200cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1e7fc700 1 --2- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d200cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1e7fc700 1 -- 172.21.15.135:0/960340968 >> v1:172.21.15.135:6789/0 conn(0x7f4d200ce090 legacy=0x7f4d200ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1e7fc700 1 -- 172.21.15.135:0/960340968 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20159610 con 0x7f4d200cae30 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1effd700 1 --2- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d200cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1e7fc700 1 --2- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200cae30 0x7f4d200cdb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009840 tx=0x7f4d10009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ff68b3a268ba4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1dffb700 1 -- 172.21.15.135:0/960340968 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10011830 con 0x7f4d200cae30 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1dffb700 1 -- 172.21.15.135:0/960340968 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d10011990 con 0x7f4d200cae30 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.138+0000 7f4d1dffb700 1 -- 172.21.15.135:0/960340968 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10011d00 con 0x7f4d200cae30 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 -- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200cae30 msgr2=0x7f4d200cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 --2- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200cae30 0x7f4d200cdb50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009840 tx=0x7f4d10009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:06.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 -- 172.21.15.135:0/960340968 shutdown_connections 2024-05-08T20:55:06.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 --2- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d200cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 --2- 172.21.15.135:0/960340968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200cae30 0x7f4d200cdb50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 -- 172.21.15.135:0/960340968 >> 172.21.15.135:0/960340968 conn(0x7f4d200726c0 msgr2=0x7f4d200ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:06.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 -- 172.21.15.135:0/960340968 shutdown_connections 2024-05-08T20:55:06.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.139+0000 7f4d257ad700 1 -- 172.21.15.135:0/960340968 wait complete. 2024-05-08T20:55:06.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.141+0000 7f4d257ad700 1 Processor -- start 2024-05-08T20:55:06.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.141+0000 7f4d257ad700 1 -- start start 2024-05-08T20:55:06.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d200cae30 0x7f4d20154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d2014a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200ae8f0 0x7f4d201ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20155860 con 0x7f4d200cae30 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d201eec50 con 0x7f4d200ae8f0 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d20153df0 con 0x7f4d200cb5a0 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d200cae30 0x7f4d20154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d200cae30 0x7f4d20154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50432/0 (socket says 172.21.15.135:50432) 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 -- 172.21.15.135:0/3069943700 learned_addr learned my addr 172.21.15.135:0/3069943700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1f7fe700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200ae8f0 0x7f4d201ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1e7fc700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d2014a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 -- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 msgr2=0x7f4d2014a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d2014a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 -- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200ae8f0 msgr2=0x7f4d201ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200ae8f0 0x7f4d201ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 -- 172.21.15.135:0/3069943700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d140094a0 con 0x7f4d200cae30 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d1effd700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d200cae30 0x7f4d20154940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400ebe0 tx=0x7f4d1400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d077fe700 1 -- 172.21.15.135:0/3069943700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400c850 con 0x7f4d200cae30 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d077fe700 1 -- 172.21.15.135:0/3069943700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1400c9b0 con 0x7f4d200cae30 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d077fe700 1 -- 172.21.15.135:0/3069943700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400cd40 con 0x7f4d200cae30 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d100094a0 con 0x7f4d200cae30 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.142+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d201543b0 con 0x7f4d200cae30 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.143+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2006ce90 con 0x7f4d200cae30 2024-05-08T20:55:06.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.144+0000 7f4d077fe700 1 -- 172.21.15.135:0/3069943700 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d14013470 con 0x7f4d200cae30 2024-05-08T20:55:06.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.144+0000 7f4d077fe700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f4d0c06ac90 0x7f4d0c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:06.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.144+0000 7f4d077fe700 1 -- 172.21.15.135:0/3069943700 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d140897d0 con 0x7f4d200cae30 2024-05-08T20:55:06.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.144+0000 7f4d1e7fc700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f4d0c06ac90 0x7f4d0c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:06.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.145+0000 7f4d1e7fc700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f4d0c06ac90 0x7f4d0c06d150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000c00 tx=0x7f4d1001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:06.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.149+0000 7f4d077fe700 1 -- 172.21.15.135:0/3069943700 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4d140545a0 con 0x7f4d200cae30 2024-05-08T20:55:06.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.343+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d20067890 con 0x7f4d200cae30 2024-05-08T20:55:06.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.344+0000 7f4d077fe700 1 -- 172.21.15.135:0/3069943700 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f4d1400cea0 con 0x7f4d200cae30 2024-05-08T20:55:06.347 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:06.348 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:06.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f4d0c06ac90 msgr2=0x7f4d0c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f4d0c06ac90 0x7f4d0c06d150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000c00 tx=0x7f4d1001c040 comp rx=0 tx=0).stop 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d200cae30 msgr2=0x7f4d20154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d200cae30 0x7f4d20154940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400ebe0 tx=0x7f4d1400eef0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 shutdown_connections 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f4d0c06ac90 0x7f4d0c06d150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d200ae8f0 0x7f4d201ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d200cae30 0x7f4d20154940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 --2- 172.21.15.135:0/3069943700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d200cb5a0 0x7f4d2014a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 >> 172.21.15.135:0/3069943700 conn(0x7f4d200726c0 msgr2=0x7f4d20157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:06.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 shutdown_connections 2024-05-08T20:55:06.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:06.346+0000 7f4d257ad700 1 -- 172.21.15.135:0/3069943700 wait complete. 2024-05-08T20:55:06.965 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T20:55:00.066076+0000', 'modified': '2024-05-08T20:55:04.509328+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6837/2419873080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 2419873080}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 2419873080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-05-08T20:55:06.966 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T20:55:06.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-08T20:55:07.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.089+0000 7fa339705700 1 Processor -- start 2024-05-08T20:55:07.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.089+0000 7fa339705700 1 -- start start 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.089+0000 7fa339705700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa3340c6780 0x7fa3340c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.089+0000 7fa339705700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33415db20 con 0x7fa334160c50 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.089+0000 7fa339705700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33415d7f0 con 0x7fa334157990 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.089+0000 7fa339705700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3340c70a0 con 0x7fa3340c6780 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.089+0000 7fa3337fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa3340c6780 0x7fa3340c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa3337fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa3340c6780 0x7fa3340c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50436/0 (socket says 172.21.15.135:50436) 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa3337fe700 1 -- 172.21.15.135:0/162452743 learned_addr learned my addr 172.21.15.135:0/162452743 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:07.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa3337fe700 1 -- 172.21.15.135:0/162452743 >> v1:172.21.15.183:6789/0 conn(0x7fa334157990 legacy=0x7fa3340c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa3337fe700 1 -- 172.21.15.135:0/162452743 >> v1:172.21.15.135:6789/0 conn(0x7fa334160c50 legacy=0x7fa33415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa3337fe700 1 -- 172.21.15.135:0/162452743 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334161220 con 0x7fa3340c6780 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa331ffb700 1 -- 172.21.15.135:0/162452743 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680993096 0 0) 0x7fa33415db20 con 0x7fa334160c50 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa3337fe700 1 --2- 172.21.15.135:0/162452743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c6b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009e50 tx=0x7fa32c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff07c41eb1c72bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa331ffb700 1 -- 172.21.15.135:0/162452743 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00e070 con 0x7fa3340c6780 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa331ffb700 1 -- 172.21.15.135:0/162452743 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c00b9c0 con 0x7fa3340c6780 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.090+0000 7fa331ffb700 1 -- 172.21.15.135:0/162452743 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00bd70 con 0x7fa3340c6780 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.091+0000 7fa339705700 1 -- 172.21.15.135:0/162452743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 msgr2=0x7fa3340c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.091+0000 7fa339705700 1 --2- 172.21.15.135:0/162452743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c6b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009e50 tx=0x7fa32c00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.091+0000 7fa339705700 1 -- 172.21.15.135:0/162452743 shutdown_connections 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.091+0000 7fa339705700 1 --2- 172.21.15.135:0/162452743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c6b60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.091+0000 7fa339705700 1 -- 172.21.15.135:0/162452743 >> 172.21.15.135:0/162452743 conn(0x7fa33406a960 msgr2=0x7fa33406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.091+0000 7fa339705700 1 -- 172.21.15.135:0/162452743 shutdown_connections 2024-05-08T20:55:07.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.091+0000 7fa339705700 1 -- 172.21.15.135:0/162452743 wait complete. 2024-05-08T20:55:07.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.092+0000 7fa339705700 1 Processor -- start 2024-05-08T20:55:07.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.092+0000 7fa339705700 1 -- start start 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa334157990 0x7fa3340c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa334160c50 0x7fa33414d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa334159f50 con 0x7fa3340c6780 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340c86d0 con 0x7fa334157990 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3341f4450 con 0x7fa334160c50 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50442/0 (socket says 172.21.15.135:50442) 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 -- 172.21.15.135:0/1369036765 learned_addr learned my addr 172.21.15.135:0/1369036765 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa3337fe700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa334160c50 0x7fa33414d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa3327fc700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa334157990 0x7fa3340c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 -- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa334160c50 msgr2=0x7fa33414d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa334160c50 0x7fa33414d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 -- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa334157990 msgr2=0x7fa3340c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa334157990 0x7fa3340c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 -- 172.21.15.135:0/1369036765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c009b30 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa332ffd700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c9800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c4e0 tx=0x7fa31c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa32b7fe700 1 -- 172.21.15.135:0/1369036765 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0052d0 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa32b7fe700 1 -- 172.21.15.135:0/1369036765 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c005430 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3340c8920 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa32b7fe700 1 -- 172.21.15.135:0/1369036765 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0038c0 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.093+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3340c8ee0 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.095+0000 7fa32b7fe700 1 -- 172.21.15.135:0/1369036765 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa31c003a20 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.095+0000 7fa32b7fe700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa31406ac90 0x7fa31406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.095+0000 7fa32b7fe700 1 -- 172.21.15.135:0/1369036765 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa31c088b70 con 0x7fa3340c6780 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.095+0000 7fa3327fc700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa31406ac90 0x7fa31406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.096+0000 7fa3327fc700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa31406ac90 0x7fa31406d150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3340c4420 tx=0x7fa324009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.097+0000 7fa3458bfb80 1 Processor -- start 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.097+0000 7fa3458bfb80 1 -- start start 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f90450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f53930 0x562aa6f7a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f911b0 0x562aa6f7aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6ea8100 con 0x562aa6f911b0 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6ea5ac0 con 0x562aa6f90dd0 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aa6ea13b0 con 0x562aa6f53930 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f911b0 0x562aa6f7aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f911b0 0x562aa6f7aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50456/0 (socket says 172.21.15.135:50456) 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3337fe700 1 -- 172.21.15.135:0/690358349 learned_addr learned my addr 172.21.15.135:0/690358349 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa3327fc700 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f53930 0x562aa6f7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.098+0000 7fa332ffd700 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f90450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.099+0000 7fa3337fe700 1 -- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f53930 msgr2=0x562aa6f7a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.099+0000 7fa3337fe700 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f53930 0x562aa6f7a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.099+0000 7fa3337fe700 1 -- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 msgr2=0x562aa6f90450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.099+0000 7fa3337fe700 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f90450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.099+0000 7fa3337fe700 1 -- 172.21.15.135:0/690358349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aa6d22360 con 0x562aa6f911b0 2024-05-08T20:55:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.099+0000 7fa3337fe700 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f911b0 0x562aa6f7aac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009a50 tx=0x7fa32c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0828e71d4dcafe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.101+0000 7fa328ff9700 1 -- 172.21.15.135:0/690358349 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00bd30 con 0x562aa6f911b0 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.101+0000 7fa328ff9700 1 -- 172.21.15.135:0/690358349 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c024410 con 0x562aa6f911b0 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.101+0000 7fa328ff9700 1 -- 172.21.15.135:0/690358349 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c024780 con 0x562aa6f911b0 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 -- 172.21.15.135:0/690358349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f911b0 msgr2=0x562aa6f7aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f911b0 0x562aa6f7aac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009a50 tx=0x7fa32c010000 comp rx=0 tx=0).stop 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 -- 172.21.15.135:0/690358349 shutdown_connections 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f90450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f911b0 0x562aa6f7aac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/690358349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f53930 0x562aa6f7a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 -- 172.21.15.135:0/690358349 >> 172.21.15.135:0/690358349 conn(0x562aa6eaf1c0 msgr2=0x562aa6f4f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 -- 172.21.15.135:0/690358349 shutdown_connections 2024-05-08T20:55:07.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 -- 172.21.15.135:0/690358349 wait complete. 2024-05-08T20:55:07.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.102+0000 7fa3458bfb80 1 -- start start 2024-05-08T20:55:07.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 1 Processor -- start 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f91990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f911b0 0x562aa6f70c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f720f0 0x562aa6f79000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6e3d510 con 0x562aa6f720f0 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6e3d1b0 con 0x562aa6f90dd0 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aa6d24650 con 0x562aa6f911b0 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3458bfb80 10 client.0 _ll_register_callbacks cb 0x562aa6e46ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f720f0 0x562aa6f79000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f720f0 0x562aa6f79000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50464/0 (socket says 172.21.15.135:50464) 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.103+0000 7fa3337fe700 1 -- 172.21.15.135:0/413485662 learned_addr learned my addr 172.21.15.135:0/413485662 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa332ffd700 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f91990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3327fc700 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f911b0 0x562aa6f70c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3337fe700 1 -- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f911b0 msgr2=0x562aa6f70c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3337fe700 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f911b0 0x562aa6f70c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3337fe700 1 -- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 msgr2=0x562aa6f91990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3337fe700 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f91990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3337fe700 1 -- 172.21.15.135:0/413485662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa334161220 con 0x562aa6f720f0 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3337fe700 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f720f0 0x562aa6f79000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009a80 tx=0x7fa32c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c8c1833d11a544 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa311ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa311ffb700 1 -- 172.21.15.135:0/413485662 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c024ea0 con 0x562aa6f720f0 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa311ffb700 1 -- 172.21.15.135:0/413485662 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa32c02f440 con 0x562aa6f720f0 2024-05-08T20:55:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562aa6dfa220 con 0x562aa6f720f0 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa311ffb700 1 -- 172.21.15.135:0/413485662 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa32c00be80 con 0x562aa6f720f0 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3458bfb80 10 client.4434 fetch_fsmap learned FSMap version 7 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562aa6cceb10 con 0x562aa6f720f0 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa311ffb700 1 -- 172.21.15.135:0/413485662 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562aa6dfa220 con 0x562aa6f720f0 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.104+0000 7fa311ffb700 1 -- 172.21.15.135:0/413485662 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fa32c00b050 con 0x562aa6f720f0 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa3458bfb80 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa3458bfb80 10 client.4434 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa3458bfb80 20 client.4434 populate_metadata read hostname 'smithi135' 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f6ebb0 0x562aa6f6ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa3458bfb80 4 client.4434 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 --> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562aa6f20790 con 0x562aa6f6ebb0 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa332ffd700 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f6ebb0 0x562aa6f6ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa311ffb700 10 client.4434 ms_handle_connect on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.105+0000 7fa332ffd700 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f6ebb0 0x562aa6f6ef90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=befdd7a79abe1faa server_cookie=f25d0d0dac977924 in_seq=0 out_seq=0 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa311ffb700 1 -- 172.21.15.135:0/413485662 <== mds.0 v2:172.21.15.183:6834/2419873080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562aa6f20790 con 0x562aa6f6ebb0 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa311ffb700 10 client.4434 handle_command_reply: tid=0 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 client.4434 shutdown 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f720f0 msgr2=0x562aa6f79000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f720f0 0x562aa6f79000 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009a80 tx=0x7fa32c004b40 comp rx=0 tx=0).stop 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 shutdown_connections 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f6ebb0 0x562aa6f6ef90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6f91990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f720f0 0x562aa6f79000 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa311ffb700 0 client.4434 ms_handle_reset on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/413485662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f911b0 0x562aa6f70c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 >> 172.21.15.135:0/413485662 conn(0x562aa6eaf1c0 msgr2=0x562aa6f4f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 shutdown_connections 2024-05-08T20:55:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 1 -- 172.21.15.135:0/413485662 wait complete. 2024-05-08T20:55:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.106+0000 7fa3458bfb80 20 client.4434 trim_cache size 0 max 16384 2024-05-08T20:55:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.124+0000 7fa3458bfb80 1 Processor -- start 2024-05-08T20:55:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.124+0000 7fa3458bfb80 1 -- start start 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f6ebb0 0x562aa6fb4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6f95420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f90dd0 0x562aa6f95960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6f53290 con 0x562aa6f90dd0 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6f72ae0 con 0x562aa6f6ebb0 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aa6f7b730 con 0x562aa6f720f0 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f90dd0 0x562aa6f95960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f90dd0 0x562aa6f95960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50480/0 (socket says 172.21.15.135:50480) 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 -- 172.21.15.135:0/2272846917 learned_addr learned my addr 172.21.15.135:0/2272846917 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa332ffd700 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f6ebb0 0x562aa6fb4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3327fc700 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6f95420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 -- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 msgr2=0x562aa6f95420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6f95420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 -- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f6ebb0 msgr2=0x562aa6fb4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f6ebb0 0x562aa6fb4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3337fe700 1 -- 172.21.15.135:0/2272846917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aa6e67510 con 0x562aa6f90dd0 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa332ffd700 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f6ebb0 0x562aa6fb4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.125+0000 7fa3327fc700 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6f95420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3337fe700 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f90dd0 0x562aa6f95960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009a50 tx=0x7fa32c029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93da45456ec2d40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3297fa700 1 -- 172.21.15.135:0/2272846917 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00e070 con 0x562aa6f90dd0 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3297fa700 1 -- 172.21.15.135:0/2272846917 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c024580 con 0x562aa6f90dd0 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3297fa700 1 -- 172.21.15.135:0/2272846917 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c02f740 con 0x562aa6f90dd0 2024-05-08T20:55:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 -- 172.21.15.135:0/2272846917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f90dd0 msgr2=0x562aa6f95960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f90dd0 0x562aa6f95960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009a50 tx=0x7fa32c029000 comp rx=0 tx=0).stop 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 -- 172.21.15.135:0/2272846917 shutdown_connections 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f6ebb0 0x562aa6fb4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f90dd0 0x562aa6f95960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/2272846917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6f95420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 -- 172.21.15.135:0/2272846917 >> 172.21.15.135:0/2272846917 conn(0x562aa6eaf1c0 msgr2=0x562aa6f48190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 -- 172.21.15.135:0/2272846917 shutdown_connections 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.126+0000 7fa3458bfb80 1 -- 172.21.15.135:0/2272846917 wait complete. 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.127+0000 7fa3458bfb80 1 -- start start 2024-05-08T20:55:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.127+0000 7fa3458bfb80 1 Processor -- start 2024-05-08T20:55:07.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f6ebb0 0x562aa6f78780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6fa5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6ff47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6f8ee20 con 0x562aa6f6ebb0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aa6f78cc0 con 0x562aa6f90dd0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x562aa6ffb260 con 0x562aa6f720f0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 10 client.0 _ll_register_callbacks cb 0x562aa6e46ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f6ebb0 0x562aa6f78780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f6ebb0 0x562aa6f78780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50492/0 (socket says 172.21.15.135:50492) 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 -- 172.21.15.135:0/3764446453 learned_addr learned my addr 172.21.15.135:0/3764446453 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3337fe700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6ff47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3327fc700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6fa5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 -- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 msgr2=0x562aa6fa5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6fa5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 -- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 msgr2=0x562aa6ff47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6ff47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 -- 172.21.15.135:0/3764446453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562aa6cceb10 con 0x562aa6f6ebb0 2024-05-08T20:55:07.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3337fe700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6ff47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3327fc700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6fa5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa332ffd700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f6ebb0 0x562aa6f78780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa31c057840 tx=0x7fa31c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d2b7e3d7044500 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa311ffb700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa311ffb700 1 -- 172.21.15.135:0/3764446453 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c05fa70 con 0x562aa6f6ebb0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa311ffb700 1 -- 172.21.15.135:0/3764446453 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa31c0578e0 con 0x562aa6f6ebb0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa32c024410 con 0x562aa6f6ebb0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa311ffb700 1 -- 172.21.15.135:0/3764446453 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa31c057aa0 con 0x562aa6f6ebb0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 10 client.4440 fetch_fsmap learned FSMap version 7 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562aa6d26c80 con 0x562aa6f6ebb0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.128+0000 7fa311ffb700 1 -- 172.21.15.135:0/3764446453 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c024410 con 0x562aa6f6ebb0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa311ffb700 1 -- 172.21.15.135:0/3764446453 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fa31c056b70 con 0x562aa6f6ebb0 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2024-05-08T20:55:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 10 client.4440 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 20 client.4440 populate_metadata read hostname 'smithi135' 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f911b0 0x562aa6ff5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 4 client.4440 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 --> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562aa6e99e70 con 0x562aa6f911b0 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3327fc700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f911b0 0x562aa6ff5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa311ffb700 10 client.4440 ms_handle_connect on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3327fc700 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f911b0 0x562aa6ff5210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d55696a2fa35e9f server_cookie=a55bcaaa454049f2 in_seq=0 out_seq=0 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa311ffb700 1 -- 172.21.15.135:0/3764446453 <== mds.0 v2:172.21.15.183:6834/2419873080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x562aa6e99e70 con 0x562aa6f911b0 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa311ffb700 10 client.4440 handle_command_reply: tid=0 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 1 client.4440 shutdown 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f6ebb0 msgr2=0x562aa6f78780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.129+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f6ebb0 0x562aa6f78780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa31c057840 tx=0x7fa31c01e040 comp rx=0 tx=0).stop 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 shutdown_connections 2024-05-08T20:55:07.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x562aa6f911b0 0x562aa6ff5210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562aa6f90dd0 0x562aa6ff47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa6f6ebb0 0x562aa6f78780 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa311ffb700 0 client.4440 ms_handle_reset on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 --2- 172.21.15.135:0/3764446453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x562aa6f720f0 0x562aa6fa5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 >> 172.21.15.135:0/3764446453 conn(0x562aa6eaf1c0 msgr2=0x562aa6f6ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 shutdown_connections 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 1 -- 172.21.15.135:0/3764446453 wait complete. 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa3458bfb80 20 client.4440 trim_cache size 0 max 16384 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T20:55:07.140 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "2800f999-7ad2-4fbf-96c4-2e5fd73f8089", 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4299, 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 7.0628175390000001, 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 7, 2024-05-08T20:55:07.141 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 25, 2024-05-08T20:55:07.142 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 24, 2024-05-08T20:55:07.142 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 13.986902832 2024-05-08T20:55:07.142 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T20:55:07.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa31406ac90 msgr2=0x7fa31406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa31406ac90 0x7fa31406d150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3340c4420 tx=0x7fa324009040 comp rx=0 tx=0).stop 2024-05-08T20:55:07.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 msgr2=0x7fa3340c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c9800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c4e0 tx=0x7fa31c00c8a0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 shutdown_connections 2024-05-08T20:55:07.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa31406ac90 0x7fa31406d150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa334160c50 0x7fa33414d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3340c6780 0x7fa3340c9800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 --2- 172.21.15.135:0/1369036765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa334157990 0x7fa3340c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 >> 172.21.15.135:0/1369036765 conn(0x7fa33406a960 msgr2=0x7fa3341561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 shutdown_connections 2024-05-08T20:55:07.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.130+0000 7fa339705700 1 -- 172.21.15.135:0/1369036765 wait complete. 2024-05-08T20:55:07.147 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:55:07.147 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:07.147 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:55:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.265+0000 7f259c11f700 1 Processor -- start 2024-05-08T20:55:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.266+0000 7f259c11f700 1 -- start start 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.266+0000 7f259c11f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2594072b50 0x7f2594159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.266+0000 7f259c11f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25940cc8c0 con 0x7f25940c6770 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.266+0000 7f259c11f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25940c6c20 con 0x7f25941536d0 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.266+0000 7f259c11f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2594153ab0 con 0x7f2594072b50 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f25996ba700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f2594072b50 0x7f2594159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f259a6bc700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f25940c6770 0x7f259406a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:47980/0 (socket says 172.21.15.135:47980) 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f259a6bc700 1 -- 172.21.15.135:0/3180796160 learned_addr learned my addr 172.21.15.135:0/3180796160 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f25996ba700 1 -- 172.21.15.135:0/3180796160 >> v1:172.21.15.183:6789/0 conn(0x7f25941536d0 legacy=0x7f259415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f25996ba700 1 -- 172.21.15.135:0/3180796160 >> v1:172.21.15.135:6789/0 conn(0x7f25940c6770 legacy=0x7f259406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f25996ba700 1 -- 172.21.15.135:0/3180796160 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940cc380 con 0x7f2594072b50 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f2598eb9700 1 -- 172.21.15.135:0/3180796160 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861663749 0 0) 0x7f25940cc8c0 con 0x7f25940c6770 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f25996ba700 1 --2- 172.21.15.135:0/3180796160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2594072b50 0x7f2594159f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2590009840 tx=0x7f2590009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7480f4582a51692f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f2598eb9700 1 -- 172.21.15.135:0/3180796160 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590004230 con 0x7f2594072b50 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f2598eb9700 1 -- 172.21.15.135:0/3180796160 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590004390 con 0x7f2594072b50 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.267+0000 7f2598eb9700 1 -- 172.21.15.135:0/3180796160 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25900036a0 con 0x7f2594072b50 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.268+0000 7f259c11f700 1 -- 172.21.15.135:0/3180796160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2594072b50 msgr2=0x7f2594159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.268+0000 7f259c11f700 1 --2- 172.21.15.135:0/3180796160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2594072b50 0x7f2594159f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2590009840 tx=0x7f2590009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.268+0000 7f259c11f700 1 -- 172.21.15.135:0/3180796160 shutdown_connections 2024-05-08T20:55:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.268+0000 7f259c11f700 1 --2- 172.21.15.135:0/3180796160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2594072b50 0x7f2594159f90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.268+0000 7f259c11f700 1 -- 172.21.15.135:0/3180796160 >> 172.21.15.135:0/3180796160 conn(0x7f259406daf0 msgr2=0x7f259406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.268+0000 7f259c11f700 1 -- 172.21.15.135:0/3180796160 shutdown_connections 2024-05-08T20:55:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.268+0000 7f259c11f700 1 -- 172.21.15.135:0/3180796160 wait complete. 2024-05-08T20:55:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.269+0000 7f259c11f700 1 Processor -- start 2024-05-08T20:55:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.269+0000 7f259c11f700 1 -- start start 2024-05-08T20:55:07.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594072b50 0x7f25940c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25940c6770 0x7f25941510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25941536d0 0x7f2594151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25941f2e00 con 0x7f25940c6770 2024-05-08T20:55:07.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2594150950 con 0x7f2594072b50 2024-05-08T20:55:07.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25941f3310 con 0x7f25941536d0 2024-05-08T20:55:07.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25940c6770 0x7f25941510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25940c6770 0x7f25941510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50508/0 (socket says 172.21.15.135:50508) 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 -- 172.21.15.135:0/52156385 learned_addr learned my addr 172.21.15.135:0/52156385 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259a6bc700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25941536d0 0x7f2594151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f2599ebb700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594072b50 0x7f25940c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 -- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25941536d0 msgr2=0x7f2594151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25941536d0 0x7f2594151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 -- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594072b50 msgr2=0x7f25940c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594072b50 0x7f25940c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 -- 172.21.15.135:0/52156385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25900094a0 con 0x7f25940c6770 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f25996ba700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25940c6770 0x7f25941510c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f259406ead0 tx=0x7f2590004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f258a7fc700 1 -- 172.21.15.135:0/52156385 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590011630 con 0x7f25940c6770 2024-05-08T20:55:07.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f258a7fc700 1 -- 172.21.15.135:0/52156385 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259001e070 con 0x7f25940c6770 2024-05-08T20:55:07.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25941f3030 con 0x7f25940c6770 2024-05-08T20:55:07.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f258a7fc700 1 -- 172.21.15.135:0/52156385 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25900119f0 con 0x7f25940c6770 2024-05-08T20:55:07.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.270+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25940c7330 con 0x7f25940c6770 2024-05-08T20:55:07.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.271+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259415ce90 con 0x7f25940c6770 2024-05-08T20:55:07.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.272+0000 7f258a7fc700 1 -- 172.21.15.135:0/52156385 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2590011b50 con 0x7f25940c6770 2024-05-08T20:55:07.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.272+0000 7f258a7fc700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f257806acc0 0x7f257806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:07.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.272+0000 7f258a7fc700 1 -- 172.21.15.135:0/52156385 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f259008aa50 con 0x7f25940c6770 2024-05-08T20:55:07.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.272+0000 7f2599ebb700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f257806acc0 0x7f257806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:07.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.272+0000 7f2599ebb700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f257806acc0 0x7f257806d180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2584009870 tx=0x7f2584008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:07.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.276+0000 7f258a7fc700 1 -- 172.21.15.135:0/52156385 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25900559f0 con 0x7f25940c6770 2024-05-08T20:55:07.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.518+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f259415ce90 con 0x7f25940c6770 2024-05-08T20:55:07.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.519+0000 7f258a7fc700 1 -- 172.21.15.135:0/52156385 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2590020070 con 0x7f25940c6770 2024-05-08T20:55:07.522 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T20:55:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f257806acc0 msgr2=0x7f257806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f257806acc0 0x7f257806d180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2584009870 tx=0x7f2584008040 comp rx=0 tx=0).stop 2024-05-08T20:55:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25940c6770 msgr2=0x7f25941510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25940c6770 0x7f25941510c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f259406ead0 tx=0x7f2590004750 comp rx=0 tx=0).stop 2024-05-08T20:55:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 shutdown_connections 2024-05-08T20:55:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f257806acc0 0x7f257806d180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2594072b50 0x7f25940c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25941536d0 0x7f2594151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 --2- 172.21.15.135:0/52156385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25940c6770 0x7f25941510c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:07.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 >> 172.21.15.135:0/52156385 conn(0x7f259406daf0 msgr2=0x7f259415d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:07.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 shutdown_connections 2024-05-08T20:55:07.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:07.521+0000 7f259c11f700 1 -- 172.21.15.135:0/52156385 wait complete. 2024-05-08T20:55:07.536 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-08T20:55:07.536 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:55:07.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-05-08T20:55:07.537 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-08T20:55:07.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:07.537 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-08T20:55:07.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:55:07.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:55:07.537 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T20:55:07.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:07.537 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-05-08T20:55:07.555 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:55:07.555 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:55:07.555 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:55:07.555 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:55:07.555 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42295sec preferred_lft 42295sec 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::7646:fe7f:32d6:e733/64 scope link noprefixroute 2024-05-08T20:55:07.556 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:55:07.557 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T20:55:07.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:07.557 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:07.557 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:07.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-05-08T20:55:07.558 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-05-08T20:55:07.558 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-05-08T20:55:07.558 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T20:55:07.558 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:07.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:07.727 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:55:07.755 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-05-08T20:55:07.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:07.757 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-05-08T20:55:07.828 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-05-08T20:55:07.829 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:55:07.829 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:55:07.829 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T20:55:07.829 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:55:07.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:07.829 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:07.829 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:07.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:55:07.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:55:07.830 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:55:07.830 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:08.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:08.073 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-08T20:55:08.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:08.092 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-05-08T20:55:08.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:08.149 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:08.149 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:08.149 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T20:55:08.149 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-08T20:55:08.150 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:08.245 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-08T20:55:08.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:08.245 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:08.246 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:08.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-08T20:55:08.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T20:55:08.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-08T20:55:08.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-08T20:55:08.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-08T20:55:08.246 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:08.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:08.465 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:08.465 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:08.465 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-05-08T20:55:08.466 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T20:55:08.466 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:08.563 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-08T20:55:08.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:55:08.563 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:08.580 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T20:55:08.581 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:55:08.581 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:08.638 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-08T20:55:08.705 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:55:08.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:55:08.772 INFO:teuthology.orchestra.run.smithi135.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:55:08.773 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:55:08.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:08.774 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-08T20:55:08.832 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T20:55:08.832 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-08T20:55:08.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-08T20:55:08.901 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:55:08.902 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:55:08.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:2024-05-08T20:55:08.961+0000 7f4561bda5c0 -1 init, newargv = 0x55c464a38360 newargc=15 2024-05-08T20:55:08.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[55266]: starting ceph client 2024-05-08T20:55:08.968 INFO:teuthology.orchestra.run.smithi135.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:55:08.969 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:55:08.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:08.970 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-08T20:55:08.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[55266]: starting fuse 2024-05-08T20:55:08.987 INFO:teuthology.orchestra.run.smithi135.stdout:47 2024-05-08T20:55:08.987 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-05-08T20:55:08.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> import re 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> import os 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:08.988 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> return f 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.admin")) 2024-05-08T20:55:08.989 DEBUG:teuthology.orchestra.run.smithi135:> ' 2024-05-08T20:55:09.112 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.admin.55266.asok 2024-05-08T20:55:09.294 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.55266.asok 2024-05-08T20:55:09.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:09.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.55266.asok status 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "admin", 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "55266", 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2024-05-08T20:55:09.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4455, 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 4455 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1113230841 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T20:55:09.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1113230841 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.4455 192.168.0.1:0/1113230841", 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/1113230841", 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 7, 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 25, 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2024-05-08T20:55:09.454 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T20:55:09.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:09.462 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2024-05-08T20:55:09.462 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:09.480 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2024-05-08T20:55:09.480 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:09.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:09.480 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:09.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:09.549 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-08T20:55:09.656 INFO:teuthology.orchestra.run.smithi135.stdout:# file: . 2024-05-08T20:55:09.656 INFO:teuthology.orchestra.run.smithi135.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-08T20:55:09.656 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:09.657 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:55:09.657 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:55:09.674 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:09.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.833+0000 7fb79e063700 1 Processor -- start 2024-05-08T20:55:09.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.833+0000 7fb79e063700 1 -- start start 2024-05-08T20:55:09.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb79e063700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7981535a0 0x7fb79806a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:09.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb79e063700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7980cbf50 0x7fb79806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:09.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb79e063700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79815c990 con 0x7fb798072ae0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb79e063700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79815cbc0 con 0x7fb7981535a0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb79e063700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79815ce60 con 0x7fb7980cbf50 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7977fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb7981535a0 0x7fb79806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb797fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb798072ae0 0x7fb7980c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:47988/0 (socket says 172.21.15.135:47988) 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb797fff700 1 -- 172.21.15.135:0/797938254 learned_addr learned my addr 172.21.15.135:0/797938254 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb796ffd700 1 --2- 172.21.15.135:0/797938254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7980cbf50 0x7fb79806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7977fe700 1 -- 172.21.15.135:0/797938254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7980cbf50 msgr2=0x7fb79806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7977fe700 1 --2- 172.21.15.135:0/797938254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7980cbf50 0x7fb79806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7977fe700 1 -- 172.21.15.135:0/797938254 >> v1:172.21.15.135:6789/0 conn(0x7fb798072ae0 legacy=0x7fb7980c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7967fc700 1 -- 172.21.15.135:0/797938254 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884899721 0 0) 0x7fb79815c990 con 0x7fb798072ae0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7977fe700 1 -- 172.21.15.135:0/797938254 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79815d140 con 0x7fb7981535a0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7977fe700 1 --2- 172.21.15.135:0/797938254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7981535a0 0x7fb79806a960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb788009840 tx=0x7fb788009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89e4e019fb10144 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.834+0000 7fb7967fc700 1 -- 172.21.15.135:0/797938254 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788011830 con 0x7fb7981535a0 2024-05-08T20:55:09.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb7967fc700 1 -- 172.21.15.135:0/797938254 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb788011990 con 0x7fb7981535a0 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb7967fc700 1 -- 172.21.15.135:0/797938254 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788011d20 con 0x7fb7981535a0 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 -- 172.21.15.135:0/797938254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7981535a0 msgr2=0x7fb79806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 --2- 172.21.15.135:0/797938254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7981535a0 0x7fb79806a960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb788009840 tx=0x7fb788009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 -- 172.21.15.135:0/797938254 shutdown_connections 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 --2- 172.21.15.135:0/797938254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7981535a0 0x7fb79806a960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 --2- 172.21.15.135:0/797938254 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7980cbf50 0x7fb79806aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 -- 172.21.15.135:0/797938254 >> 172.21.15.135:0/797938254 conn(0x7fb79806daf0 msgr2=0x7fb79806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 -- 172.21.15.135:0/797938254 shutdown_connections 2024-05-08T20:55:09.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.835+0000 7fb79e063700 1 -- 172.21.15.135:0/797938254 wait complete. 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.836+0000 7fb79e063700 1 Processor -- start 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb79e063700 1 -- start start 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb79e063700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb798072ae0 0x7fb798155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb79e063700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7980cbf50 0x7fb7980cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb79e063700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7981535a0 0x7fb798149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb79e063700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7981556c0 con 0x7fb7980cbf50 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb79e063700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7981f2340 con 0x7fb7981535a0 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb79e063700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7981f25e0 con 0x7fb798072ae0 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb796ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7980cbf50 0x7fb7980cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:09.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb796ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7980cbf50 0x7fb7980cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50538/0 (socket says 172.21.15.135:50538) 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb796ffd700 1 -- 172.21.15.135:0/3757681798 learned_addr learned my addr 172.21.15.135:0/3757681798 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb797fff700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7981535a0 0x7fb798149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.837+0000 7fb7977fe700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb798072ae0 0x7fb798155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb796ffd700 1 -- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb798072ae0 msgr2=0x7fb798155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb796ffd700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb798072ae0 0x7fb798155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb796ffd700 1 -- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7981535a0 msgr2=0x7fb798149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb796ffd700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7981535a0 0x7fb798149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb796ffd700 1 -- 172.21.15.135:0/3757681798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880094a0 con 0x7fb7980cbf50 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb797fff700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7981535a0 0x7fb798149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb796ffd700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7980cbf50 0x7fb7980cac10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00e810 tx=0x7fb78c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:09.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb77ffff700 1 -- 172.21.15.135:0/3757681798 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c013610 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb77ffff700 1 -- 172.21.15.135:0/3757681798 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c013770 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7981f28c0 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb77ffff700 1 -- 172.21.15.135:0/3757681798 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c013b20 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.838+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79806c1e0 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.839+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7980c33c0 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.839+0000 7fb77ffff700 1 -- 172.21.15.135:0/3757681798 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb78c013c80 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.840+0000 7fb77ffff700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb78406acc0 0x7fb78406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.840+0000 7fb77ffff700 1 -- 172.21.15.135:0/3757681798 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb78c0892b0 con 0x7fb7980cbf50 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.840+0000 7fb7977fe700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb78406acc0 0x7fb78406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:09.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.840+0000 7fb7977fe700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb78406acc0 0x7fb78406d180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb7880090b0 tx=0x7fb788008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:09.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:09.844+0000 7fb77ffff700 1 -- 172.21.15.135:0/3757681798 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb78c0541b0 con 0x7fb7980cbf50 2024-05-08T20:55:10.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.041+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7981f30c0 con 0x7fb7980cbf50 2024-05-08T20:55:10.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.042+0000 7fb77ffff700 1 -- 172.21.15.135:0/3757681798 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fb78c0577d0 con 0x7fb7980cbf50 2024-05-08T20:55:10.045 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:10.045 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:10.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb78406acc0 msgr2=0x7fb78406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb78406acc0 0x7fb78406d180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb7880090b0 tx=0x7fb788008030 comp rx=0 tx=0).stop 2024-05-08T20:55:10.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7980cbf50 msgr2=0x7fb7980cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7980cbf50 0x7fb7980cac10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00e810 tx=0x7fb78c00ebd0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 shutdown_connections 2024-05-08T20:55:10.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb78406acc0 0x7fb78406d180 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7981535a0 0x7fb798149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb798072ae0 0x7fb798155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 --2- 172.21.15.135:0/3757681798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7980cbf50 0x7fb7980cac10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 >> 172.21.15.135:0/3757681798 conn(0x7fb79806daf0 msgr2=0x7fb79806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:10.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 shutdown_connections 2024-05-08T20:55:10.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.044+0000 7fb79e063700 1 -- 172.21.15.135:0/3757681798 wait complete. 2024-05-08T20:55:10.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:54:57.947571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:54:58.988583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T20:55:02.098509+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T20:55:10.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:55:10.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.181+0000 7f0b1c554700 1 Processor -- start 2024-05-08T20:55:10.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.181+0000 7f0b1c554700 1 -- start start 2024-05-08T20:55:10.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1c554700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b14153650 0x7f0b140c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1c554700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0b140c9da0 0x7f0b1415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1c554700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b14159570 con 0x7f0b14153270 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1c554700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1415a160 con 0x7f0b14153650 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1c554700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b141597c0 con 0x7f0b140c9da0 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b19aef700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0b14153650 0x7f0b140c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1a2f0700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0b14153270 0x7f0b14070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:47998/0 (socket says 172.21.15.135:47998) 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1a2f0700 1 -- 172.21.15.135:0/79285157 learned_addr learned my addr 172.21.15.135:0/79285157 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b1aaf1700 1 --2- 172.21.15.135:0/79285157 >> v2:172.21.15.183:3300/0 conn(0x7f0b140c9da0 0x7f0b1415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b19aef700 1 -- 172.21.15.135:0/79285157 >> v2:172.21.15.183:3300/0 conn(0x7f0b140c9da0 msgr2=0x7f0b1415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b19aef700 1 --2- 172.21.15.135:0/79285157 >> v2:172.21.15.183:3300/0 conn(0x7f0b140c9da0 0x7f0b1415ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b19aef700 1 -- 172.21.15.135:0/79285157 >> v1:172.21.15.135:6789/0 conn(0x7f0b14153270 legacy=0x7f0b14070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b19aef700 1 -- 172.21.15.135:0/79285157 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b14159aa0 con 0x7f0b14153650 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.182+0000 7f0b192ee700 1 -- 172.21.15.135:0/79285157 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673675737 0 0) 0x7f0b14159570 con 0x7f0b14153270 2024-05-08T20:55:10.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b19aef700 1 --2- 172.21.15.135:0/79285157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b140c9080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b1415dae0 tx=0x7f0b10009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ec1e19fdabd1f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b192ee700 1 -- 172.21.15.135:0/79285157 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011830 con 0x7f0b14153650 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b192ee700 1 -- 172.21.15.135:0/79285157 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b10011990 con 0x7f0b14153650 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b192ee700 1 -- 172.21.15.135:0/79285157 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011d20 con 0x7f0b14153650 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 -- 172.21.15.135:0/79285157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 msgr2=0x7f0b140c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 --2- 172.21.15.135:0/79285157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b140c9080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0b1415dae0 tx=0x7f0b10009b20 comp rx=0 tx=0).stop 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 -- 172.21.15.135:0/79285157 shutdown_connections 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 --2- 172.21.15.135:0/79285157 >> v2:172.21.15.183:3300/0 conn(0x7f0b140c9da0 0x7f0b1415ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 --2- 172.21.15.135:0/79285157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b140c9080 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 -- 172.21.15.135:0/79285157 >> 172.21.15.135:0/79285157 conn(0x7f0b14066d70 msgr2=0x7f0b1406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 -- 172.21.15.135:0/79285157 shutdown_connections 2024-05-08T20:55:10.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.183+0000 7f0b1c554700 1 -- 172.21.15.135:0/79285157 wait complete. 2024-05-08T20:55:10.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 Processor -- start 2024-05-08T20:55:10.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 -- start start 2024-05-08T20:55:10.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b140c9da0 0x7f0b141579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b14153270 0x7f0b1415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b141f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14144670 con 0x7f0b14153650 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14144b00 con 0x7f0b140c9da0 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1c554700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1415d8a0 con 0x7f0b14153270 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1aaf1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b141f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1aaf1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b141f1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50568/0 (socket says 172.21.15.135:50568) 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.185+0000 7f0b1aaf1700 1 -- 172.21.15.135:0/1669452945 learned_addr learned my addr 172.21.15.135:0/1669452945 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b19aef700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b14153270 0x7f0b1415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1a2f0700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b140c9da0 0x7f0b141579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1aaf1700 1 -- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b14153270 msgr2=0x7f0b1415a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1aaf1700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b14153270 0x7f0b1415a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1aaf1700 1 -- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b140c9da0 msgr2=0x7f0b141579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1aaf1700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b140c9da0 0x7f0b141579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1aaf1700 1 -- 172.21.15.135:0/1669452945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100094a0 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1aaf1700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b141f1d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c007e70 tx=0x7f0b0c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b0affd700 1 -- 172.21.15.135:0/1669452945 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00ed30 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b0affd700 1 -- 172.21.15.135:0/1669452945 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00eeb0 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b0affd700 1 -- 172.21.15.135:0/1669452945 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c014640 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1415d600 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.186+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b14144020 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.187+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b14067fa0 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.187+0000 7f0b0affd700 1 -- 172.21.15.135:0/1669452945 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b0c0147a0 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.188+0000 7f0b0affd700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0af806ac90 0x7f0af806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.188+0000 7f0b0affd700 1 -- 172.21.15.135:0/1669452945 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b0c089e10 con 0x7f0b14153650 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.188+0000 7f0b1a2f0700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0af806ac90 0x7f0af806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.188+0000 7f0b1a2f0700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0af806ac90 0x7f0af806d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b04007fd0 tx=0x7f0b04007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.192+0000 7f0b0affd700 1 -- 172.21.15.135:0/1669452945 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0b0c054c70 con 0x7f0b14153650 2024-05-08T20:55:10.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.386+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b141447b0 con 0x7f0b14153650 2024-05-08T20:55:10.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.387+0000 7f0b0affd700 1 -- 172.21.15.135:0/1669452945 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b0c058290 con 0x7f0b14153650 2024-05-08T20:55:10.389 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0af806ac90 msgr2=0x7f0af806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0af806ac90 0x7f0af806d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0b04007fd0 tx=0x7f0b04007de0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 msgr2=0x7f0b141f1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b141f1d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c007e70 tx=0x7f0b0c00e3c0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 shutdown_connections 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0af806ac90 0x7f0af806d150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b140c9da0 0x7f0b141579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b14153650 0x7f0b141f1d20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 --2- 172.21.15.135:0/1669452945 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b14153270 0x7f0b1415a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 >> 172.21.15.135:0/1669452945 conn(0x7f0b14066d70 msgr2=0x7f0b14147fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:10.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 shutdown_connections 2024-05-08T20:55:10.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.389+0000 7f0b1c554700 1 -- 172.21.15.135:0/1669452945 wait complete. 2024-05-08T20:55:10.403 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:55:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.526+0000 7f8de3892700 1 Processor -- start 2024-05-08T20:55:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.526+0000 7f8de3892700 1 -- start start 2024-05-08T20:55:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de3892700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8ddc1635b0 0x7f8ddc1668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de3892700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8ddc0c5a40 0x7f8ddc0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de3892700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc0ca840 0x7f8ddc0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de3892700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc0c2510 con 0x7f8ddc0c5a40 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de3892700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc0cb210 con 0x7f8ddc1635b0 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de3892700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc1695c0 con 0x7f8ddc0ca840 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de0e2d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8ddc0c5a40 0x7f8ddc0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de0e2d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8ddc0c5a40 0x7f8ddc0c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50580/0 (socket says 172.21.15.135:50580) 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de0e2d700 1 -- 172.21.15.135:0/1854549005 learned_addr learned my addr 172.21.15.135:0/1854549005 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de1e2f700 1 --2- 172.21.15.135:0/1854549005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc0ca840 0x7f8ddc0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.527+0000 7f8de162e700 1 --2- 172.21.15.135:0/1854549005 >> v2:172.21.15.183:3300/0 conn(0x7f8ddc1635b0 0x7f8ddc1668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de0e2d700 1 -- 172.21.15.135:0/1854549005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc0ca840 msgr2=0x7f8ddc0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de0e2d700 1 --2- 172.21.15.135:0/1854549005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc0ca840 0x7f8ddc0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de0e2d700 1 -- 172.21.15.135:0/1854549005 >> v2:172.21.15.183:3300/0 conn(0x7f8ddc1635b0 msgr2=0x7f8ddc1668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de0e2d700 1 --2- 172.21.15.135:0/1854549005 >> v2:172.21.15.183:3300/0 conn(0x7f8ddc1635b0 0x7f8ddc1668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de0e2d700 1 -- 172.21.15.135:0/1854549005 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc169860 con 0x7f8ddc0c5a40 2024-05-08T20:55:10.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de1e2f700 1 --2- 172.21.15.135:0/1854549005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc0ca840 0x7f8ddc0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de162e700 1 --2- 172.21.15.135:0/1854549005 >> v2:172.21.15.183:3300/0 conn(0x7f8ddc1635b0 0x7f8ddc1668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8de0e2d700 1 --2- 172.21.15.135:0/1854549005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc0c5ea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0c56d0 tx=0x7f8dd800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c951601455b360c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8dd3fff700 1 -- 172.21.15.135:0/1854549005 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800cc60 con 0x7f8ddc0c5a40 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8dd3fff700 1 -- 172.21.15.135:0/1854549005 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd800cdc0 con 0x7f8ddc0c5a40 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.542+0000 7f8dd3fff700 1 -- 172.21.15.135:0/1854549005 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800f680 con 0x7f8ddc0c5a40 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 -- 172.21.15.135:0/1854549005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0c5a40 msgr2=0x7f8ddc0c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 --2- 172.21.15.135:0/1854549005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc0c5ea0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0c56d0 tx=0x7f8dd800bc80 comp rx=0 tx=0).stop 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 -- 172.21.15.135:0/1854549005 shutdown_connections 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 --2- 172.21.15.135:0/1854549005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc0ca840 0x7f8ddc0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 --2- 172.21.15.135:0/1854549005 >> v2:172.21.15.183:3300/0 conn(0x7f8ddc1635b0 0x7f8ddc1668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 --2- 172.21.15.135:0/1854549005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc0c5ea0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 -- 172.21.15.135:0/1854549005 >> 172.21.15.135:0/1854549005 conn(0x7f8ddc06a960 msgr2=0x7f8ddc06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 -- 172.21.15.135:0/1854549005 shutdown_connections 2024-05-08T20:55:10.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.543+0000 7f8de3892700 1 -- 172.21.15.135:0/1854549005 wait complete. 2024-05-08T20:55:10.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 Processor -- start 2024-05-08T20:55:10.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 -- start start 2024-05-08T20:55:10.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc1fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0ca840 0x7f8ddc072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc1635b0 0x7f8ddc0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0c90e0 con 0x7f8ddc0ca840 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc15ec00 con 0x7f8ddc0c5a40 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de3892700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc1fc600 con 0x7f8ddc1635b0 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de0e2d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0ca840 0x7f8ddc072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de0e2d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0ca840 0x7f8ddc072a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50588/0 (socket says 172.21.15.135:50588) 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.545+0000 7f8de0e2d700 1 -- 172.21.15.135:0/344168697 learned_addr learned my addr 172.21.15.135:0/344168697 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de162e700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc1fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de1e2f700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc1635b0 0x7f8ddc0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de0e2d700 1 -- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc1635b0 msgr2=0x7f8ddc0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de0e2d700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc1635b0 0x7f8ddc0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de0e2d700 1 -- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ddc0c5a40 msgr2=0x7f8ddc1fc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de0e2d700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc1fc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de0e2d700 1 -- 172.21.15.135:0/344168697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd800b600 con 0x7f8ddc0ca840 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de1e2f700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc1635b0 0x7f8ddc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:10.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de162e700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc1fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de0e2d700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0ca840 0x7f8ddc072a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8dd1ffb700 1 -- 172.21.15.135:0/344168697 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd801c070 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8dd1ffb700 1 -- 172.21.15.135:0/344168697 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd8004050 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc15e080 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8dd1ffb700 1 -- 172.21.15.135:0/344168697 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8004400 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.546+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc15e640 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.547+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc06e670 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.548+0000 7f8dd1ffb700 1 -- 172.21.15.135:0/344168697 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8dd80036a0 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.548+0000 7f8dd1ffb700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8dc006ac90 0x7f8dc006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.548+0000 7f8dd1ffb700 1 -- 172.21.15.135:0/344168697 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8dd808b030 con 0x7f8ddc0ca840 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.548+0000 7f8de162e700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8dc006ac90 0x7f8dc006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.549+0000 7f8de162e700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8dc006ac90 0x7f8dc006d150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc007fa0 tx=0x7f8dcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.553+0000 7f8dd1ffb700 1 -- 172.21.15.135:0/344168697 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8dd8055f30 con 0x7f8ddc0ca840 2024-05-08T20:55:10.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.750+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ddc067890 con 0x7f8ddc0ca840 2024-05-08T20:55:10.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.751+0000 7f8dd1ffb700 1 -- 172.21.15.135:0/344168697 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dd8059550 con 0x7f8ddc0ca840 2024-05-08T20:55:10.754 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8dc006ac90 msgr2=0x7f8dc006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8dc006ac90 0x7f8dc006d150 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc007fa0 tx=0x7f8dcc009040 comp rx=0 tx=0).stop 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0ca840 msgr2=0x7f8ddc072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0ca840 0x7f8ddc072a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd8004750 comp rx=0 tx=0).stop 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 shutdown_connections 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8dc006ac90 0x7f8dc006d150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ddc0c5a40 0x7f8ddc1fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ddc1635b0 0x7f8ddc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 --2- 172.21.15.135:0/344168697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ddc0ca840 0x7f8ddc072a20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 >> 172.21.15.135:0/344168697 conn(0x7f8ddc06a960 msgr2=0x7f8ddc162780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 shutdown_connections 2024-05-08T20:55:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.753+0000 7f8de3892700 1 -- 172.21.15.135:0/344168697 wait complete. 2024-05-08T20:55:10.768 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:55:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.889+0000 7fda2dc90700 1 Processor -- start 2024-05-08T20:55:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.889+0000 7fda2dc90700 1 -- start start 2024-05-08T20:55:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.890+0000 7fda2dc90700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda28153810 0x7fda2806bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.890+0000 7fda2dc90700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2806ba70 con 0x7fda28070d60 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.890+0000 7fda2dc90700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda280c7a40 con 0x7fda28071140 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.890+0000 7fda2dc90700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2815a240 con 0x7fda28153810 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.890+0000 7fda277fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fda28070d60 0x7fda280c7330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:48000/0 (socket says 172.21.15.135:48000) 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.890+0000 7fda277fe700 1 -- 172.21.15.135:0/1956188640 learned_addr learned my addr 172.21.15.135:0/1956188640 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda27fff700 1 --2- 172.21.15.135:0/1956188640 >> v2:172.21.15.183:3300/0 conn(0x7fda28153810 0x7fda2806bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda267fc700 1 -- 172.21.15.135:0/1956188640 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259852817 0 0) 0x7fda2806ba70 con 0x7fda28070d60 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda267fc700 1 -- 172.21.15.135:0/1956188640 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda140035b0 con 0x7fda28070d60 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda27fff700 1 -- 172.21.15.135:0/1956188640 >> v1:172.21.15.183:6789/0 conn(0x7fda28071140 legacy=0x7fda28153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda267fc700 1 -- 172.21.15.135:0/1956188640 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2713922591 0 0) 0x7fda140035b0 con 0x7fda28070d60 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda27fff700 1 -- 172.21.15.135:0/1956188640 >> v1:172.21.15.135:6789/0 conn(0x7fda28070d60 legacy=0x7fda280c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda27fff700 1 -- 172.21.15.135:0/1956188640 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2815ca90 con 0x7fda28153810 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda27fff700 1 --2- 172.21.15.135:0/1956188640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28153810 0x7fda2806bf00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda20009d90 tx=0x7fda2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=607fbcd0c28cf0ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda267fc700 1 -- 172.21.15.135:0/1956188640 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2000e070 con 0x7fda28153810 2024-05-08T20:55:10.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda267fc700 1 -- 172.21.15.135:0/1956188640 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda20003a20 con 0x7fda28153810 2024-05-08T20:55:10.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.891+0000 7fda267fc700 1 -- 172.21.15.135:0/1956188640 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10001670 con 0x7fda28153810 2024-05-08T20:55:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.892+0000 7fda2dc90700 1 -- 172.21.15.135:0/1956188640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28153810 msgr2=0x7fda2806bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.892+0000 7fda2dc90700 1 --2- 172.21.15.135:0/1956188640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28153810 0x7fda2806bf00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda20009d90 tx=0x7fda2000b330 comp rx=0 tx=0).stop 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.892+0000 7fda2dc90700 1 -- 172.21.15.135:0/1956188640 shutdown_connections 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.892+0000 7fda2dc90700 1 --2- 172.21.15.135:0/1956188640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28153810 0x7fda2806bf00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.892+0000 7fda2dc90700 1 -- 172.21.15.135:0/1956188640 >> 172.21.15.135:0/1956188640 conn(0x7fda28066d70 msgr2=0x7fda2806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.892+0000 7fda2dc90700 1 -- 172.21.15.135:0/1956188640 shutdown_connections 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.892+0000 7fda2dc90700 1 -- 172.21.15.135:0/1956188640 wait complete. 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.893+0000 7fda2dc90700 1 Processor -- start 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.893+0000 7fda2dc90700 1 -- start start 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda2dc90700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda28070d60 0x7fda281f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda2dc90700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28071140 0x7fda281efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda2dc90700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda28153810 0x7fda281f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda2dc90700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281527d0 con 0x7fda28070d60 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda2dc90700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280cd310 con 0x7fda28071140 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda2dc90700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda281f2d10 con 0x7fda28153810 2024-05-08T20:55:10.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda28070d60 0x7fda281f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda28070d60 0x7fda281f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50594/0 (socket says 172.21.15.135:50594) 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 -- 172.21.15.135:0/2817985196 learned_addr learned my addr 172.21.15.135:0/2817985196 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda27fff700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda28153810 0x7fda281f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda26ffd700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28071140 0x7fda281efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 -- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda28153810 msgr2=0x7fda281f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda28153810 0x7fda281f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 -- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28071140 msgr2=0x7fda281efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28071140 0x7fda281efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 -- 172.21.15.135:0/2817985196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20009a70 con 0x7fda28070d60 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.894+0000 7fda277fe700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda28070d60 0x7fda281f2070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda100011e0 tx=0x7fda1000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.895+0000 7fda1ffff700 1 -- 172.21.15.135:0/2817985196 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10004c80 con 0x7fda28070d60 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.895+0000 7fda1ffff700 1 -- 172.21.15.135:0/2817985196 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10004de0 con 0x7fda28070d60 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.895+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda280cd030 con 0x7fda28070d60 2024-05-08T20:55:10.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.895+0000 7fda1ffff700 1 -- 172.21.15.135:0/2817985196 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100072d0 con 0x7fda28070d60 2024-05-08T20:55:10.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.895+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280c8e40 con 0x7fda28070d60 2024-05-08T20:55:10.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.896+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda28067fa0 con 0x7fda28070d60 2024-05-08T20:55:10.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.896+0000 7fda1ffff700 1 -- 172.21.15.135:0/2817985196 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda10007430 con 0x7fda28070d60 2024-05-08T20:55:10.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.897+0000 7fda1ffff700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fda0806acc0 0x7fda0806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:10.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.897+0000 7fda1ffff700 1 -- 172.21.15.135:0/2817985196 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda10089320 con 0x7fda28070d60 2024-05-08T20:55:10.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.897+0000 7fda26ffd700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fda0806acc0 0x7fda0806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:10.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.897+0000 7fda26ffd700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fda0806acc0 0x7fda0806d180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda280c95a0 tx=0x7fda18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:10.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:10.901+0000 7fda1ffff700 1 -- 172.21.15.135:0/2817985196 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fda10054210 con 0x7fda28070d60 2024-05-08T20:55:11.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.099+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda28153330 con 0x7fda28070d60 2024-05-08T20:55:11.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.099+0000 7fda1ffff700 1 -- 172.21.15.135:0/2817985196 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda10057830 con 0x7fda28070d60 2024-05-08T20:55:11.102 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.101+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fda0806acc0 msgr2=0x7fda0806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.101+0000 7fda2dc90700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fda0806acc0 0x7fda0806d180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fda280c95a0 tx=0x7fda18009040 comp rx=0 tx=0).stop 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.101+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda28070d60 msgr2=0x7fda281f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.101+0000 7fda2dc90700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda28070d60 0x7fda281f2070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda100011e0 tx=0x7fda1000ca50 comp rx=0 tx=0).stop 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 shutdown_connections 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fda0806acc0 0x7fda0806d180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda28153810 0x7fda281f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda28070d60 0x7fda281f2070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 --2- 172.21.15.135:0/2817985196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda28071140 0x7fda281efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 >> 172.21.15.135:0/2817985196 conn(0x7fda28066d70 msgr2=0x7fda280c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 shutdown_connections 2024-05-08T20:55:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.102+0000 7fda2dc90700 1 -- 172.21.15.135:0/2817985196 wait complete. 2024-05-08T20:55:11.118 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T20:55:11.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.238+0000 7f13c3a9d700 1 Processor -- start 2024-05-08T20:55:11.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.238+0000 7f13c3a9d700 1 -- start start 2024-05-08T20:55:11.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c3a9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f13bc151400 0x7f13bc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c3a9d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f13bc0c9e80 0x7f13bc070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c3a9d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc15b620 con 0x7f13bc071030 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c3a9d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0c1b20 con 0x7f13bc151400 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c3a9d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0cd8e0 con 0x7f13bc0c9e80 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c1839700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f13bc151400 0x7f13bc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c203a700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f13bc071030 0x7f13bc0c1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:48016/0 (socket says 172.21.15.135:48016) 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c203a700 1 -- 172.21.15.135:0/2293583312 learned_addr learned my addr 172.21.15.135:0/2293583312 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c1038700 1 --2- 172.21.15.135:0/2293583312 >> v2:172.21.15.183:3300/0 conn(0x7f13bc0c9e80 0x7f13bc070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c1839700 1 -- 172.21.15.135:0/2293583312 >> v2:172.21.15.183:3300/0 conn(0x7f13bc0c9e80 msgr2=0x7f13bc070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c1839700 1 --2- 172.21.15.135:0/2293583312 >> v2:172.21.15.183:3300/0 conn(0x7f13bc0c9e80 0x7f13bc070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c1839700 1 -- 172.21.15.135:0/2293583312 >> v1:172.21.15.135:6789/0 conn(0x7f13bc071030 legacy=0x7f13bc0c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c1839700 1 -- 172.21.15.135:0/2293583312 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0ccd60 con 0x7f13bc151400 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c1038700 1 --2- 172.21.15.135:0/2293583312 >> v2:172.21.15.183:3300/0 conn(0x7f13bc0c9e80 0x7f13bc070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.239+0000 7f13c0837700 1 -- 172.21.15.135:0/2293583312 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780339434 0 0) 0x7f13bc15b620 con 0x7f13bc071030 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c1839700 1 --2- 172.21.15.135:0/2293583312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc15b0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0706c0 tx=0x7f13ac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c96db2255c05b3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c0837700 1 -- 172.21.15.135:0/2293583312 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac011830 con 0x7f13bc151400 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c0837700 1 -- 172.21.15.135:0/2293583312 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac011990 con 0x7f13bc151400 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c0837700 1 -- 172.21.15.135:0/2293583312 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac011d20 con 0x7f13bc151400 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 -- 172.21.15.135:0/2293583312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 msgr2=0x7f13bc15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/2293583312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc15b0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0706c0 tx=0x7f13ac009b20 comp rx=0 tx=0).stop 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 -- 172.21.15.135:0/2293583312 shutdown_connections 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/2293583312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc15b0e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/2293583312 >> v2:172.21.15.183:3300/0 conn(0x7f13bc0c9e80 0x7f13bc070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 -- 172.21.15.135:0/2293583312 >> 172.21.15.135:0/2293583312 conn(0x7f13bc066d70 msgr2=0x7f13bc06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:11.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 -- 172.21.15.135:0/2293583312 shutdown_connections 2024-05-08T20:55:11.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.240+0000 7f13c3a9d700 1 -- 172.21.15.135:0/2293583312 wait complete. 2024-05-08T20:55:11.248 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 Processor -- start 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 -- start start 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13bc071030 0x7f13bc1f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13bc0c9e80 0x7f13bc155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc153400 con 0x7f13bc151400 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc157300 con 0x7f13bc0c9e80 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c3a9d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc153a00 con 0x7f13bc071030 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c203a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c203a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50598/0 (socket says 172.21.15.135:50598) 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.242+0000 7f13c203a700 1 -- 172.21.15.135:0/4008142747 learned_addr learned my addr 172.21.15.135:0/4008142747 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c1839700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13bc071030 0x7f13bc1f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c1038700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13bc0c9e80 0x7f13bc155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c203a700 1 -- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13bc071030 msgr2=0x7f13bc1f0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c203a700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13bc071030 0x7f13bc1f0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c203a700 1 -- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13bc0c9e80 msgr2=0x7f13bc155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c203a700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13bc0c9e80 0x7f13bc155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c203a700 1 -- 172.21.15.135:0/4008142747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac0094a0 con 0x7f13bc151400 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c1839700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13bc071030 0x7f13bc1f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c1038700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13bc0c9e80 0x7f13bc155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c203a700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc157790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13b400cc70 tx=0x7f13b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13b27fc700 1 -- 172.21.15.135:0/4008142747 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b400ad40 con 0x7f13bc151400 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13b27fc700 1 -- 172.21.15.135:0/4008142747 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b400ce70 con 0x7f13bc151400 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc1f0e40 con 0x7f13bc151400 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13b27fc700 1 -- 172.21.15.135:0/4008142747 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40072f0 con 0x7f13bc151400 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.243+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc156a60 con 0x7f13bc151400 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.244+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc1574b0 con 0x7f13bc151400 2024-05-08T20:55:11.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.244+0000 7f13b27fc700 1 -- 172.21.15.135:0/4008142747 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13b4007450 con 0x7f13bc151400 2024-05-08T20:55:11.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.245+0000 7f13b27fc700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f13a006ac90 0x7f13a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.245+0000 7f13c1839700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f13a006ac90 0x7f13a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.245+0000 7f13b27fc700 1 -- 172.21.15.135:0/4008142747 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13b40893f0 con 0x7f13bc151400 2024-05-08T20:55:11.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.245+0000 7f13c1839700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f13a006ac90 0x7f13a006d150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0090b0 tx=0x7f13ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:11.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.249+0000 7f13b27fc700 1 -- 172.21.15.135:0/4008142747 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f13bc1574b0 con 0x7f13bc151400 2024-05-08T20:55:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.444+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13bc1574b0 con 0x7f13bc151400 2024-05-08T20:55:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.445+0000 7f13b27fc700 1 -- 172.21.15.135:0/4008142747 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f13bc1574b0 con 0x7f13bc151400 2024-05-08T20:55:11.448 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.446+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f13a006ac90 msgr2=0x7f13a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.446+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f13a006ac90 0x7f13a006d150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0090b0 tx=0x7f13ac008030 comp rx=0 tx=0).stop 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.446+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 msgr2=0x7f13bc157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.446+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc157790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f13b400cc70 tx=0x7f13b400a340 comp rx=0 tx=0).stop 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 shutdown_connections 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f13a006ac90 0x7f13a006d150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13bc151400 0x7f13bc157790 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13bc071030 0x7f13bc1f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 --2- 172.21.15.135:0/4008142747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13bc0c9e80 0x7f13bc155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 >> 172.21.15.135:0/4008142747 conn(0x7f13bc066d70 msgr2=0x7f13bc0c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:11.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 shutdown_connections 2024-05-08T20:55:11.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.447+0000 7f13c3a9d700 1 -- 172.21.15.135:0/4008142747 wait complete. 2024-05-08T20:55:11.462 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T20:55:11.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.581+0000 7fab03dbd700 1 Processor -- start 2024-05-08T20:55:11.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.581+0000 7fab03dbd700 1 -- start start 2024-05-08T20:55:11.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab03dbd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faafc0cb5a0 0x7faafc0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab03dbd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0ccb40 0x7faafc0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab03dbd700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc15a220 con 0x7faafc0cae30 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab03dbd700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc0ce520 con 0x7faafc0cb5a0 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab03dbd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc159400 con 0x7faafc0ccb40 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01b59700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7faafc0cb5a0 0x7faafc0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01358700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7faafc0cae30 0x7faafc0cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:48028/0 (socket says 172.21.15.135:48028) 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01358700 1 -- 172.21.15.135:0/3307031367 learned_addr learned my addr 172.21.15.135:0/3307031367 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab0235a700 1 --2- 172.21.15.135:0/3307031367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0ccb40 0x7faafc0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01b59700 1 -- 172.21.15.135:0/3307031367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0ccb40 msgr2=0x7faafc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:11.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01b59700 1 --2- 172.21.15.135:0/3307031367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0ccb40 0x7faafc0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01b59700 1 -- 172.21.15.135:0/3307031367 >> v1:172.21.15.135:6789/0 conn(0x7faafc0cae30 legacy=0x7faafc0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01b59700 1 -- 172.21.15.135:0/3307031367 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0cd4d0 con 0x7faafc0cb5a0 2024-05-08T20:55:11.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab00b57700 1 -- 172.21.15.135:0/3307031367 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678886678 0 0) 0x7faafc15a220 con 0x7faafc0cae30 2024-05-08T20:55:11.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab01b59700 1 --2- 172.21.15.135:0/3307031367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0cb980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009840 tx=0x7faaf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678b225ea0cffd45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:11.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab00b57700 1 -- 172.21.15.135:0/3307031367 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8011830 con 0x7faafc0cb5a0 2024-05-08T20:55:11.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab00b57700 1 -- 172.21.15.135:0/3307031367 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf8011990 con 0x7faafc0cb5a0 2024-05-08T20:55:11.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.582+0000 7fab00b57700 1 -- 172.21.15.135:0/3307031367 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8011d20 con 0x7faafc0cb5a0 2024-05-08T20:55:11.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 -- 172.21.15.135:0/3307031367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 msgr2=0x7faafc0cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3307031367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0cb980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009840 tx=0x7faaf8009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 -- 172.21.15.135:0/3307031367 shutdown_connections 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3307031367 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0ccb40 0x7faafc0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3307031367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0cb980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 -- 172.21.15.135:0/3307031367 >> 172.21.15.135:0/3307031367 conn(0x7faafc0726c0 msgr2=0x7faafc0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 -- 172.21.15.135:0/3307031367 shutdown_connections 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.583+0000 7fab03dbd700 1 -- 172.21.15.135:0/3307031367 wait complete. 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.584+0000 7fab03dbd700 1 Processor -- start 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.584+0000 7fab03dbd700 1 -- start start 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab03dbd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0cae30 0x7faafc0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab03dbd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab03dbd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc0ccb40 0x7faafc155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab03dbd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0afb30 con 0x7faafc0cb5a0 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab03dbd700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0ab0e0 con 0x7faafc0ccb40 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab03dbd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0ae170 con 0x7faafc0cae30 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0aff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50626/0 (socket says 172.21.15.135:50626) 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 -- 172.21.15.135:0/3181348898 learned_addr learned my addr 172.21.15.135:0/3181348898 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab0235a700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc0ccb40 0x7faafc155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01b59700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0cae30 0x7faafc0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 -- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0cae30 msgr2=0x7faafc0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0cae30 0x7faafc0aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 -- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc0ccb40 msgr2=0x7faafc155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc0ccb40 0x7faafc155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 -- 172.21.15.135:0/3181348898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80094a0 con 0x7faafc0cb5a0 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab0235a700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc0ccb40 0x7faafc155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.585+0000 7fab01358700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0aff50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faaec0011e0 tx=0x7faaec00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.586+0000 7faaf27fc700 1 -- 172.21.15.135:0/3181348898 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec004c80 con 0x7faafc0cb5a0 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.586+0000 7faaf27fc700 1 -- 172.21.15.135:0/3181348898 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec004e00 con 0x7faafc0cb5a0 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.586+0000 7faaf27fc700 1 -- 172.21.15.135:0/3181348898 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec007310 con 0x7faafc0cb5a0 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.586+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc1efa50 con 0x7faafc0cb5a0 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.586+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc0b1300 con 0x7faafc0cb5a0 2024-05-08T20:55:11.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.586+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc0afc70 con 0x7faafc0cb5a0 2024-05-08T20:55:11.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.587+0000 7faaf27fc700 1 -- 172.21.15.135:0/3181348898 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faaec007470 con 0x7faafc0cb5a0 2024-05-08T20:55:11.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.587+0000 7faaf27fc700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faae006ac90 0x7faae006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:11.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.587+0000 7faaf27fc700 1 -- 172.21.15.135:0/3181348898 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faaec0893a0 con 0x7faafc0cb5a0 2024-05-08T20:55:11.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.587+0000 7fab01b59700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faae006ac90 0x7faae006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:11.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.588+0000 7fab01b59700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faae006ac90 0x7faae006d150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faaf80090b0 tx=0x7faaf8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:11.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.592+0000 7faaf27fc700 1 -- 172.21.15.135:0/3181348898 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faafc0afc70 con 0x7faafc0cb5a0 2024-05-08T20:55:11.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.804+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faafc0afc70 con 0x7faafc0cb5a0 2024-05-08T20:55:11.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.804+0000 7faaf27fc700 1 -- 172.21.15.135:0/3181348898 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7faafc0afc70 con 0x7faafc0cb5a0 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faae006ac90 msgr2=0x7faae006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faae006ac90 0x7faae006d150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faaf80090b0 tx=0x7faaf8008030 comp rx=0 tx=0).stop 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 msgr2=0x7faafc0aff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0aff50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faaec0011e0 tx=0x7faaec00cae0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 shutdown_connections 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faae006ac90 0x7faae006d150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc0ccb40 0x7faafc155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0cae30 0x7faafc0aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 --2- 172.21.15.135:0/3181348898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faafc0cb5a0 0x7faafc0aff50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:11.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 >> 172.21.15.135:0/3181348898 conn(0x7faafc0726c0 msgr2=0x7faafc156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:11.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 shutdown_connections 2024-05-08T20:55:11.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.806+0000 7fab03dbd700 1 -- 172.21.15.135:0/3181348898 wait complete. 2024-05-08T20:55:11.810 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-08T20:55:11.821 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:55:11.821 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:55:11.838 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:11.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.997+0000 7f79a28fe700 1 Processor -- start 2024-05-08T20:55:12.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.997+0000 7f79a28fe700 1 -- start start 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.997+0000 7f79a28fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f799c1535a0 0x7f799c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.997+0000 7f79a28fe700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c15c990 con 0x7f799c0c47c0 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f79a28fe700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c15cbc0 con 0x7f799c0cbf50 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f79a28fe700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c15ce60 con 0x7f799c1535a0 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f79a0e9b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f799c0c47c0 0x7f799c163c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:48034/0 (socket says 172.21.15.135:48034) 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f79a0e9b700 1 -- 172.21.15.135:0/3665591242 learned_addr learned my addr 172.21.15.135:0/3665591242 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504255995 0 0) 0x7f799c15c990 con 0x7f799c0c47c0 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799bfff700 1 --2- 172.21.15.135:0/3665591242 >> v2:172.21.15.183:3300/0 conn(0x7f799c1535a0 0x7f799c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79840035b0 con 0x7f799c0c47c0 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946227200 0 0) 0x7f79840035b0 con 0x7f799c0c47c0 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 >> v2:172.21.15.183:3300/0 conn(0x7f799c1535a0 msgr2=0x7f799c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 --2- 172.21.15.135:0/3665591242 >> v2:172.21.15.183:3300/0 conn(0x7f799c1535a0 0x7f799c06a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 >> v1:172.21.15.183:6789/0 conn(0x7f799c0cbf50 legacy=0x7f799c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c15d140 con 0x7f799c0c47c0 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f79940019f0 con 0x7f799c0c47c0 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 >> v1:172.21.15.135:6789/0 conn(0x7f799c0c47c0 legacy=0x7f799c163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f7984003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7984004850 0x7f7984004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7984005210 0x7f798400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c15ce60 con 0x7f7984003a00 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798400c0c0 con 0x7f7984004850 2024-05-08T20:55:12.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798400c280 con 0x7f7984005210 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799bfff700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f7984003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f799b7fe700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7984004850 0x7f7984004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.998+0000 7f79a0e9b700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7984005210 0x7f798400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799bfff700 1 -- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7984005210 msgr2=0x7f798400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799bfff700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7984005210 0x7f798400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799bfff700 1 -- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7984004850 msgr2=0x7f7984004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799bfff700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7984004850 0x7f7984004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f79a0e9b700 1 -- 172.21.15.135:0/3665591242 reap_dead start 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799bfff700 1 -- 172.21.15.135:0/3665591242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840035b0 con 0x7f7984003a00 2024-05-08T20:55:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799bfff700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f7984003e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f798c009b60 tx=0x7f7984005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be693ddd65170b08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00e6c0 con 0x7f7984003a00 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c00e820 con 0x7f7984003a00 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f799affd700 1 -- 172.21.15.135:0/3665591242 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00eb90 con 0x7f7984003a00 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f79a28fe700 1 -- 172.21.15.135:0/3665591242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 msgr2=0x7f7984003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f7984003e20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f798c009b60 tx=0x7f7984005880 comp rx=0 tx=0).stop 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:11.999+0000 7f79a28fe700 1 -- 172.21.15.135:0/3665591242 shutdown_connections 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.000+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3665591242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f7984003e20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.000+0000 7f79a28fe700 1 -- 172.21.15.135:0/3665591242 >> 172.21.15.135:0/3665591242 conn(0x7f799c06daf0 msgr2=0x7f799c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.000+0000 7f79a28fe700 1 -- 172.21.15.135:0/3665591242 shutdown_connections 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.000+0000 7f79a28fe700 1 -- 172.21.15.135:0/3665591242 wait complete. 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.001+0000 7f79a28fe700 1 Processor -- start 2024-05-08T20:55:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.001+0000 7f79a28fe700 1 -- start start 2024-05-08T20:55:12.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f79a28fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f799c14be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f79a28fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f799c14ac60 0x7f799c0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f79a28fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f799c0cade0 0x7f799c145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f79a28fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c147900 con 0x7f7984003a00 2024-05-08T20:55:12.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f79a28fe700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0ca130 con 0x7f799c14ac60 2024-05-08T20:55:12.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f79a28fe700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0c7570 con 0x7f799c0cade0 2024-05-08T20:55:12.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f799c14be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f799c14be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50632/0 (socket says 172.21.15.135:50632) 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 -- 172.21.15.135:0/3058619567 learned_addr learned my addr 172.21.15.135:0/3058619567 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f79a0e9b700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f799c0cade0 0x7f799c145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799b7fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f799c14ac60 0x7f799c0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 -- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f799c0cade0 msgr2=0x7f799c145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f799c0cade0 0x7f799c145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 -- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f799c14ac60 msgr2=0x7f799c0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f799c14ac60 0x7f799c0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.002+0000 7f799bfff700 1 -- 172.21.15.135:0/3058619567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c14b100 con 0x7f7984003a00 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.003+0000 7f799bfff700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f799c14be90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f798c00e4b0 tx=0x7f798c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.003+0000 7f7998ff9700 1 -- 172.21.15.135:0/3058619567 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c00e6c0 con 0x7f7984003a00 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.003+0000 7f7998ff9700 1 -- 172.21.15.135:0/3058619567 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c0038c0 con 0x7f7984003a00 2024-05-08T20:55:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.003+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c14b3a0 con 0x7f7984003a00 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.003+0000 7f7998ff9700 1 -- 172.21.15.135:0/3058619567 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c003c70 con 0x7f7984003a00 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.003+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c0ca380 con 0x7f7984003a00 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.004+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c067fa0 con 0x7f7984003a00 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.004+0000 7f7998ff9700 1 -- 172.21.15.135:0/3058619567 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f798c013470 con 0x7f7984003a00 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.005+0000 7f7998ff9700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f798806acc0 0x7f798806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.005+0000 7f7998ff9700 1 -- 172.21.15.135:0/3058619567 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f798c08aea0 con 0x7f7984003a00 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.005+0000 7f799b7fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f798806acc0 0x7f798806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.005+0000 7f799b7fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f798806acc0 0x7f798806d180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f799c0cb470 tx=0x7f7990009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.009+0000 7f7998ff9700 1 -- 172.21.15.135:0/3058619567 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f798c055f40 con 0x7f7984003a00 2024-05-08T20:55:12.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.212+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f799c146b70 con 0x7f7984003a00 2024-05-08T20:55:12.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.213+0000 7f7998ff9700 1 -- 172.21.15.135:0/3058619567 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f798c017090 con 0x7f7984003a00 2024-05-08T20:55:12.368 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:12.368 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:12.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f798806acc0 msgr2=0x7f798806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f798806acc0 0x7f798806d180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f799c0cb470 tx=0x7f7990009040 comp rx=0 tx=0).stop 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 msgr2=0x7f799c14be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f799c14be90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f798c00e4b0 tx=0x7f798c0047c0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 shutdown_connections 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f798806acc0 0x7f798806d180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f799c0cade0 0x7f799c145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7984003a00 0x7f799c14be90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 --2- 172.21.15.135:0/3058619567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f799c14ac60 0x7f799c0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 >> 172.21.15.135:0/3058619567 conn(0x7f799c06daf0 msgr2=0x7f799c150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 shutdown_connections 2024-05-08T20:55:12.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.216+0000 7f79a28fe700 1 -- 172.21.15.135:0/3058619567 wait complete. 2024-05-08T20:55:12.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:54:57.947571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:54:58.988583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T20:55:02.098509+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T20:55:12.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:55:12.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.495+0000 7fc5833e7700 1 Processor -- start 2024-05-08T20:55:12.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.496+0000 7fc5833e7700 1 -- start start 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.496+0000 7fc5833e7700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc57c153270 0x7fc57c0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.496+0000 7fc5833e7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc57c153650 0x7fc57c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.496+0000 7fc5833e7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c159570 con 0x7fc57c0c9da0 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.496+0000 7fc5833e7700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c15a160 con 0x7fc57c153270 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.496+0000 7fc5833e7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c1597c0 con 0x7fc57c153650 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.496+0000 7fc581183700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc57c153270 0x7fc57c0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc581183700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc57c153270 0x7fc57c0c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49426/0 (socket says 172.21.15.135:49426) 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc581183700 1 -- 172.21.15.135:0/256197664 learned_addr learned my addr 172.21.15.135:0/256197664 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:12.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc580982700 1 --2- 172.21.15.135:0/256197664 >> v2:172.21.15.183:3300/0 conn(0x7fc57c153650 0x7fc57c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc581183700 1 -- 172.21.15.135:0/256197664 >> v2:172.21.15.183:3300/0 conn(0x7fc57c153650 msgr2=0x7fc57c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc581183700 1 --2- 172.21.15.135:0/256197664 >> v2:172.21.15.183:3300/0 conn(0x7fc57c153650 0x7fc57c070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc581183700 1 -- 172.21.15.135:0/256197664 >> v1:172.21.15.183:6789/0 conn(0x7fc57c0c9da0 legacy=0x7fc57c15ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc581183700 1 -- 172.21.15.135:0/256197664 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c159aa0 con 0x7fc57c153270 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc581183700 1 --2- 172.21.15.135:0/256197664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153270 0x7fc57c0c9080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0c7c90 tx=0x7fc570009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1230c527b6fc883a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc56ffff700 1 -- 172.21.15.135:0/256197664 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000b870 con 0x7fc57c153270 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc56ffff700 1 -- 172.21.15.135:0/256197664 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57000b9d0 con 0x7fc57c153270 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.497+0000 7fc56ffff700 1 -- 172.21.15.135:0/256197664 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57000bd60 con 0x7fc57c153270 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 -- 172.21.15.135:0/256197664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153270 msgr2=0x7fc57c0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 --2- 172.21.15.135:0/256197664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153270 0x7fc57c0c9080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0c7c90 tx=0x7fc570009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 -- 172.21.15.135:0/256197664 shutdown_connections 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 --2- 172.21.15.135:0/256197664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153270 0x7fc57c0c9080 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 --2- 172.21.15.135:0/256197664 >> v2:172.21.15.183:3300/0 conn(0x7fc57c153650 0x7fc57c070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 -- 172.21.15.135:0/256197664 >> 172.21.15.135:0/256197664 conn(0x7fc57c066d70 msgr2=0x7fc57c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:12.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 -- 172.21.15.135:0/256197664 shutdown_connections 2024-05-08T20:55:12.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.498+0000 7fc5833e7700 1 -- 172.21.15.135:0/256197664 wait complete. 2024-05-08T20:55:12.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.499+0000 7fc5833e7700 1 Processor -- start 2024-05-08T20:55:12.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.499+0000 7fc5833e7700 1 -- start start 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc5833e7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc57c0c9da0 0x7fc57c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc5833e7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57c153270 0x7fc57c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc5833e7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153650 0x7fc57c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc5833e7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0cd790 con 0x7fc57c153650 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc5833e7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1eef80 con 0x7fc57c153270 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc5833e7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c0ca9d0 con 0x7fc57c0c9da0 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153650 0x7fc57c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc580982700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57c153270 0x7fc57c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153650 0x7fc57c0cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49428/0 (socket says 172.21.15.135:49428) 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 -- 172.21.15.135:0/3547400257 learned_addr learned my addr 172.21.15.135:0/3547400257 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581183700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc57c0c9da0 0x7fc57c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 -- 172.21.15.135:0/3547400257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc57c0c9da0 msgr2=0x7fc57c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc57c0c9da0 0x7fc57c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 -- 172.21.15.135:0/3547400257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57c153270 msgr2=0x7fc57c148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57c153270 0x7fc57c148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 -- 172.21.15.135:0/3547400257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc570009550 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc581984700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153650 0x7fc57c0cb4b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc57400cb50 tx=0x7fc57400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc56dffb700 1 -- 172.21.15.135:0/3547400257 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574003c00 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc56dffb700 1 -- 172.21.15.135:0/3547400257 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574003d60 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57c0cacb0 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.500+0000 7fc56dffb700 1 -- 172.21.15.135:0/3547400257 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400aa20 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.501+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c14cfc0 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.501+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c0cb1d0 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.502+0000 7fc56dffb700 1 -- 172.21.15.135:0/3547400257 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc57400ab80 con 0x7fc57c153650 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.502+0000 7fc56dffb700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc56006ac90 0x7fc56006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.502+0000 7fc581183700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc56006ac90 0x7fc56006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.502+0000 7fc56dffb700 1 -- 172.21.15.135:0/3547400257 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5740895a0 con 0x7fc57c153650 2024-05-08T20:55:12.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.503+0000 7fc581183700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc56006ac90 0x7fc56006d150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc570000c00 tx=0x7fc570008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.507+0000 7fc56dffb700 1 -- 172.21.15.135:0/3547400257 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc57c0cb1d0 con 0x7fc57c153650 2024-05-08T20:55:12.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.703+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc57c0cb1d0 con 0x7fc57c153650 2024-05-08T20:55:12.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.703+0000 7fc56dffb700 1 -- 172.21.15.135:0/3547400257 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc57c0cb1d0 con 0x7fc57c153650 2024-05-08T20:55:12.707 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T20:55:12.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc56006ac90 msgr2=0x7fc56006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc56006ac90 0x7fc56006d150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc570000c00 tx=0x7fc570008030 comp rx=0 tx=0).stop 2024-05-08T20:55:12.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153650 msgr2=0x7fc57c0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153650 0x7fc57c0cb4b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc57400cb50 tx=0x7fc57400ce60 comp rx=0 tx=0).stop 2024-05-08T20:55:12.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 shutdown_connections 2024-05-08T20:55:12.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc56006ac90 0x7fc56006d150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc57c153650 0x7fc57c0cb4b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc57c0c9da0 0x7fc57c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 --2- 172.21.15.135:0/3547400257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc57c153270 0x7fc57c148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 >> 172.21.15.135:0/3547400257 conn(0x7fc57c066d70 msgr2=0x7fc57c1511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:12.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 shutdown_connections 2024-05-08T20:55:12.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.706+0000 7fc5833e7700 1 -- 172.21.15.135:0/3547400257 wait complete. 2024-05-08T20:55:12.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:55:12.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.842+0000 7fd882091700 1 Processor -- start 2024-05-08T20:55:12.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.842+0000 7fd882091700 1 -- start start 2024-05-08T20:55:12.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.842+0000 7fd882091700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c06c0d0 0x7fd87c0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.842+0000 7fd882091700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd87c0c8fb0 0x7fd87c0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.842+0000 7fd882091700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87c0c2970 con 0x7fd87c153730 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.842+0000 7fd882091700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87c153b10 con 0x7fd87c0c8fb0 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.842+0000 7fd882091700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c0c80b0 con 0x7fd87c06c0d0 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd87c0c8fb0 0x7fd87c0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87b7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd87c153730 0x7fd87c1599a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:34600/0 (socket says 172.21.15.135:34600) 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87b7fe700 1 -- 172.21.15.135:0/2712429370 learned_addr learned my addr 172.21.15.135:0/2712429370 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87affd700 1 --2- 172.21.15.135:0/2712429370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c06c0d0 0x7fd87c0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87bfff700 1 -- 172.21.15.135:0/2712429370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c06c0d0 msgr2=0x7fd87c0c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87bfff700 1 --2- 172.21.15.135:0/2712429370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c06c0d0 0x7fd87c0c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87bfff700 1 -- 172.21.15.135:0/2712429370 >> v1:172.21.15.135:6789/0 conn(0x7fd87c153730 legacy=0x7fd87c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87bfff700 1 -- 172.21.15.135:0/2712429370 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c159510 con 0x7fd87c0c8fb0 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87a7fc700 1 -- 172.21.15.135:0/2712429370 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977574683 0 0) 0x7fd87c0c2970 con 0x7fd87c153730 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87bfff700 1 --2- 172.21.15.135:0/2712429370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c0c8fb0 0x7fd87c0c89b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd874009d90 tx=0x7fd87400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bb8f0642680353 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87a7fc700 1 -- 172.21.15.135:0/2712429370 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87400e070 con 0x7fd87c0c8fb0 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87a7fc700 1 -- 172.21.15.135:0/2712429370 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87400bbd0 con 0x7fd87c0c8fb0 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.843+0000 7fd87a7fc700 1 -- 172.21.15.135:0/2712429370 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd874012430 con 0x7fd87c0c8fb0 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 -- 172.21.15.135:0/2712429370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c0c8fb0 msgr2=0x7fd87c0c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 --2- 172.21.15.135:0/2712429370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c0c8fb0 0x7fd87c0c89b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd874009d90 tx=0x7fd87400b330 comp rx=0 tx=0).stop 2024-05-08T20:55:12.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 -- 172.21.15.135:0/2712429370 shutdown_connections 2024-05-08T20:55:12.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 --2- 172.21.15.135:0/2712429370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c0c8fb0 0x7fd87c0c89b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 --2- 172.21.15.135:0/2712429370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c06c0d0 0x7fd87c0c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 -- 172.21.15.135:0/2712429370 >> 172.21.15.135:0/2712429370 conn(0x7fd87c06a960 msgr2=0x7fd87c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:12.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 -- 172.21.15.135:0/2712429370 shutdown_connections 2024-05-08T20:55:12.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.844+0000 7fd882091700 1 -- 172.21.15.135:0/2712429370 wait complete. 2024-05-08T20:55:12.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.845+0000 7fd882091700 1 Processor -- start 2024-05-08T20:55:12.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.845+0000 7fd882091700 1 -- start start 2024-05-08T20:55:12.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd882091700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c06c0d0 0x7fd87c1e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd882091700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd87c0c8fb0 0x7fd87c1f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd882091700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c153730 0x7fd87c1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd882091700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1e5f70 con 0x7fd87c06c0d0 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd882091700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1e2de0 con 0x7fd87c0c8fb0 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd882091700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87c1f2cf0 con 0x7fd87c153730 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c06c0d0 0x7fd87c1e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c06c0d0 0x7fd87c1e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49444/0 (socket says 172.21.15.135:49444) 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 -- 172.21.15.135:0/4210003920 learned_addr learned my addr 172.21.15.135:0/4210003920 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87affd700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd87c0c8fb0 0x7fd87c1f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87bfff700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c153730 0x7fd87c1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 -- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c153730 msgr2=0x7fd87c1493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c153730 0x7fd87c1493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 -- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd87c0c8fb0 msgr2=0x7fd87c1f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd87c0c8fb0 0x7fd87c1f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 -- 172.21.15.135:0/4210003920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874009a70 con 0x7fd87c06c0d0 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87bfff700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c153730 0x7fd87c1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.846+0000 7fd87b7fe700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c06c0d0 0x7fd87c1e5a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c550 tx=0x7fd86c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.847+0000 7fd873fff700 1 -- 172.21.15.135:0/4210003920 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c004c80 con 0x7fd87c06c0d0 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.847+0000 7fd873fff700 1 -- 172.21.15.135:0/4210003920 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c004e00 con 0x7fd87c06c0d0 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.847+0000 7fd873fff700 1 -- 172.21.15.135:0/4210003920 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c007310 con 0x7fd87c06c0d0 2024-05-08T20:55:12.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.847+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87c1e30c0 con 0x7fd87c06c0d0 2024-05-08T20:55:12.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.847+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87c1e2a70 con 0x7fd87c06c0d0 2024-05-08T20:55:12.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.848+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87c1e35e0 con 0x7fd87c06c0d0 2024-05-08T20:55:12.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.848+0000 7fd873fff700 1 -- 172.21.15.135:0/4210003920 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd86c007470 con 0x7fd87c06c0d0 2024-05-08T20:55:12.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.848+0000 7fd873fff700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd85c06ac90 0x7fd85c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:12.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.848+0000 7fd873fff700 1 -- 172.21.15.135:0/4210003920 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd86c089250 con 0x7fd87c06c0d0 2024-05-08T20:55:12.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.848+0000 7fd87affd700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd85c06ac90 0x7fd85c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:12.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.849+0000 7fd87affd700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd85c06ac90 0x7fd85c06d150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd87c15c4f0 tx=0x7fd864008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:12.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:12.853+0000 7fd873fff700 1 -- 172.21.15.135:0/4210003920 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd87c1e35e0 con 0x7fd87c06c0d0 2024-05-08T20:55:13.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.048+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd87c1e28d0 con 0x7fd87c06c0d0 2024-05-08T20:55:13.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.049+0000 7fd873fff700 1 -- 172.21.15.135:0/4210003920 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd87c1e28d0 con 0x7fd87c06c0d0 2024-05-08T20:55:13.052 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd85c06ac90 msgr2=0x7fd85c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd85c06ac90 0x7fd85c06d150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd87c15c4f0 tx=0x7fd864008040 comp rx=0 tx=0).stop 2024-05-08T20:55:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c06c0d0 msgr2=0x7fd87c1e5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c06c0d0 0x7fd87c1e5a30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c550 tx=0x7fd86c00c860 comp rx=0 tx=0).stop 2024-05-08T20:55:13.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 shutdown_connections 2024-05-08T20:55:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd85c06ac90 0x7fd85c06d150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd87c153730 0x7fd87c1493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87c06c0d0 0x7fd87c1e5a30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 --2- 172.21.15.135:0/4210003920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd87c0c8fb0 0x7fd87c1f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 >> 172.21.15.135:0/4210003920 conn(0x7fd87c06a960 msgr2=0x7fd87c151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 shutdown_connections 2024-05-08T20:55:13.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.051+0000 7fd882091700 1 -- 172.21.15.135:0/4210003920 wait complete. 2024-05-08T20:55:13.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:55:13.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.189+0000 7f2612f48700 1 Processor -- start 2024-05-08T20:55:13.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.189+0000 7f2612f48700 1 -- start start 2024-05-08T20:55:13.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f2612f48700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f260c1535a0 0x7f260c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f2612f48700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f260c0cbf50 0x7f260c06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f2612f48700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c15c990 con 0x7f260c072ae0 2024-05-08T20:55:13.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f2612f48700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c15cbc0 con 0x7f260c0cbf50 2024-05-08T20:55:13.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f2612f48700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c15ce60 con 0x7f260c1535a0 2024-05-08T20:55:13.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f260c0cbf50 0x7f260c06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f26114e5700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f260c072ae0 0x7f260c0c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:34610/0 (socket says 172.21.15.135:34610) 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260bfff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f260c0cbf50 0x7f260c06aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49446/0 (socket says 172.21.15.135:49446) 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f26114e5700 1 -- 172.21.15.135:0/2759697391 learned_addr learned my addr 172.21.15.135:0/2759697391 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f2610ce4700 1 --2- 172.21.15.135:0/2759697391 >> v2:172.21.15.183:3300/0 conn(0x7f260c1535a0 0x7f260c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260bfff700 1 -- 172.21.15.135:0/2759697391 >> v2:172.21.15.183:3300/0 conn(0x7f260c1535a0 msgr2=0x7f260c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260bfff700 1 --2- 172.21.15.135:0/2759697391 >> v2:172.21.15.183:3300/0 conn(0x7f260c1535a0 0x7f260c06a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260bfff700 1 -- 172.21.15.135:0/2759697391 >> v1:172.21.15.135:6789/0 conn(0x7f260c072ae0 legacy=0x7f260c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260bfff700 1 -- 172.21.15.135:0/2759697391 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c15d140 con 0x7f260c0cbf50 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f2610ce4700 1 --2- 172.21.15.135:0/2759697391 >> v2:172.21.15.183:3300/0 conn(0x7f260c1535a0 0x7f260c06a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260b7fe700 1 -- 172.21.15.135:0/2759697391 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743249908 0 0) 0x7f260c15c990 con 0x7f260c072ae0 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260bfff700 1 --2- 172.21.15.135:0/2759697391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c06aea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f260c0cca20 tx=0x7f25f8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42eb096f9e01d41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260b7fe700 1 -- 172.21.15.135:0/2759697391 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8011830 con 0x7f260c0cbf50 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260b7fe700 1 -- 172.21.15.135:0/2759697391 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8011990 con 0x7f260c0cbf50 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.190+0000 7f260b7fe700 1 -- 172.21.15.135:0/2759697391 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8011d20 con 0x7f260c0cbf50 2024-05-08T20:55:13.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 -- 172.21.15.135:0/2759697391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 msgr2=0x7f260c06aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 --2- 172.21.15.135:0/2759697391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c06aea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f260c0cca20 tx=0x7f25f8009b20 comp rx=0 tx=0).stop 2024-05-08T20:55:13.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 -- 172.21.15.135:0/2759697391 shutdown_connections 2024-05-08T20:55:13.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 --2- 172.21.15.135:0/2759697391 >> v2:172.21.15.183:3300/0 conn(0x7f260c1535a0 0x7f260c06a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 --2- 172.21.15.135:0/2759697391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c06aea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 -- 172.21.15.135:0/2759697391 >> 172.21.15.135:0/2759697391 conn(0x7f260c06daf0 msgr2=0x7f260c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:13.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 -- 172.21.15.135:0/2759697391 shutdown_connections 2024-05-08T20:55:13.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.191+0000 7f2612f48700 1 -- 172.21.15.135:0/2759697391 wait complete. 2024-05-08T20:55:13.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.192+0000 7f2612f48700 1 Processor -- start 2024-05-08T20:55:13.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.192+0000 7f2612f48700 1 -- start start 2024-05-08T20:55:13.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f2612f48700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260c072ae0 0x7f260c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f2612f48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c0cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f2612f48700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f260c1535a0 0x7f260c1eebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f2612f48700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c157910 con 0x7f260c0cbf50 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f2612f48700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c14b350 con 0x7f260c1535a0 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f2612f48700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c14b5f0 con 0x7f260c072ae0 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c0cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c0cab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49452/0 (socket says 172.21.15.135:49452) 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 -- 172.21.15.135:0/2095276274 learned_addr learned my addr 172.21.15.135:0/2095276274 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f26114e5700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f260c1535a0 0x7f260c1eebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f2610ce4700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260c072ae0 0x7f260c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 -- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260c072ae0 msgr2=0x7f260c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260c072ae0 0x7f260c157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 -- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f260c1535a0 msgr2=0x7f260c1eebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f260c1535a0 0x7f260c1eebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f260bfff700 1 -- 172.21.15.135:0/2095276274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f80094a0 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.193+0000 7f26114e5700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f260c1535a0 0x7f260c1eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.194+0000 7f260bfff700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c0cab50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f25f80090b0 tx=0x7f25f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.194+0000 7f26097fa700 1 -- 172.21.15.135:0/2095276274 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f80038a0 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.194+0000 7f26097fa700 1 -- 172.21.15.135:0/2095276274 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f801f070 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.194+0000 7f26097fa700 1 -- 172.21.15.135:0/2095276274 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8003c20 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.194+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c14b8d0 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.194+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c14be90 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.195+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c0c33c0 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.195+0000 7f26097fa700 1 -- 172.21.15.135:0/2095276274 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25f801a430 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.195+0000 7f26097fa700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f25f006ac90 0x7f25f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.196+0000 7f26097fa700 1 -- 172.21.15.135:0/2095276274 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25f8021070 con 0x7f260c0cbf50 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.196+0000 7f2610ce4700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f25f006ac90 0x7f25f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.196+0000 7f2610ce4700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f25f006ac90 0x7f25f006d150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26000098f0 tx=0x7f2600008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.200+0000 7f26097fa700 1 -- 172.21.15.135:0/2095276274 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25f8055ed0 con 0x7f260c0cbf50 2024-05-08T20:55:13.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.392+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f260c1ee8c0 con 0x7f260c0cbf50 2024-05-08T20:55:13.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.393+0000 7f26097fa700 1 -- 172.21.15.135:0/2095276274 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25f802b020 con 0x7f260c0cbf50 2024-05-08T20:55:13.396 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T20:55:13.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f25f006ac90 msgr2=0x7f25f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f25f006ac90 0x7f25f006d150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f26000098f0 tx=0x7f2600008040 comp rx=0 tx=0).stop 2024-05-08T20:55:13.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 msgr2=0x7f260c0cab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c0cab50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f25f80090b0 tx=0x7f25f8004750 comp rx=0 tx=0).stop 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 shutdown_connections 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f25f006ac90 0x7f25f006d150 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f260c1535a0 0x7f260c1eebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f260c072ae0 0x7f260c157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 --2- 172.21.15.135:0/2095276274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f260c0cbf50 0x7f260c0cab50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 >> 172.21.15.135:0/2095276274 conn(0x7f260c06daf0 msgr2=0x7f260c0c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 shutdown_connections 2024-05-08T20:55:13.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.395+0000 7f2612f48700 1 -- 172.21.15.135:0/2095276274 wait complete. 2024-05-08T20:55:13.410 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T20:55:13.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.532+0000 7fd61e3b2700 1 Processor -- start 2024-05-08T20:55:13.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.532+0000 7fd61e3b2700 1 -- start start 2024-05-08T20:55:13.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd61e3b2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 0x7fd61806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd61e3b2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd618159650 con 0x7fd618153630 2024-05-08T20:55:13.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd61e3b2700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd618159930 con 0x7fd618072370 2024-05-08T20:55:13.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd61e3b2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd618159c10 con 0x7fd618072750 2024-05-08T20:55:13.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd6177fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd618153630 0x7fd61815ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:34626/0 (socket says 172.21.15.135:34626) 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd6177fe700 1 -- 172.21.15.135:0/21654238 learned_addr learned my addr 172.21.15.135:0/21654238 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172833376 0 0) 0x7fd618159650 con 0x7fd618153630 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd61c94f700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 0x7fd61806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.533+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6000035b0 con 0x7fd618153630 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 648676023 0 0) 0x7fd6000035b0 con 0x7fd618153630 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 msgr2=0x7fd61806ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 0x7fd61806ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 >> v1:172.21.15.183:6789/0 conn(0x7fd618072370 legacy=0x7fd618152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618159ef0 con 0x7fd618153630 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7fd608001670 con 0x7fd618153630 2024-05-08T20:55:13.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 >> v1:172.21.15.135:6789/0 conn(0x7fd618153630 legacy=0x7fd61815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 0x7fd600003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd600003fb0 0x7fd600004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd600004d90 0x7fd600005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd618159c10 con 0x7fd600004d90 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60000bb80 con 0x7fd600003fb0 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60000bd40 con 0x7fd618072750 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd61c94f700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd600004d90 0x7fd600005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd6177fe700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd600003fb0 0x7fd600004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd617fff700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 0x7fd600003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd61c94f700 1 -- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 msgr2=0x7fd600003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd61c94f700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd618072750 0x7fd600003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd61c94f700 1 -- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd600003fb0 msgr2=0x7fd600004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:13.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd61c94f700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd600003fb0 0x7fd600004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd61c94f700 1 -- 172.21.15.135:0/21654238 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000035b0 con 0x7fd600004d90 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.534+0000 7fd61c94f700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd600004d90 0x7fd600005210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd61806c960 tx=0x7fd600005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929a84e572ae3cc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000ebd0 con 0x7fd600004d90 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61000f040 con 0x7fd600004d90 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd616ffd700 1 -- 172.21.15.135:0/21654238 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610014480 con 0x7fd600004d90 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd61e3b2700 1 -- 172.21.15.135:0/21654238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd600004d90 msgr2=0x7fd600005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd61e3b2700 1 --2- 172.21.15.135:0/21654238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd600004d90 0x7fd600005210 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd61806c960 tx=0x7fd600005880 comp rx=0 tx=0).stop 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd61c94f700 1 -- 172.21.15.135:0/21654238 reap_dead start 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd61e3b2700 1 -- 172.21.15.135:0/21654238 shutdown_connections 2024-05-08T20:55:13.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd61e3b2700 1 -- 172.21.15.135:0/21654238 >> 172.21.15.135:0/21654238 conn(0x7fd61806eb30 msgr2=0x7fd61806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd61e3b2700 1 -- 172.21.15.135:0/21654238 shutdown_connections 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.535+0000 7fd61e3b2700 1 -- 172.21.15.135:0/21654238 wait complete. 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.536+0000 7fd61e3b2700 1 Processor -- start 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.536+0000 7fd61e3b2700 1 -- start start 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd61e3b2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd61814eeb0 0x7fd6180c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd61e3b2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61814f290 0x7fd61815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd61e3b2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd61815c2f0 0x7fd618145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd61e3b2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180cbea0 con 0x7fd61814eeb0 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd61e3b2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181f21e0 con 0x7fd61814f290 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd61e3b2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180cb320 con 0x7fd61815c2f0 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd617fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd61814eeb0 0x7fd6180c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd617fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd61814eeb0 0x7fd6180c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49456/0 (socket says 172.21.15.135:49456) 2024-05-08T20:55:13.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd617fff700 1 -- 172.21.15.135:0/3656845369 learned_addr learned my addr 172.21.15.135:0/3656845369 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd61c94f700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd61815c2f0 0x7fd618145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd6177fe700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61814f290 0x7fd61815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.537+0000 7fd617fff700 1 -- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd61815c2f0 msgr2=0x7fd618145440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd617fff700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd61815c2f0 0x7fd618145440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd617fff700 1 -- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61814f290 msgr2=0x7fd61815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd617fff700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61814f290 0x7fd61815bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd617fff700 1 -- 172.21.15.135:0/3656845369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180cb600 con 0x7fd61814eeb0 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd6177fe700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61814f290 0x7fd61815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd617fff700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd61814eeb0 0x7fd6180c57e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00f7f0 tx=0x7fd60c00fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd614ff9700 1 -- 172.21.15.135:0/3656845369 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0052e0 con 0x7fd61814eeb0 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd614ff9700 1 -- 172.21.15.135:0/3656845369 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c005440 con 0x7fd61814eeb0 2024-05-08T20:55:13.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6180cb8e0 con 0x7fd61814eeb0 2024-05-08T20:55:13.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd614ff9700 1 -- 172.21.15.135:0/3656845369 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c0038c0 con 0x7fd61814eeb0 2024-05-08T20:55:13.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.538+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61815b890 con 0x7fd61814eeb0 2024-05-08T20:55:13.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.539+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd618067fa0 con 0x7fd61814eeb0 2024-05-08T20:55:13.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.539+0000 7fd614ff9700 1 -- 172.21.15.135:0/3656845369 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd60c003a20 con 0x7fd61814eeb0 2024-05-08T20:55:13.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.540+0000 7fd614ff9700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd60406acc0 0x7fd60406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.540+0000 7fd614ff9700 1 -- 172.21.15.135:0/3656845369 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd60c0894b0 con 0x7fd61814eeb0 2024-05-08T20:55:13.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.540+0000 7fd6177fe700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd60406acc0 0x7fd60406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.540+0000 7fd6177fe700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd60406acc0 0x7fd60406d180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6180cc320 tx=0x7fd608009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.544+0000 7fd614ff9700 1 -- 172.21.15.135:0/3656845369 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd60c054300 con 0x7fd61814eeb0 2024-05-08T20:55:13.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.741+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd6180c64f0 con 0x7fd61814eeb0 2024-05-08T20:55:13.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.742+0000 7fd614ff9700 1 -- 172.21.15.135:0/3656845369 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd60c057920 con 0x7fd61814eeb0 2024-05-08T20:55:13.745 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd60406acc0 msgr2=0x7fd60406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd60406acc0 0x7fd60406d180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6180cc320 tx=0x7fd608009040 comp rx=0 tx=0).stop 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd61814eeb0 msgr2=0x7fd6180c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd61814eeb0 0x7fd6180c57e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00f7f0 tx=0x7fd60c00fb00 comp rx=0 tx=0).stop 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 shutdown_connections 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd60406acc0 0x7fd60406d180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd61815c2f0 0x7fd618145440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd61814eeb0 0x7fd6180c57e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 --2- 172.21.15.135:0/3656845369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd61814f290 0x7fd61815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 >> 172.21.15.135:0/3656845369 conn(0x7fd61806eb30 msgr2=0x7fd6180c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:13.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 shutdown_connections 2024-05-08T20:55:13.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.744+0000 7fd61e3b2700 1 -- 172.21.15.135:0/3656845369 wait complete. 2024-05-08T20:55:13.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T20:55:13.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.878+0000 7fcd070ff700 1 Processor -- start 2024-05-08T20:55:13.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.878+0000 7fcd070ff700 1 -- start start 2024-05-08T20:55:13.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fcd070ff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd000c8650 0x7fcd000c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fcd070ff700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000c84a0 con 0x7fcd001536d0 2024-05-08T20:55:13.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fcd070ff700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0015d9b0 con 0x7fcd000c7590 2024-05-08T20:55:13.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fcd070ff700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd00159400 con 0x7fcd000c8650 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fccfffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fcd000c8650 0x7fcd000c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fcd04e9b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fcd001536d0 0x7fcd00159b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:34638/0 (socket says 172.21.15.135:34638) 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fcd04e9b700 1 -- 172.21.15.135:0/923955896 learned_addr learned my addr 172.21.15.135:0/923955896 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fccfffff700 1 -- 172.21.15.135:0/923955896 >> v1:172.21.15.183:6789/0 conn(0x7fcd000c7590 legacy=0x7fcd00163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fccfffff700 1 -- 172.21.15.135:0/923955896 >> v1:172.21.15.135:6789/0 conn(0x7fcd001536d0 legacy=0x7fcd00159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fccff7fe700 1 -- 172.21.15.135:0/923955896 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046848223 0 0) 0x7fcd000c84a0 con 0x7fcd001536d0 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fccfffff700 1 -- 172.21.15.135:0/923955896 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0015ce30 con 0x7fcd000c8650 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.879+0000 7fccfffff700 1 --2- 172.21.15.135:0/923955896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c8650 0x7fcd000c8e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fccec009840 tx=0x7fccec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7430301fbe9008ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fccff7fe700 1 -- 172.21.15.135:0/923955896 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec011830 con 0x7fcd000c8650 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fccff7fe700 1 -- 172.21.15.135:0/923955896 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec011990 con 0x7fcd000c8650 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fccff7fe700 1 -- 172.21.15.135:0/923955896 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec011d20 con 0x7fcd000c8650 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fcd070ff700 1 -- 172.21.15.135:0/923955896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c8650 msgr2=0x7fcd000c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fcd070ff700 1 --2- 172.21.15.135:0/923955896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c8650 0x7fcd000c8e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fccec009840 tx=0x7fccec009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:13.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fcd070ff700 1 -- 172.21.15.135:0/923955896 shutdown_connections 2024-05-08T20:55:13.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fcd070ff700 1 --2- 172.21.15.135:0/923955896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c8650 0x7fcd000c8e50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fcd070ff700 1 -- 172.21.15.135:0/923955896 >> 172.21.15.135:0/923955896 conn(0x7fcd0006a960 msgr2=0x7fcd0006ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:13.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fcd070ff700 1 -- 172.21.15.135:0/923955896 shutdown_connections 2024-05-08T20:55:13.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.880+0000 7fcd070ff700 1 -- 172.21.15.135:0/923955896 wait complete. 2024-05-08T20:55:13.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.881+0000 7fcd070ff700 1 Processor -- start 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.881+0000 7fcd070ff700 1 -- start start 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd070ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c7590 0x7fcd000af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd070ff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd000c8650 0x7fcd00150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd070ff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd001536d0 0x7fcd001efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd070ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd001f0190 con 0x7fcd000c7590 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd070ff700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0015cb90 con 0x7fcd001536d0 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd070ff700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000aeec0 con 0x7fcd000c8650 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd04e9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c7590 0x7fcd000af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd04e9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c7590 0x7fcd000af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49472/0 (socket says 172.21.15.135:49472) 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd04e9b700 1 -- 172.21.15.135:0/2166684044 learned_addr learned my addr 172.21.15.135:0/2166684044 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fccfffff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd000c8650 0x7fcd00150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.882+0000 7fcd0569c700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd001536d0 0x7fcd001efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd04e9b700 1 -- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd000c8650 msgr2=0x7fcd00150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd04e9b700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd000c8650 0x7fcd00150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd04e9b700 1 -- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd001536d0 msgr2=0x7fcd001efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd04e9b700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd001536d0 0x7fcd001efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd04e9b700 1 -- 172.21.15.135:0/2166684044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0094a0 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd04e9b700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c7590 0x7fcd000af350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c550 tx=0x7fccf400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fccfd7fa700 1 -- 172.21.15.135:0/2166684044 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4004c80 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fccfd7fa700 1 -- 172.21.15.135:0/2166684044 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4004e00 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0015c610 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fccfd7fa700 1 -- 172.21.15.135:0/2166684044 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4007310 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.883+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd000ae870 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.884+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd00067fa0 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.884+0000 7fccfd7fa700 1 -- 172.21.15.135:0/2166684044 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fccf4007470 con 0x7fcd000c7590 2024-05-08T20:55:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.885+0000 7fccfd7fa700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcce406ac90 0x7fcce406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.885+0000 7fccfd7fa700 1 -- 172.21.15.135:0/2166684044 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fccf4089240 con 0x7fcd000c7590 2024-05-08T20:55:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.885+0000 7fccfffff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcce406ac90 0x7fcce406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.885+0000 7fccfffff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcce406ac90 0x7fcce406d150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccec0090b0 tx=0x7fccec01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:13.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:13.889+0000 7fccfd7fa700 1 -- 172.21.15.135:0/2166684044 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fccf4054130 con 0x7fcd000c7590 2024-05-08T20:55:14.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.099+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcd0014d500 con 0x7fcd000c7590 2024-05-08T20:55:14.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.100+0000 7fccfd7fa700 1 -- 172.21.15.135:0/2166684044 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fccf4057750 con 0x7fcd000c7590 2024-05-08T20:55:14.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcce406ac90 msgr2=0x7fcce406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:14.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcce406ac90 0x7fcce406d150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fccec0090b0 tx=0x7fccec01c040 comp rx=0 tx=0).stop 2024-05-08T20:55:14.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c7590 msgr2=0x7fcd000af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c7590 0x7fcd000af350 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c550 tx=0x7fccf400c860 comp rx=0 tx=0).stop 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 shutdown_connections 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fcce406ac90 0x7fcce406d150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd001536d0 0x7fcd001efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd000c7590 0x7fcd000af350 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 --2- 172.21.15.135:0/2166684044 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd000c8650 0x7fcd00150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 >> 172.21.15.135:0/2166684044 conn(0x7fcd0006a960 msgr2=0x7fcd000709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 shutdown_connections 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:14.102+0000 7fcd070ff700 1 -- 172.21.15.135:0/2166684044 wait complete. 2024-05-08T20:55:14.106 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-08T20:55:14.117 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2024-05-08T20:55:14.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:14.117 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-08T20:55:14.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[55266]: fuse finished with error 0 and tester_r 0 2024-05-08T20:55:14.156 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T20:55:20.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T20:55:20.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:20.258 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-08T20:55:20.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:20.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e7702700 1 Processor -- start 2024-05-08T20:55:20.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e7702700 1 -- start start 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e7702700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e01504c0 0x7fe3e00c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e7702700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe3e0159ab0 0x7fe3e00c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e7702700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e01508a0 con 0x7fe3e0159670 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e7702700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e00c2de0 con 0x7fe3e0159ab0 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e7702700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e00c5720 con 0x7fe3e01504c0 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e5c9f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe3e0159ab0 0x7fe3e00c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e5c9f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe3e0159ab0 0x7fe3e00c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49482/0 (socket says 172.21.15.135:49482) 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.463+0000 7fe3e5c9f700 1 -- 172.21.15.135:0/4154723052 learned_addr learned my addr 172.21.15.135:0/4154723052 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:20.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3e549e700 1 --2- 172.21.15.135:0/4154723052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e01504c0 0x7fe3e00c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3e5c9f700 1 -- 172.21.15.135:0/4154723052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e01504c0 msgr2=0x7fe3e00c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3e5c9f700 1 --2- 172.21.15.135:0/4154723052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e01504c0 0x7fe3e00c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3e5c9f700 1 -- 172.21.15.135:0/4154723052 >> v1:172.21.15.183:6789/0 conn(0x7fe3e0159670 legacy=0x7fe3e0072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3e5c9f700 1 -- 172.21.15.135:0/4154723052 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0072e40 con 0x7fe3e0159ab0 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3e5c9f700 1 --2- 172.21.15.135:0/4154723052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e0159ab0 0x7fe3e00c6600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800d150 tx=0x7fe3d800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bf88eae07142b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3d3fff700 1 -- 172.21.15.135:0/4154723052 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8010070 con 0x7fe3e0159ab0 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3d3fff700 1 -- 172.21.15.135:0/4154723052 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d800dd10 con 0x7fe3e0159ab0 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.464+0000 7fe3d3fff700 1 -- 172.21.15.135:0/4154723052 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d800b310 con 0x7fe3e0159ab0 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 -- 172.21.15.135:0/4154723052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e0159ab0 msgr2=0x7fe3e00c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 --2- 172.21.15.135:0/4154723052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e0159ab0 0x7fe3e00c6600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800d150 tx=0x7fe3d800d460 comp rx=0 tx=0).stop 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 -- 172.21.15.135:0/4154723052 shutdown_connections 2024-05-08T20:55:20.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 --2- 172.21.15.135:0/4154723052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e0159ab0 0x7fe3e00c6600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 --2- 172.21.15.135:0/4154723052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e01504c0 0x7fe3e00c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 -- 172.21.15.135:0/4154723052 >> 172.21.15.135:0/4154723052 conn(0x7fe3e006daf0 msgr2=0x7fe3e006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:20.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 -- 172.21.15.135:0/4154723052 shutdown_connections 2024-05-08T20:55:20.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.465+0000 7fe3e7702700 1 -- 172.21.15.135:0/4154723052 wait complete. 2024-05-08T20:55:20.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.466+0000 7fe3e7702700 1 Processor -- start 2024-05-08T20:55:20.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.466+0000 7fe3e7702700 1 -- start start 2024-05-08T20:55:20.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e7702700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e01504c0 0x7fe3e0144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e7702700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e0159670 0x7fe3e0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e7702700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e0159ab0 0x7fe3e01f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e7702700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e01f0640 con 0x7fe3e01504c0 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e7702700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e01429a0 con 0x7fe3e0159ab0 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e7702700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e0143c40 con 0x7fe3e0159670 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e549e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e01504c0 0x7fe3e0144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e549e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e01504c0 0x7fe3e0144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49494/0 (socket says 172.21.15.135:49494) 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.467+0000 7fe3e549e700 1 -- 172.21.15.135:0/2824307144 learned_addr learned my addr 172.21.15.135:0/2824307144 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e549e700 1 -- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e0159670 msgr2=0x7fe3e0158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e4c9d700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e0159670 0x7fe3e0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e549e700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e0159670 0x7fe3e0158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e5c9f700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e0159ab0 0x7fe3e01f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e549e700 1 -- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e0159ab0 msgr2=0x7fe3e01f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e549e700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e0159ab0 0x7fe3e01f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e549e700 1 -- 172.21.15.135:0/2824307144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d800bd40 con 0x7fe3e01504c0 2024-05-08T20:55:20.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e549e700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e01504c0 0x7fe3e0144ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400e9e0 tx=0x7fe3d400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:20.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3d1ffb700 1 -- 172.21.15.135:0/2824307144 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4009710 con 0x7fe3e01504c0 2024-05-08T20:55:20.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3d1ffb700 1 -- 172.21.15.135:0/2824307144 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d400c7f0 con 0x7fe3e01504c0 2024-05-08T20:55:20.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e0143f20 con 0x7fe3e01504c0 2024-05-08T20:55:20.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3d1ffb700 1 -- 172.21.15.135:0/2824307144 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400cb60 con 0x7fe3e01504c0 2024-05-08T20:55:20.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.468+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e01444e0 con 0x7fe3e01504c0 2024-05-08T20:55:20.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.469+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e01f08e0 con 0x7fe3e01504c0 2024-05-08T20:55:20.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.470+0000 7fe3d1ffb700 1 -- 172.21.15.135:0/2824307144 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe3d400ccc0 con 0x7fe3e01504c0 2024-05-08T20:55:20.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.470+0000 7fe3d1ffb700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe3c406ac90 0x7fe3c406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.470+0000 7fe3d1ffb700 1 -- 172.21.15.135:0/2824307144 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3d4089740 con 0x7fe3e01504c0 2024-05-08T20:55:20.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.470+0000 7fe3e4c9d700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe3c406ac90 0x7fe3c406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.470+0000 7fe3e4c9d700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe3c406ac90 0x7fe3c406d150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0153bc0 tx=0x7fe3dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:20.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.475+0000 7fe3d1ffb700 1 -- 172.21.15.135:0/2824307144 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe3d40545a0 con 0x7fe3e01504c0 2024-05-08T20:55:20.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.675+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3e0067fa0 con 0x7fe3e01504c0 2024-05-08T20:55:20.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.676+0000 7fe3d1ffb700 1 -- 172.21.15.135:0/2824307144 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fe3d4057bc0 con 0x7fe3e01504c0 2024-05-08T20:55:20.678 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:20.678 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe3c406ac90 msgr2=0x7fe3c406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe3c406ac90 0x7fe3c406d150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0153bc0 tx=0x7fe3dc009040 comp rx=0 tx=0).stop 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e01504c0 msgr2=0x7fe3e0144ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e01504c0 0x7fe3e0144ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400e9e0 tx=0x7fe3d400eda0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 shutdown_connections 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe3c406ac90 0x7fe3c406d150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e0159ab0 0x7fe3e01f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe3e01504c0 0x7fe3e0144ec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 --2- 172.21.15.135:0/2824307144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e0159670 0x7fe3e0158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 >> 172.21.15.135:0/2824307144 conn(0x7fe3e006daf0 msgr2=0x7fe3e006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:20.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 shutdown_connections 2024-05-08T20:55:20.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.678+0000 7fe3e7702700 1 -- 172.21.15.135:0/2824307144 wait complete. 2024-05-08T20:55:20.693 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.812+0000 7fc8a802d700 1 Processor -- start 2024-05-08T20:55:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.812+0000 7fc8a802d700 1 -- start start 2024-05-08T20:55:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a802d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8a0153270 0x7fc8a00c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a802d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a802d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a0159570 con 0x7fc8a0153650 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a802d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a015a160 con 0x7fc8a0153270 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a802d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01597c0 con 0x7fc8a00c9da0 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a65ca700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a65ca700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:60948/0 (socket says 172.21.15.135:60948) 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a5dc9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8a0153270 0x7fc8a00c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a65ca700 1 -- 172.21.15.135:0/490130255 learned_addr learned my addr 172.21.15.135:0/490130255 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a65ca700 1 -- 172.21.15.135:0/490130255 >> v2:172.21.15.183:3300/0 conn(0x7fc8a0153270 msgr2=0x7fc8a00c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a65ca700 1 --2- 172.21.15.135:0/490130255 >> v2:172.21.15.183:3300/0 conn(0x7fc8a0153270 0x7fc8a00c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a65ca700 1 -- 172.21.15.135:0/490130255 >> v1:172.21.15.183:6789/0 conn(0x7fc8a0153650 legacy=0x7fc8a0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.813+0000 7fc8a65ca700 1 -- 172.21.15.135:0/490130255 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0159aa0 con 0x7fc8a00c9da0 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a65ca700 1 --2- 172.21.15.135:0/490130255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015ca50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc898009e50 tx=0x7fc89800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f9203a458129d16 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a4dc7700 1 -- 172.21.15.135:0/490130255 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800e070 con 0x7fc8a00c9da0 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a4dc7700 1 -- 172.21.15.135:0/490130255 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89800b910 con 0x7fc8a00c9da0 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a4dc7700 1 -- 172.21.15.135:0/490130255 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89800bcc0 con 0x7fc8a00c9da0 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 -- 172.21.15.135:0/490130255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 msgr2=0x7fc8a015ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 --2- 172.21.15.135:0/490130255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015ca50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc898009e50 tx=0x7fc89800b330 comp rx=0 tx=0).stop 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 -- 172.21.15.135:0/490130255 shutdown_connections 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 --2- 172.21.15.135:0/490130255 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015ca50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 --2- 172.21.15.135:0/490130255 >> v2:172.21.15.183:3300/0 conn(0x7fc8a0153270 0x7fc8a00c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 -- 172.21.15.135:0/490130255 >> 172.21.15.135:0/490130255 conn(0x7fc8a0066d70 msgr2=0x7fc8a006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 -- 172.21.15.135:0/490130255 shutdown_connections 2024-05-08T20:55:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.814+0000 7fc8a802d700 1 -- 172.21.15.135:0/490130255 wait complete. 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.816+0000 7fc8a802d700 1 Processor -- start 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.816+0000 7fc8a802d700 1 -- start start 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a802d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a802d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8a0153270 0x7fc8a015c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a802d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a0153650 0x7fc8a0149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a802d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01efc10 con 0x7fc8a0153270 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a802d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a015d2d0 con 0x7fc8a0153650 2024-05-08T20:55:20.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a802d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a015b920 con 0x7fc8a00c9da0 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8a0153270 0x7fc8a015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8a0153270 0x7fc8a015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49502/0 (socket says 172.21.15.135:49502) 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 -- 172.21.15.135:0/3202335079 learned_addr learned my addr 172.21.15.135:0/3202335079 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a5dc9700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a65ca700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a0153650 0x7fc8a0149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 -- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 msgr2=0x7fc8a015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 -- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a0153650 msgr2=0x7fc8a0149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a0153650 0x7fc8a0149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 -- 172.21.15.135:0/3202335079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009b30 con 0x7fc8a0153270 2024-05-08T20:55:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.817+0000 7fc8a55c8700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8a0153270 0x7fc8a015c690 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc89000c3f0 tx=0x7fc89000c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.818+0000 7fc8967fc700 1 -- 172.21.15.135:0/3202335079 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8900052d0 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.818+0000 7fc8967fc700 1 -- 172.21.15.135:0/3202335079 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890005430 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.818+0000 7fc8967fc700 1 -- 172.21.15.135:0/3202335079 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890006aa0 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.818+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a014a840 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.818+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a01ef270 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.819+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a01efd50 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.819+0000 7fc8967fc700 1 -- 172.21.15.135:0/3202335079 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc890003680 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.820+0000 7fc8967fc700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc88406acc0 0x7fc88406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.820+0000 7fc8967fc700 1 -- 172.21.15.135:0/3202335079 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc890088d50 con 0x7fc8a0153270 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.820+0000 7fc8a5dc9700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc88406acc0 0x7fc88406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:20.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.820+0000 7fc8a5dc9700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc88406acc0 0x7fc88406d180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009be0 tx=0x7fc89c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:20.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:20.824+0000 7fc8967fc700 1 -- 172.21.15.135:0/3202335079 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc890053c90 con 0x7fc8a0153270 2024-05-08T20:55:21.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.023+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8a01efd50 con 0x7fc8a0153270 2024-05-08T20:55:21.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.024+0000 7fc8967fc700 1 -- 172.21.15.135:0/3202335079 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fc8a01efd50 con 0x7fc8a0153270 2024-05-08T20:55:21.026 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:21.026 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc88406acc0 msgr2=0x7fc88406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc88406acc0 0x7fc88406d180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009be0 tx=0x7fc89c009210 comp rx=0 tx=0).stop 2024-05-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8a0153270 msgr2=0x7fc8a015c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8a0153270 0x7fc8a015c690 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc89000c3f0 tx=0x7fc89000c700 comp rx=0 tx=0).stop 2024-05-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 shutdown_connections 2024-05-08T20:55:21.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc88406acc0 0x7fc88406d180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8a0153650 0x7fc8a0149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8a00c9da0 0x7fc8a015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 --2- 172.21.15.135:0/3202335079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8a0153270 0x7fc8a015c690 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.026+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 >> 172.21.15.135:0/3202335079 conn(0x7fc8a0066d70 msgr2=0x7fc8a0150050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:21.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.027+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 shutdown_connections 2024-05-08T20:55:21.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.027+0000 7fc8a802d700 1 -- 172.21.15.135:0/3202335079 wait complete. 2024-05-08T20:55:21.041 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T20:55:21.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.164+0000 7f8fe2c73700 1 Processor -- start 2024-05-08T20:55:21.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.164+0000 7f8fe2c73700 1 -- start start 2024-05-08T20:55:21.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe2c73700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8fdc072390 0x7f8fdc0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe2c73700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072770 0x7f8fdc0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe2c73700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc0c1540 con 0x7f8fdc156050 2024-05-08T20:55:21.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe2c73700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc0cc4c0 con 0x7f8fdc072390 2024-05-08T20:55:21.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe2c73700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0c6670 con 0x7f8fdc072770 2024-05-08T20:55:21.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe0a0f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8fdc072390 0x7f8fdc0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe1210700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8fdc156050 0x7f8fdc14fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:34646/0 (socket says 172.21.15.135:34646) 2024-05-08T20:55:21.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe1210700 1 -- 172.21.15.135:0/3370882092 learned_addr learned my addr 172.21.15.135:0/3370882092 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:21.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fdbfff700 1 --2- 172.21.15.135:0/3370882092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072770 0x7f8fdc0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe0a0f700 1 -- 172.21.15.135:0/3370882092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072770 msgr2=0x7f8fdc0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:21.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe0a0f700 1 --2- 172.21.15.135:0/3370882092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072770 0x7f8fdc0cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe0a0f700 1 -- 172.21.15.135:0/3370882092 >> v1:172.21.15.135:6789/0 conn(0x7f8fdc156050 legacy=0x7f8fdc14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe0a0f700 1 -- 172.21.15.135:0/3370882092 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0c19d0 con 0x7f8fdc072390 2024-05-08T20:55:21.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fdb7fe700 1 -- 172.21.15.135:0/3370882092 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228576009 0 0) 0x7f8fdc0c1540 con 0x7f8fdc156050 2024-05-08T20:55:21.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fe0a0f700 1 --2- 172.21.15.135:0/3370882092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc072390 0x7f8fdc0b1c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009870 tx=0x7f8fd0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c5d42f50c60a6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:21.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fdb7fe700 1 -- 172.21.15.135:0/3370882092 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011830 con 0x7f8fdc072390 2024-05-08T20:55:21.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fdb7fe700 1 -- 172.21.15.135:0/3370882092 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0011990 con 0x7f8fdc072390 2024-05-08T20:55:21.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.165+0000 7f8fdb7fe700 1 -- 172.21.15.135:0/3370882092 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011d20 con 0x7f8fdc072390 2024-05-08T20:55:21.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 -- 172.21.15.135:0/3370882092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc072390 msgr2=0x7f8fdc0b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/3370882092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc072390 0x7f8fdc0b1c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009870 tx=0x7f8fd0009b80 comp rx=0 tx=0).stop 2024-05-08T20:55:21.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 -- 172.21.15.135:0/3370882092 shutdown_connections 2024-05-08T20:55:21.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/3370882092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc072390 0x7f8fdc0b1c70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/3370882092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072770 0x7f8fdc0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 -- 172.21.15.135:0/3370882092 >> 172.21.15.135:0/3370882092 conn(0x7f8fdc06ec40 msgr2=0x7f8fdc06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:21.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 -- 172.21.15.135:0/3370882092 shutdown_connections 2024-05-08T20:55:21.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.166+0000 7f8fe2c73700 1 -- 172.21.15.135:0/3370882092 wait complete. 2024-05-08T20:55:21.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.167+0000 7f8fe2c73700 1 Processor -- start 2024-05-08T20:55:21.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.167+0000 7f8fe2c73700 1 -- start start 2024-05-08T20:55:21.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe2c73700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072390 0x7f8fdc1ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe2c73700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fdc072770 0x7f8fdc144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe2c73700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc156050 0x7f8fdc140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe2c73700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14f960 con 0x7f8fdc156050 2024-05-08T20:55:21.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe2c73700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14cf40 con 0x7f8fdc072770 2024-05-08T20:55:21.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe2c73700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14d1c0 con 0x7f8fdc072390 2024-05-08T20:55:21.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe1210700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc156050 0x7f8fdc140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe0a0f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072390 0x7f8fdc1ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe0a0f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072390 0x7f8fdc1ef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:60984/0 (socket says 172.21.15.135:60984) 2024-05-08T20:55:21.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe1210700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc156050 0x7f8fdc140460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49518/0 (socket says 172.21.15.135:49518) 2024-05-08T20:55:21.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe0a0f700 1 -- 172.21.15.135:0/252205814 learned_addr learned my addr 172.21.15.135:0/252205814 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:21.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fdbfff700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fdc072770 0x7f8fdc144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe1210700 1 -- 172.21.15.135:0/252205814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072390 msgr2=0x7f8fdc1ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe1210700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072390 0x7f8fdc1ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe1210700 1 -- 172.21.15.135:0/252205814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fdc072770 msgr2=0x7f8fdc144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe1210700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fdc072770 0x7f8fdc144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.168+0000 7f8fe1210700 1 -- 172.21.15.135:0/252205814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00094a0 con 0x7f8fdc156050 2024-05-08T20:55:21.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.169+0000 7f8fe1210700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc156050 0x7f8fdc140460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400caf0 tx=0x7f8fd400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:21.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.169+0000 7f8fd97fa700 1 -- 172.21.15.135:0/252205814 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400a9e0 con 0x7f8fdc156050 2024-05-08T20:55:21.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.169+0000 7f8fd97fa700 1 -- 172.21.15.135:0/252205814 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd400ab60 con 0x7f8fdc156050 2024-05-08T20:55:21.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.169+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc159fb0 con 0x7f8fdc156050 2024-05-08T20:55:21.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.169+0000 7f8fd97fa700 1 -- 172.21.15.135:0/252205814 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40070d0 con 0x7f8fdc156050 2024-05-08T20:55:21.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.169+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc1eecf0 con 0x7f8fdc156050 2024-05-08T20:55:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.170+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc0c1c10 con 0x7f8fdc156050 2024-05-08T20:55:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.171+0000 7f8fd97fa700 1 -- 172.21.15.135:0/252205814 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fd4007230 con 0x7f8fdc156050 2024-05-08T20:55:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.171+0000 7f8fd97fa700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8fc006acc0 0x7f8fc006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.171+0000 7f8fd97fa700 1 -- 172.21.15.135:0/252205814 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fd4089570 con 0x7f8fdc156050 2024-05-08T20:55:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.171+0000 7f8fe0a0f700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8fc006acc0 0x7f8fc006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.172+0000 7f8fe0a0f700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8fc006acc0 0x7f8fc006d180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000a010 tx=0x7f8fd0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.175+0000 7f8fd97fa700 1 -- 172.21.15.135:0/252205814 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8fd40544b0 con 0x7f8fdc156050 2024-05-08T20:55:21.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.416+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8fdc067fa0 con 0x7f8fdc156050 2024-05-08T20:55:21.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.524+0000 7f8fd97fa700 1 -- 172.21.15.135:0/252205814 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8fd4018020 con 0x7f8fdc156050 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8fc006acc0 msgr2=0x7f8fc006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8fc006acc0 0x7f8fc006d180 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000a010 tx=0x7f8fd0008030 comp rx=0 tx=0).stop 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc156050 msgr2=0x7f8fdc140460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc156050 0x7f8fdc140460 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400caf0 tx=0x7f8fd400ce00 comp rx=0 tx=0).stop 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 shutdown_connections 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8fc006acc0 0x7f8fc006d180 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8fdc156050 0x7f8fdc140460 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fdc072390 0x7f8fdc1ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 --2- 172.21.15.135:0/252205814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fdc072770 0x7f8fdc144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 >> 172.21.15.135:0/252205814 conn(0x7f8fdc06ec40 msgr2=0x7f8fdc154830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:21.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 shutdown_connections 2024-05-08T20:55:21.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.527+0000 7f8fe2c73700 1 -- 172.21.15.135:0/252205814 wait complete. 2024-05-08T20:55:21.541 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-05-08T20:55:21.541 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T20:55:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.665+0000 7f68eacd7700 1 Processor -- start 2024-05-08T20:55:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.665+0000 7f68eacd7700 1 -- start start 2024-05-08T20:55:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.665+0000 7f68eacd7700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f68e41504c0 0x7f68e40c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.665+0000 7f68eacd7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e4159ae0 0x7f68e40c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.665+0000 7f68eacd7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e41508a0 con 0x7f68e4159670 2024-05-08T20:55:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68eacd7700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40c2de0 con 0x7f68e41504c0 2024-05-08T20:55:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68eacd7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40c5720 con 0x7f68e4159ae0 2024-05-08T20:55:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e4159ae0 0x7f68e40c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e4159ae0 0x7f68e40c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:60992/0 (socket says 172.21.15.135:60992) 2024-05-08T20:55:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 -- 172.21.15.135:0/3551412140 learned_addr learned my addr 172.21.15.135:0/3551412140 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e8a73700 1 --2- 172.21.15.135:0/3551412140 >> v2:172.21.15.183:3300/0 conn(0x7f68e41504c0 0x7f68e40c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 -- 172.21.15.135:0/3551412140 >> v2:172.21.15.183:3300/0 conn(0x7f68e41504c0 msgr2=0x7f68e40c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 --2- 172.21.15.135:0/3551412140 >> v2:172.21.15.183:3300/0 conn(0x7f68e41504c0 0x7f68e40c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 -- 172.21.15.135:0/3551412140 >> v1:172.21.15.183:6789/0 conn(0x7f68e4159670 legacy=0x7f68e4072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 -- 172.21.15.135:0/3551412140 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4072e40 con 0x7f68e4159ae0 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e8a73700 1 --2- 172.21.15.135:0/3551412140 >> v2:172.21.15.183:3300/0 conn(0x7f68e41504c0 0x7f68e40c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.666+0000 7f68e9274700 1 --2- 172.21.15.135:0/3551412140 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e4159ae0 0x7f68e40c6600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00d150 tx=0x7f68dc00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7be7669d3a9e66e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68e37fe700 1 -- 172.21.15.135:0/3551412140 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc010070 con 0x7f68e4159ae0 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68e37fe700 1 -- 172.21.15.135:0/3551412140 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc00dd10 con 0x7f68e4159ae0 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68e37fe700 1 -- 172.21.15.135:0/3551412140 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc00b310 con 0x7f68e4159ae0 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 -- 172.21.15.135:0/3551412140 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e4159ae0 msgr2=0x7f68e40c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3551412140 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e4159ae0 0x7f68e40c6600 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00d150 tx=0x7f68dc00d460 comp rx=0 tx=0).stop 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 -- 172.21.15.135:0/3551412140 shutdown_connections 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3551412140 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e4159ae0 0x7f68e40c6600 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3551412140 >> v2:172.21.15.183:3300/0 conn(0x7f68e41504c0 0x7f68e40c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 -- 172.21.15.135:0/3551412140 >> 172.21.15.135:0/3551412140 conn(0x7f68e406daf0 msgr2=0x7f68e406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:21.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 -- 172.21.15.135:0/3551412140 shutdown_connections 2024-05-08T20:55:21.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.667+0000 7f68eacd7700 1 -- 172.21.15.135:0/3551412140 wait complete. 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.669+0000 7f68eacd7700 1 Processor -- start 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.669+0000 7f68eacd7700 1 -- start start 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68eacd7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e41504c0 0x7f68e413dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68eacd7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e4159670 0x7f68e4143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68eacd7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68e4159ae0 0x7f68e4143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68eacd7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e41eb970 con 0x7f68e4159670 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68eacd7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e406ab00 con 0x7f68e4159ae0 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68eacd7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e414f3f0 con 0x7f68e41504c0 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e4159670 0x7f68e4143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e4159670 0x7f68e4143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49526/0 (socket says 172.21.15.135:49526) 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 -- 172.21.15.135:0/3173341004 learned_addr learned my addr 172.21.15.135:0/3173341004 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e8a73700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e41504c0 0x7f68e413dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e9274700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68e4159ae0 0x7f68e4143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 -- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e41504c0 msgr2=0x7f68e413dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e41504c0 0x7f68e413dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 -- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68e4159ae0 msgr2=0x7f68e4143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68e4159ae0 0x7f68e4143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 -- 172.21.15.135:0/3173341004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80094a0 con 0x7f68e4159670 2024-05-08T20:55:21.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.670+0000 7f68e3fff700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e4159670 0x7f68e4143530 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f68d000c4e0 tx=0x7f68d000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.671+0000 7f68e17fa700 1 -- 172.21.15.135:0/3173341004 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00052d0 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.671+0000 7f68e17fa700 1 -- 172.21.15.135:0/3173341004 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0005430 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.671+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc00bd40 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.671+0000 7f68e17fa700 1 -- 172.21.15.135:0/3173341004 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00038c0 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.671+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e414f9b0 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.672+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e4067fa0 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.672+0000 7f68e17fa700 1 -- 172.21.15.135:0/3173341004 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f68d0003a20 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.672+0000 7f68e17fa700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f68c806ac90 0x7f68c806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.672+0000 7f68e17fa700 1 -- 172.21.15.135:0/3173341004 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68d0088940 con 0x7f68e4159670 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.672+0000 7f68e8a73700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f68c806ac90 0x7f68c806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:21.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.673+0000 7f68e8a73700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f68c806ac90 0x7f68c806d150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009d70 tx=0x7f68d8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:21.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.677+0000 7f68e17fa700 1 -- 172.21.15.135:0/3173341004 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f68d0053840 con 0x7f68e4159670 2024-05-08T20:55:21.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:21.917+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f68e40c27d0 con 0x7f68e4159670 2024-05-08T20:55:22.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.531+0000 7f68e17fa700 1 -- 172.21.15.135:0/3173341004 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f68d0056e60 con 0x7f68e4159670 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f68c806ac90 msgr2=0x7f68c806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f68c806ac90 0x7f68c806d150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009d70 tx=0x7f68d8009210 comp rx=0 tx=0).stop 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e4159670 msgr2=0x7f68e4143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e4159670 0x7f68e4143530 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f68d000c4e0 tx=0x7f68d000c7f0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 shutdown_connections 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f68c806ac90 0x7f68c806d150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68e4159ae0 0x7f68e4143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68e41504c0 0x7f68e413dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 --2- 172.21.15.135:0/3173341004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68e4159670 0x7f68e4143530 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 >> 172.21.15.135:0/3173341004 conn(0x7f68e406daf0 msgr2=0x7f68e4073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:22.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 shutdown_connections 2024-05-08T20:55:22.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.534+0000 7f68eacd7700 1 -- 172.21.15.135:0/3173341004 wait complete. 2024-05-08T20:55:22.548 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-08T20:55:22.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.671+0000 7f8f3009f700 1 Processor -- start 2024-05-08T20:55:22.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.671+0000 7f8f3009f700 1 -- start start 2024-05-08T20:55:22.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f3009f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8f280cbf50 0x7f8f280c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:22.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f3009f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f280c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:22.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f3009f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2815c990 con 0x7f8f281535a0 2024-05-08T20:55:22.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f3009f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2815cbc0 con 0x7f8f280cbf50 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f3009f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2815ce60 con 0x7f8f28072ae0 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2d63a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8f280cbf50 0x7f8f280c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2de3b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8f281535a0 0x7f8f2806a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59764/0 (socket says 172.21.15.135:59764) 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2de3b700 1 -- 172.21.15.135:0/1087864183 learned_addr learned my addr 172.21.15.135:0/1087864183 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2e63c700 1 --2- 172.21.15.135:0/1087864183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f280c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2d63a700 1 -- 172.21.15.135:0/1087864183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 msgr2=0x7f8f280c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2d63a700 1 --2- 172.21.15.135:0/1087864183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f280c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2d63a700 1 -- 172.21.15.135:0/1087864183 >> v1:172.21.15.135:6789/0 conn(0x7f8f281535a0 legacy=0x7f8f2806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2ce39700 1 -- 172.21.15.135:0/1087864183 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548053196 0 0) 0x7f8f2815c990 con 0x7f8f281535a0 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.672+0000 7f8f2d63a700 1 -- 172.21.15.135:0/1087864183 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2815d140 con 0x7f8f280cbf50 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f2d63a700 1 --2- 172.21.15.135:0/1087864183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f280c40b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009840 tx=0x7f8f24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df04b73fe1488ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f2ce39700 1 -- 172.21.15.135:0/1087864183 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24011830 con 0x7f8f280cbf50 2024-05-08T20:55:22.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f2ce39700 1 -- 172.21.15.135:0/1087864183 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24011990 con 0x7f8f280cbf50 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f2ce39700 1 -- 172.21.15.135:0/1087864183 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24011d20 con 0x7f8f280cbf50 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 -- 172.21.15.135:0/1087864183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 msgr2=0x7f8f280c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 --2- 172.21.15.135:0/1087864183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f280c40b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009840 tx=0x7f8f24009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 -- 172.21.15.135:0/1087864183 shutdown_connections 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 --2- 172.21.15.135:0/1087864183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f280c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 --2- 172.21.15.135:0/1087864183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f280c40b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 -- 172.21.15.135:0/1087864183 >> 172.21.15.135:0/1087864183 conn(0x7f8f2806daf0 msgr2=0x7f8f2806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 -- 172.21.15.135:0/1087864183 shutdown_connections 2024-05-08T20:55:22.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.673+0000 7f8f3009f700 1 -- 172.21.15.135:0/1087864183 wait complete. 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 Processor -- start 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 -- start start 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f2815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f28155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f281535a0 0x7f8f281556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f281542e0 con 0x7f8f280cbf50 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2815c750 con 0x7f8f281535a0 2024-05-08T20:55:22.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f3009f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280c29a0 con 0x7f8f28072ae0 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f2d63a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f28155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f2d63a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f28155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32936/0 (socket says 172.21.15.135:32936) 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.675+0000 7f8f2d63a700 1 -- 172.21.15.135:0/4174919465 learned_addr learned my addr 172.21.15.135:0/4174919465 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2de3b700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f2815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2e63c700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f281535a0 0x7f8f281556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2d63a700 1 -- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 msgr2=0x7f8f2815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2d63a700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f2815c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2d63a700 1 -- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f281535a0 msgr2=0x7f8f281556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2d63a700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f281535a0 0x7f8f281556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2d63a700 1 -- 172.21.15.135:0/4174919465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240094a0 con 0x7f8f280cbf50 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2e63c700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f281535a0 0x7f8f281556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2de3b700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f2815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f2d63a700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f28155170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f2806d230 tx=0x7f8f24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:22.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f1e7fc700 1 -- 172.21.15.135:0/4174919465 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240038a0 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f1e7fc700 1 -- 172.21.15.135:0/4174919465 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2401f070 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f1e7fc700 1 -- 172.21.15.135:0/4174919465 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003c20 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2815b070 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.676+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2815b630 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.677+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f280c33c0 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.678+0000 7f8f1e7fc700 1 -- 172.21.15.135:0/4174919465 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f2401a430 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.678+0000 7f8f1e7fc700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8f0c06ac90 0x7f8f0c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.678+0000 7f8f1e7fc700 1 -- 172.21.15.135:0/4174919465 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f24021070 con 0x7f8f280cbf50 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.678+0000 7f8f2de3b700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8f0c06ac90 0x7f8f0c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:22.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.678+0000 7f8f2de3b700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8f0c06ac90 0x7f8f0c06d150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f18000f60 tx=0x7f8f18007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:22.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.682+0000 7f8f1e7fc700 1 -- 172.21.15.135:0/4174919465 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8f24055f50 con 0x7f8f280cbf50 2024-05-08T20:55:22.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:22.925+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f8f28067fa0 con 0x7f8f280cbf50 2024-05-08T20:55:23.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.538+0000 7f8f1e7fc700 1 -- 172.21.15.135:0/4174919465 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f8f24059570 con 0x7f8f280cbf50 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8f0c06ac90 msgr2=0x7f8f0c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8f0c06ac90 0x7f8f0c06d150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f18000f60 tx=0x7f8f18007d30 comp rx=0 tx=0).stop 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 msgr2=0x7f8f28155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f28155170 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f2806d230 tx=0x7f8f24004750 comp rx=0 tx=0).stop 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 shutdown_connections 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8f0c06ac90 0x7f8f0c06d150 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f281535a0 0x7f8f281556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f28072ae0 0x7f8f2815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 --2- 172.21.15.135:0/4174919465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f280cbf50 0x7f8f28155170 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 >> 172.21.15.135:0/4174919465 conn(0x7f8f2806daf0 msgr2=0x7f8f2806b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:23.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 shutdown_connections 2024-05-08T20:55:23.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.541+0000 7f8f3009f700 1 -- 172.21.15.135:0/4174919465 wait complete. 2024-05-08T20:55:23.556 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T20:55:23.556 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:55:23.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.679+0000 7fd916ae8700 1 Processor -- start 2024-05-08T20:55:23.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.679+0000 7fd916ae8700 1 -- start start 2024-05-08T20:55:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.680+0000 7fd916ae8700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd91013d120 0x7fd9100c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.680+0000 7fd916ae8700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91006c1f0 con 0x7fd9100c4ef0 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.680+0000 7fd916ae8700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91006b670 con 0x7fd91006f9e0 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.680+0000 7fd916ae8700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91006b950 con 0x7fd91013d120 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.680+0000 7fd90ffff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd9100c4ef0 0x7fd91006f2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59772/0 (socket says 172.21.15.135:59772) 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.680+0000 7fd90ffff700 1 -- 172.21.15.135:0/1471567501 learned_addr learned my addr 172.21.15.135:0/1471567501 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd914884700 1 --2- 172.21.15.135:0/1471567501 >> v2:172.21.15.183:3300/0 conn(0x7fd91013d120 0x7fd9100c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567293987 0 0) 0x7fd91006c1f0 con 0x7fd9100c4ef0 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9000035b0 con 0x7fd9100c4ef0 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1503736719 0 0) 0x7fd9000035b0 con 0x7fd9100c4ef0 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 >> v2:172.21.15.183:3300/0 conn(0x7fd91013d120 msgr2=0x7fd9100c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 --2- 172.21.15.135:0/1471567501 >> v2:172.21.15.183:3300/0 conn(0x7fd91013d120 0x7fd9100c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 >> v1:172.21.15.183:6789/0 conn(0x7fd91006f9e0 legacy=0x7fd91015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91006bc30 con 0x7fd9100c4ef0 2024-05-08T20:55:23.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7fd8fc001670 con 0x7fd9100c4ef0 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 >> v1:172.21.15.135:6789/0 conn(0x7fd9100c4ef0 legacy=0x7fd91006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900003a00 0x7fd900003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900004850 0x7fd900004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd900005210 0x7fd90000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91006b950 con 0x7fd900003a00 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90000c0c0 con 0x7fd900005210 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90000c280 con 0x7fd900004850 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd914884700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900003a00 0x7fd900003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd915085700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd900005210 0x7fd90000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd90ffff700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900004850 0x7fd900004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd914884700 1 -- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900004850 msgr2=0x7fd900004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd914884700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900004850 0x7fd900004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd914884700 1 -- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd900005210 msgr2=0x7fd90000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd914884700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd900005210 0x7fd90000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd914884700 1 -- 172.21.15.135:0/1471567501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000035b0 con 0x7fd900003a00 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd915085700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd900005210 0x7fd90000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.681+0000 7fd915085700 1 -- 172.21.15.135:0/1471567501 reap_dead start 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd914884700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900003a00 0x7fd900003e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd904009b60 tx=0x7fd900005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b891c3cdf162100 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400e6c0 con 0x7fd900003a00 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90400e820 con 0x7fd900003a00 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd90f7fe700 1 -- 172.21.15.135:0/1471567501 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400eb90 con 0x7fd900003a00 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd916ae8700 1 -- 172.21.15.135:0/1471567501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900003a00 msgr2=0x7fd900003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd916ae8700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900003a00 0x7fd900003e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd904009b60 tx=0x7fd900005880 comp rx=0 tx=0).stop 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd916ae8700 1 -- 172.21.15.135:0/1471567501 shutdown_connections 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd916ae8700 1 --2- 172.21.15.135:0/1471567501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900003a00 0x7fd900003e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd916ae8700 1 -- 172.21.15.135:0/1471567501 >> 172.21.15.135:0/1471567501 conn(0x7fd91006e370 msgr2=0x7fd91006e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd916ae8700 1 -- 172.21.15.135:0/1471567501 shutdown_connections 2024-05-08T20:55:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.682+0000 7fd916ae8700 1 -- 172.21.15.135:0/1471567501 wait complete. 2024-05-08T20:55:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.684+0000 7fd916ae8700 1 Processor -- start 2024-05-08T20:55:23.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.684+0000 7fd916ae8700 1 -- start start 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd916ae8700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900003a00 0x7fd9100c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd916ae8700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd910157d10 0x7fd9100c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd916ae8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9101f2460 0x7fd9100c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd916ae8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101ef860 con 0x7fd9101f2460 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd916ae8700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910151360 con 0x7fd910157d10 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd916ae8700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100c2ce0 con 0x7fd900003a00 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9101f2460 0x7fd9100c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9101f2460 0x7fd9100c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32950/0 (socket says 172.21.15.135:32950) 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 -- 172.21.15.135:0/3082943906 learned_addr learned my addr 172.21.15.135:0/3082943906 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd90ffff700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd910157d10 0x7fd9100c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd914884700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900003a00 0x7fd9100c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 -- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900003a00 msgr2=0x7fd9100c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900003a00 0x7fd9100c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 -- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd910157d10 msgr2=0x7fd9100c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd910157d10 0x7fd9100c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 -- 172.21.15.135:0/3082943906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910154650 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.685+0000 7fd915085700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9101f2460 0x7fd9100c1a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd910070ea0 tx=0x7fd90800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.686+0000 7fd90d7fa700 1 -- 172.21.15.135:0/3082943906 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90800ee80 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.686+0000 7fd90d7fa700 1 -- 172.21.15.135:0/3082943906 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908003c10 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.686+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd910154930 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.686+0000 7fd90d7fa700 1 -- 172.21.15.135:0/3082943906 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9080050d0 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.686+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9101ef480 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.686+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9101ef640 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.687+0000 7fd90d7fa700 1 -- 172.21.15.135:0/3082943906 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd908005230 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.687+0000 7fd90d7fa700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8f406ac90 0x7fd8f406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.687+0000 7fd90d7fa700 1 -- 172.21.15.135:0/3082943906 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd908089490 con 0x7fd9101f2460 2024-05-08T20:55:23.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.687+0000 7fd914884700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8f406ac90 0x7fd8f406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:23.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.688+0000 7fd914884700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8f406ac90 0x7fd8f406d150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9040090b0 tx=0x7fd90401f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:23.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.692+0000 7fd90d7fa700 1 -- 172.21.15.135:0/3082943906 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd9080542f0 con 0x7fd9101f2460 2024-05-08T20:55:23.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.933+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9101ef9a0 con 0x7fd9101f2460 2024-05-08T20:55:23.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.934+0000 7fd90d7fa700 1 -- 172.21.15.135:0/3082943906 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6260 (secure 0 0 0) 0x7fd9101ef9a0 con 0x7fd9101f2460 2024-05-08T20:55:23.936 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:23.937 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:23.530682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:55:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8f406ac90 msgr2=0x7fd8f406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8f406ac90 0x7fd8f406d150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd9040090b0 tx=0x7fd90401f040 comp rx=0 tx=0).stop 2024-05-08T20:55:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9101f2460 msgr2=0x7fd9100c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9101f2460 0x7fd9100c1a40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd910070ea0 tx=0x7fd90800ed50 comp rx=0 tx=0).stop 2024-05-08T20:55:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 shutdown_connections 2024-05-08T20:55:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8f406ac90 0x7fd8f406d150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9101f2460 0x7fd9100c1a40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd900003a00 0x7fd9100c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 --2- 172.21.15.135:0/3082943906 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd910157d10 0x7fd9100c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:23.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 >> 172.21.15.135:0/3082943906 conn(0x7fd91006e370 msgr2=0x7fd91013f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:23.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 shutdown_connections 2024-05-08T20:55:23.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:23.936+0000 7fd916ae8700 1 -- 172.21.15.135:0/3082943906 wait complete. 2024-05-08T20:55:23.939 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-08T20:55:23.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:24.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.070+0000 7f45e9abf700 1 Processor -- start 2024-05-08T20:55:24.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.070+0000 7f45e9abf700 1 -- start start 2024-05-08T20:55:24.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e9abf700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f45e40c9e80 0x7f45e415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e9abf700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45e40c1f70 0x7f45e40c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e9abf700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e415b620 con 0x7f45e4151400 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e9abf700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e40c1b20 con 0x7f45e40c1f70 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e9abf700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e40cd8e0 con 0x7f45e40c9e80 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45e40c1f70 0x7f45e40c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f45e40c1f70 0x7f45e40c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32954/0 (socket says 172.21.15.135:32954) 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 -- 172.21.15.135:0/82606471 learned_addr learned my addr 172.21.15.135:0/82606471 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e2ffd700 1 --2- 172.21.15.135:0/82606471 >> v2:172.21.15.183:3300/0 conn(0x7f45e40c9e80 0x7f45e415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 -- 172.21.15.135:0/82606471 >> v2:172.21.15.183:3300/0 conn(0x7f45e40c9e80 msgr2=0x7f45e415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 --2- 172.21.15.135:0/82606471 >> v2:172.21.15.183:3300/0 conn(0x7f45e40c9e80 0x7f45e415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 -- 172.21.15.135:0/82606471 >> v1:172.21.15.183:6789/0 conn(0x7f45e4151400 legacy=0x7f45e4070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 -- 172.21.15.135:0/82606471 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40c2900 con 0x7f45e40c1f70 2024-05-08T20:55:24.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.071+0000 7f45e3fff700 1 --2- 172.21.15.135:0/82606471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e40c23c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f45e40c1c60 tx=0x7f45dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9b3c4b88bb157d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e27fc700 1 -- 172.21.15.135:0/82606471 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00e070 con 0x7f45e40c1f70 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e27fc700 1 -- 172.21.15.135:0/82606471 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc00b950 con 0x7f45e40c1f70 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e27fc700 1 -- 172.21.15.135:0/82606471 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00bd00 con 0x7f45e40c1f70 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 -- 172.21.15.135:0/82606471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 msgr2=0x7f45e40c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 --2- 172.21.15.135:0/82606471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e40c23c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f45e40c1c60 tx=0x7f45dc00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 -- 172.21.15.135:0/82606471 shutdown_connections 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 --2- 172.21.15.135:0/82606471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e40c23c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 --2- 172.21.15.135:0/82606471 >> v2:172.21.15.183:3300/0 conn(0x7f45e40c9e80 0x7f45e415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 -- 172.21.15.135:0/82606471 >> 172.21.15.135:0/82606471 conn(0x7f45e4066d70 msgr2=0x7f45e406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 -- 172.21.15.135:0/82606471 shutdown_connections 2024-05-08T20:55:24.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.072+0000 7f45e9abf700 1 -- 172.21.15.135:0/82606471 wait complete. 2024-05-08T20:55:24.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.073+0000 7f45e9abf700 1 Processor -- start 2024-05-08T20:55:24.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e9abf700 1 -- start start 2024-05-08T20:55:24.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e9abf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e9abf700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e40c9e80 0x7f45e4157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e9abf700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e4151400 0x7f45e41eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e9abf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e415ac90 con 0x7f45e40c1f70 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e9abf700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e415a300 con 0x7f45e40c9e80 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e9abf700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e415aa20 con 0x7f45e4151400 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32964/0 (socket says 172.21.15.135:32964) 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e37fe700 1 -- 172.21.15.135:0/719196082 learned_addr learned my addr 172.21.15.135:0/719196082 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e3fff700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e4151400 0x7f45e41eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.074+0000 7f45e2ffd700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e40c9e80 0x7f45e4157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e37fe700 1 -- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e4151400 msgr2=0x7f45e41eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e37fe700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e4151400 0x7f45e41eeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e37fe700 1 -- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e40c9e80 msgr2=0x7f45e4157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e37fe700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e40c9e80 0x7f45e4157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e37fe700 1 -- 172.21.15.135:0/719196082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009b30 con 0x7f45e40c1f70 2024-05-08T20:55:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e3fff700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e4151400 0x7f45e41eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e37fe700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e415a4e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00b4d0 tx=0x7f45cc00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45dbfff700 1 -- 172.21.15.135:0/719196082 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011830 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45dbfff700 1 -- 172.21.15.135:0/719196082 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc011990 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45dbfff700 1 -- 172.21.15.135:0/719196082 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011d40 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e41f1ff0 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.075+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e41f25b0 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.076+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e4067fa0 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.076+0000 7f45dbfff700 1 -- 172.21.15.135:0/719196082 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45cc01a400 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.077+0000 7f45dbfff700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f45c406acc0 0x7f45c406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.077+0000 7f45dbfff700 1 -- 172.21.15.135:0/719196082 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45cc089290 con 0x7f45e40c1f70 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.077+0000 7f45e2ffd700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f45c406acc0 0x7f45c406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.077+0000 7f45e2ffd700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f45c406acc0 0x7f45c406d180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45e40cb000 tx=0x7f45d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.081+0000 7f45dbfff700 1 -- 172.21.15.135:0/719196082 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f45cc054180 con 0x7f45e40c1f70 2024-05-08T20:55:24.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.281+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45e40ca9a0 con 0x7f45e40c1f70 2024-05-08T20:55:24.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.282+0000 7f45dbfff700 1 -- 172.21.15.135:0/719196082 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f45cc0577a0 con 0x7f45e40c1f70 2024-05-08T20:55:24.284 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:24.284 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:24.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f45c406acc0 msgr2=0x7f45c406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f45c406acc0 0x7f45c406d180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45e40cb000 tx=0x7f45d4008040 comp rx=0 tx=0).stop 2024-05-08T20:55:24.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 msgr2=0x7f45e415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e415a4e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00b4d0 tx=0x7f45cc00b7e0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 shutdown_connections 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f45c406acc0 0x7f45c406d180 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e4151400 0x7f45e41eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45e40c1f70 0x7f45e415a4e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 --2- 172.21.15.135:0/719196082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e40c9e80 0x7f45e4157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 >> 172.21.15.135:0/719196082 conn(0x7f45e4066d70 msgr2=0x7f45e40cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 shutdown_connections 2024-05-08T20:55:24.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.284+0000 7f45e9abf700 1 -- 172.21.15.135:0/719196082 wait complete. 2024-05-08T20:55:24.298 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T20:55:24.299 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:55:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.418+0000 7f3ce9e54700 1 Processor -- start 2024-05-08T20:55:24.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.418+0000 7f3ce9e54700 1 -- start start 2024-05-08T20:55:24.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce9e54700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce406bc50 0x7f3ce40c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce9e54700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce406a960 con 0x7f3ce4159390 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce9e54700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce406b7c0 con 0x7f3ce41535a0 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce9e54700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce406e700 con 0x7f3ce406bc50 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce3fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f3ce4159390 0x7f3ce4159820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59788/0 (socket says 172.21.15.135:59788) 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce3fff700 1 -- 172.21.15.135:0/3552205542 learned_addr learned my addr 172.21.15.135:0/3552205542 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3cdbfff700 1 --2- 172.21.15.135:0/3552205542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce406bc50 0x7f3ce40c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce2ffd700 1 -- 172.21.15.135:0/3552205542 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768353523 0 0) 0x7f3ce406a960 con 0x7f3ce4159390 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce2ffd700 1 -- 172.21.15.135:0/3552205542 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd00035b0 con 0x7f3ce4159390 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.419+0000 7f3ce2ffd700 1 -- 172.21.15.135:0/3552205542 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041097574 0 0) 0x7f3ce406b7c0 con 0x7f3ce41535a0 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3ce2ffd700 1 -- 172.21.15.135:0/3552205542 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce406a960 con 0x7f3ce41535a0 2024-05-08T20:55:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3cdbfff700 1 -- 172.21.15.135:0/3552205542 >> v1:172.21.15.183:6789/0 conn(0x7f3ce41535a0 legacy=0x7f3ce406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3cdbfff700 1 -- 172.21.15.135:0/3552205542 >> v1:172.21.15.135:6789/0 conn(0x7f3ce4159390 legacy=0x7f3ce4159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3cdbfff700 1 -- 172.21.15.135:0/3552205542 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce406abb0 con 0x7f3ce406bc50 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3cdbfff700 1 --2- 172.21.15.135:0/3552205542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce406bc50 0x7f3ce40c63f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0098a0 tx=0x7f3ccc009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56a7848bc54153f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3ce2ffd700 1 -- 172.21.15.135:0/3552205542 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc011830 con 0x7f3ce406bc50 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3ce2ffd700 1 -- 172.21.15.135:0/3552205542 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc011990 con 0x7f3ce406bc50 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.420+0000 7f3ce2ffd700 1 -- 172.21.15.135:0/3552205542 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc011d00 con 0x7f3ce406bc50 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.421+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3552205542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce406bc50 msgr2=0x7f3ce40c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.421+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3552205542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce406bc50 0x7f3ce40c63f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0098a0 tx=0x7f3ccc009bb0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.421+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3552205542 shutdown_connections 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.421+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3552205542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce406bc50 0x7f3ce40c63f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.421+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3552205542 >> 172.21.15.135:0/3552205542 conn(0x7f3ce40cb200 msgr2=0x7f3ce40cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.421+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3552205542 shutdown_connections 2024-05-08T20:55:24.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.421+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3552205542 wait complete. 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 Processor -- start 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 -- start start 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce406bc50 0x7f3ce414bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce41535a0 0x7f3ce414b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce4159390 0x7f3ce41f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce41f2f20 con 0x7f3ce4159390 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4155040 con 0x7f3ce406bc50 2024-05-08T20:55:24.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.422+0000 7f3ce9e54700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce41f2c40 con 0x7f3ce41535a0 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce4159390 0x7f3ce41f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce4159390 0x7f3ce41f2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32976/0 (socket says 172.21.15.135:32976) 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 -- 172.21.15.135:0/3767189028 learned_addr learned my addr 172.21.15.135:0/3767189028 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce37fe700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce406bc50 0x7f3ce414bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3cdbfff700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce41535a0 0x7f3ce414b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 -- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce41535a0 msgr2=0x7f3ce414b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce41535a0 0x7f3ce414b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 -- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce406bc50 msgr2=0x7f3ce414bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce406bc50 0x7f3ce414bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 -- 172.21.15.135:0/3767189028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0094a0 con 0x7f3ce4159390 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce3fff700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce4159390 0x7f3ce41f2280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00caf0 tx=0x7f3cdc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce0ff9700 1 -- 172.21.15.135:0/3767189028 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00aad0 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce0ff9700 1 -- 172.21.15.135:0/3767189028 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00ac30 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce0ff9700 1 -- 172.21.15.135:0/3767189028 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc012400 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce414ad40 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.423+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce40c9a10 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.424+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce4072240 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.425+0000 7f3ce0ff9700 1 -- 172.21.15.135:0/3767189028 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3cdc01b3b0 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.425+0000 7f3ce0ff9700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3cc406ac90 0x7f3cc406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.425+0000 7f3ce0ff9700 1 -- 172.21.15.135:0/3767189028 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3cdc089440 con 0x7f3ce4159390 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.425+0000 7f3ce37fe700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3cc406ac90 0x7f3cc406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.425+0000 7f3ce37fe700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3cc406ac90 0x7f3cc406d150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40016f0 tx=0x7f3cd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.429+0000 7f3ce0ff9700 1 -- 172.21.15.135:0/3767189028 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3cdc0542b0 con 0x7f3ce4159390 2024-05-08T20:55:24.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.629+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ce406b450 con 0x7f3cc406ac90 2024-05-08T20:55:24.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.638+0000 7f3ce0ff9700 1 -- 172.21.15.135:0/3767189028 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345233 (secure 0 0 0) 0x7f3cd40050d0 con 0x7f3cc406ac90 2024-05-08T20:55:24.645 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:24.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3cc406ac90 msgr2=0x7f3cc406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3cc406ac90 0x7f3cc406d150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40016f0 tx=0x7f3cd4009040 comp rx=0 tx=0).stop 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce4159390 msgr2=0x7f3ce41f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce4159390 0x7f3ce41f2280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00caf0 tx=0x7f3cdc00ceb0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 shutdown_connections 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3cc406ac90 0x7f3cc406d150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ce406bc50 0x7f3ce414bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ce4159390 0x7f3ce41f2280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 --2- 172.21.15.135:0/3767189028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ce41535a0 0x7f3ce414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 >> 172.21.15.135:0/3767189028 conn(0x7f3ce40cb200 msgr2=0x7f3ce40c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 shutdown_connections 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.642+0000 7f3ce9e54700 1 -- 172.21.15.135:0/3767189028 wait complete. 2024-05-08T20:55:24.649 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T20:55:24.656 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-05-08T20:55:24.460897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2025532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002977"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210658+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T20:55:04.210658+0000","last_peered":"2024-05-08T20:55:04.210658+0000","last_clean":"2024-05-08T20:55:04.210658+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T20:55:04.210658+0000","last_undegraded":"2024-05-08T20:55:04.210658+0000","last_fullsized":"2024-05-08T20:55:04.210658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106818+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T20:55:04.106818+0000","last_peered":"2024-05-08T20:55:04.106818+0000","last_clean":"2024-05-08T20:55:04.106818+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T20:55:04.106818+0000","last_undegraded":"2024-05-08T20:55:04.106818+0000","last_fullsized":"2024-05-08T20:55:04.106818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100019+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T20:55:04.100019+0000","last_peered":"2024-05-08T20:55:04.100019+0000","last_clean":"2024-05-08T20:55:04.100019+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T20:55:04.100019+0000","last_undegraded":"2024-05-08T20:55:04.100019+0000","last_fullsized":"2024-05-08T20:55:04.100019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101967+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T20:55:04.101967+0000","last_peered":"2024-05-08T20:55:04.101967+0000","last_clean":"2024-05-08T20:55:04.101967+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T20:55:04.101967+0000","last_undegraded":"2024-05-08T20:55:04.101967+0000","last_fullsized":"2024-05-08T20:55:04.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209670+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T20:55:04.209670+0000","last_peered":"2024-05-08T20:55:04.209670+0000","last_clean":"2024-05-08T20:55:04.209670+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T20:55:04.209670+0000","last_undegraded":"2024-05-08T20:55:04.209670+0000","last_fullsized":"2024-05-08T20:55:04.209670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102240+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T20:55:04.102240+0000","last_peered":"2024-05-08T20:55:04.102240+0000","last_clean":"2024-05-08T20:55:04.102240+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T20:55:04.102240+0000","last_undegraded":"2024-05-08T20:55:04.102240+0000","last_fullsized":"2024-05-08T20:55:04.102240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209219+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T20:55:04.209219+0000","last_peered":"2024-05-08T20:55:04.209219+0000","last_clean":"2024-05-08T20:55:04.209219+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T20:55:04.209219+0000","last_undegraded":"2024-05-08T20:55:04.209219+0000","last_fullsized":"2024-05-08T20:55:04.209219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091254+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T20:55:04.091254+0000","last_peered":"2024-05-08T20:55:04.091254+0000","last_clean":"2024-05-08T20:55:04.091254+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T20:55:04.091254+0000","last_undegraded":"2024-05-08T20:55:04.091254+0000","last_fullsized":"2024-05-08T20:55:04.091254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210538+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T20:55:04.210538+0000","last_peered":"2024-05-08T20:55:04.210538+0000","last_clean":"2024-05-08T20:55:04.210538+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T20:55:04.210538+0000","last_undegraded":"2024-05-08T20:55:04.210538+0000","last_fullsized":"2024-05-08T20:55:04.210538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091771+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T20:55:04.091771+0000","last_peered":"2024-05-08T20:55:04.091771+0000","last_clean":"2024-05-08T20:55:04.091771+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T20:55:04.091771+0000","last_undegraded":"2024-05-08T20:55:04.091771+0000","last_fullsized":"2024-05-08T20:55:04.091771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095917+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T20:55:04.095917+0000","last_peered":"2024-05-08T20:55:04.095917+0000","last_clean":"2024-05-08T20:55:04.095917+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T20:55:04.095917+0000","last_undegraded":"2024-05-08T20:55:04.095917+0000","last_fullsized":"2024-05-08T20:55:04.095917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090851+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T20:55:04.090851+0000","last_peered":"2024-05-08T20:55:04.090851+0000","last_clean":"2024-05-08T20:55:04.090851+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T20:55:04.090851+0000","last_undegraded":"2024-05-08T20:55:04.090851+0000","last_fullsized":"2024-05-08T20:55:04.090851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100626+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T20:55:04.100626+0000","last_peered":"2024-05-08T20:55:04.100626+0000","last_clean":"2024-05-08T20:55:04.100626+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T20:55:04.100626+0000","last_undegraded":"2024-05-08T20:55:04.100626+0000","last_fullsized":"2024-05-08T20:55:04.100626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105894+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T20:55:04.105894+0000","last_peered":"2024-05-08T20:55:04.105894+0000","last_clean":"2024-05-08T20:55:04.105894+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T20:55:04.105894+0000","last_undegraded":"2024-05-08T20:55:04.105894+0000","last_fullsized":"2024-05-08T20:55:04.105894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101412+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T20:55:04.101412+0000","last_peered":"2024-05-08T20:55:04.101412+0000","last_clean":"2024-05-08T20:55:04.101412+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T20:55:04.101412+0000","last_undegraded":"2024-05-08T20:55:04.101412+0000","last_fullsized":"2024-05-08T20:55:04.101412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102105+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T20:55:04.102105+0000","last_peered":"2024-05-08T20:55:04.102105+0000","last_clean":"2024-05-08T20:55:04.102105+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T20:55:04.102105+0000","last_undegraded":"2024-05-08T20:55:04.102105+0000","last_fullsized":"2024-05-08T20:55:04.102105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097726+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T20:55:04.097726+0000","last_peered":"2024-05-08T20:55:04.097726+0000","last_clean":"2024-05-08T20:55:04.097726+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T20:55:04.097726+0000","last_undegraded":"2024-05-08T20:55:04.097726+0000","last_fullsized":"2024-05-08T20:55:04.097726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210168+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T20:55:04.210168+0000","last_peered":"2024-05-08T20:55:04.210168+0000","last_clean":"2024-05-08T20:55:04.210168+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T20:55:04.210168+0000","last_undegraded":"2024-05-08T20:55:04.210168+0000","last_fullsized":"2024-05-08T20:55:04.210168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512517+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T20:55:04.512517+0000","last_peered":"2024-05-08T20:55:04.512517+0000","last_clean":"2024-05-08T20:55:04.512517+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T20:55:04.512517+0000","last_undegraded":"2024-05-08T20:55:04.512517+0000","last_fullsized":"2024-05-08T20:55:04.512517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:53.835534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100281+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T20:55:04.100281+0000","last_peered":"2024-05-08T20:55:04.100281+0000","last_clean":"2024-05-08T20:55:04.100281+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T20:55:04.100281+0000","last_undegraded":"2024-05-08T20:55:04.100281+0000","last_fullsized":"2024-05-08T20:55:04.100281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091690+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T20:55:04.091690+0000","last_peered":"2024-05-08T20:55:04.091690+0000","last_clean":"2024-05-08T20:55:04.091690+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T20:55:04.091690+0000","last_undegraded":"2024-05-08T20:55:04.091690+0000","last_fullsized":"2024-05-08T20:55:04.091690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519037+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T20:55:04.519037+0000","last_peered":"2024-05-08T20:55:04.519037+0000","last_clean":"2024-05-08T20:55:04.519037+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T20:55:04.519037+0000","last_undegraded":"2024-05-08T20:55:04.519037+0000","last_fullsized":"2024-05-08T20:55:04.519037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091796+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T20:55:04.091796+0000","last_peered":"2024-05-08T20:55:04.091796+0000","last_clean":"2024-05-08T20:55:04.091796+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T20:55:04.091796+0000","last_undegraded":"2024-05-08T20:55:04.091796+0000","last_fullsized":"2024-05-08T20:55:04.091796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100188+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T20:55:04.100188+0000","last_peered":"2024-05-08T20:55:04.100188+0000","last_clean":"2024-05-08T20:55:04.100188+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T20:55:04.100188+0000","last_undegraded":"2024-05-08T20:55:04.100188+0000","last_fullsized":"2024-05-08T20:55:04.100188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519193+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T20:55:04.519193+0000","last_peered":"2024-05-08T20:55:04.519193+0000","last_clean":"2024-05-08T20:55:04.519193+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T20:55:04.519193+0000","last_undegraded":"2024-05-08T20:55:04.519193+0000","last_fullsized":"2024-05-08T20:55:04.519193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:49.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209957+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T20:55:04.209957+0000","last_peered":"2024-05-08T20:55:04.209957+0000","last_clean":"2024-05-08T20:55:04.209957+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T20:55:04.209957+0000","last_undegraded":"2024-05-08T20:55:04.209957+0000","last_fullsized":"2024-05-08T20:55:04.209957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101756+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T20:55:04.101756+0000","last_peered":"2024-05-08T20:55:04.101756+0000","last_clean":"2024-05-08T20:55:04.101756+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T20:55:04.101756+0000","last_undegraded":"2024-05-08T20:55:04.101756+0000","last_fullsized":"2024-05-08T20:55:04.101756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519088+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T20:55:04.519088+0000","last_peered":"2024-05-08T20:55:04.519088+0000","last_clean":"2024-05-08T20:55:04.519088+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T20:55:04.519088+0000","last_undegraded":"2024-05-08T20:55:04.519088+0000","last_fullsized":"2024-05-08T20:55:04.519088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209700+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T20:55:04.209700+0000","last_peered":"2024-05-08T20:55:04.209700+0000","last_clean":"2024-05-08T20:55:04.209700+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T20:55:04.209700+0000","last_undegraded":"2024-05-08T20:55:04.209700+0000","last_fullsized":"2024-05-08T20:55:04.209700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102182+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T20:55:04.102182+0000","last_peered":"2024-05-08T20:55:04.102182+0000","last_clean":"2024-05-08T20:55:04.102182+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T20:55:04.102182+0000","last_undegraded":"2024-05-08T20:55:04.102182+0000","last_fullsized":"2024-05-08T20:55:04.102182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512895+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T20:55:04.512895+0000","last_peered":"2024-05-08T20:55:04.512895+0000","last_clean":"2024-05-08T20:55:04.512895+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T20:55:04.512895+0000","last_undegraded":"2024-05-08T20:55:04.512895+0000","last_fullsized":"2024-05-08T20:55:04.512895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:15.767597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091524+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T20:55:04.091524+0000","last_peered":"2024-05-08T20:55:04.091524+0000","last_clean":"2024-05-08T20:55:04.091524+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T20:55:04.091524+0000","last_undegraded":"2024-05-08T20:55:04.091524+0000","last_fullsized":"2024-05-08T20:55:04.091524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.094714+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T20:55:04.094714+0000","last_peered":"2024-05-08T20:55:04.094714+0000","last_clean":"2024-05-08T20:55:04.094714+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T20:55:04.094714+0000","last_undegraded":"2024-05-08T20:55:04.094714+0000","last_fullsized":"2024-05-08T20:55:04.094714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:00.135628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872171+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T20:55:04.872171+0000","last_peered":"2024-05-08T20:55:04.872171+0000","last_clean":"2024-05-08T20:55:04.872171+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T20:55:04.872171+0000","last_undegraded":"2024-05-08T20:55:04.872171+0000","last_fullsized":"2024-05-08T20:55:04.872171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:52.925278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092648+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T20:55:04.092648+0000","last_peered":"2024-05-08T20:55:04.092648+0000","last_clean":"2024-05-08T20:55:04.092648+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T20:55:04.092648+0000","last_undegraded":"2024-05-08T20:55:04.092648+0000","last_fullsized":"2024-05-08T20:55:04.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100316+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T20:55:04.100316+0000","last_peered":"2024-05-08T20:55:04.100316+0000","last_clean":"2024-05-08T20:55:04.100316+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T20:55:04.100316+0000","last_undegraded":"2024-05-08T20:55:04.100316+0000","last_fullsized":"2024-05-08T20:55:04.100316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655299+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T20:55:04.655299+0000","last_peered":"2024-05-08T20:55:04.655299+0000","last_clean":"2024-05-08T20:55:04.655299+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T20:55:04.655299+0000","last_undegraded":"2024-05-08T20:55:04.655299+0000","last_fullsized":"2024-05-08T20:55:04.655299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090657+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T20:55:04.090657+0000","last_peered":"2024-05-08T20:55:04.090657+0000","last_clean":"2024-05-08T20:55:04.090657+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T20:55:04.090657+0000","last_undegraded":"2024-05-08T20:55:04.090657+0000","last_fullsized":"2024-05-08T20:55:04.090657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090599+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T20:55:04.090599+0000","last_peered":"2024-05-08T20:55:04.090599+0000","last_clean":"2024-05-08T20:55:04.090599+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T20:55:04.090599+0000","last_undegraded":"2024-05-08T20:55:04.090599+0000","last_fullsized":"2024-05-08T20:55:04.090599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.874020+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T20:55:04.874020+0000","last_peered":"2024-05-08T20:55:04.874020+0000","last_clean":"2024-05-08T20:55:04.874020+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T20:55:04.874020+0000","last_undegraded":"2024-05-08T20:55:04.874020+0000","last_fullsized":"2024-05-08T20:55:04.874020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101470+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T20:55:04.101470+0000","last_peered":"2024-05-08T20:55:04.101470+0000","last_clean":"2024-05-08T20:55:04.101470+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T20:55:04.101470+0000","last_undegraded":"2024-05-08T20:55:04.101470+0000","last_fullsized":"2024-05-08T20:55:04.101470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105915+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T20:55:04.105915+0000","last_peered":"2024-05-08T20:55:04.105915+0000","last_clean":"2024-05-08T20:55:04.105915+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T20:55:04.105915+0000","last_undegraded":"2024-05-08T20:55:04.105915+0000","last_fullsized":"2024-05-08T20:55:04.105915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512493+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T20:55:04.512493+0000","last_peered":"2024-05-08T20:55:04.512493+0000","last_clean":"2024-05-08T20:55:04.512493+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T20:55:04.512493+0000","last_undegraded":"2024-05-08T20:55:04.512493+0000","last_fullsized":"2024-05-08T20:55:04.512493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:25.005036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093315+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T20:55:04.093315+0000","last_peered":"2024-05-08T20:55:04.093315+0000","last_clean":"2024-05-08T20:55:04.093315+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T20:55:04.093315+0000","last_undegraded":"2024-05-08T20:55:04.093315+0000","last_fullsized":"2024-05-08T20:55:04.093315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101936+0000","last_change":"2024-05-08T20:55:00.101507+0000","last_active":"2024-05-08T20:55:04.101936+0000","last_peered":"2024-05-08T20:55:04.101936+0000","last_clean":"2024-05-08T20:55:04.101936+0000","last_became_active":"2024-05-08T20:55:00.101218+0000","last_became_peered":"2024-05-08T20:55:00.101218+0000","last_unstale":"2024-05-08T20:55:04.101936+0000","last_undegraded":"2024-05-08T20:55:04.101936+0000","last_fullsized":"2024-05-08T20:55:04.101936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512444+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T20:55:04.512444+0000","last_peered":"2024-05-08T20:55:04.512444+0000","last_clean":"2024-05-08T20:55:04.512444+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T20:55:04.512444+0000","last_undegraded":"2024-05-08T20:55:04.512444+0000","last_fullsized":"2024-05-08T20:55:04.512444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101935+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T20:55:04.101935+0000","last_peered":"2024-05-08T20:55:04.101935+0000","last_clean":"2024-05-08T20:55:04.101935+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T20:55:04.101935+0000","last_undegraded":"2024-05-08T20:55:04.101935+0000","last_fullsized":"2024-05-08T20:55:04.101935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100361+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T20:55:04.100361+0000","last_peered":"2024-05-08T20:55:04.100361+0000","last_clean":"2024-05-08T20:55:04.100361+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T20:55:04.100361+0000","last_undegraded":"2024-05-08T20:55:04.100361+0000","last_fullsized":"2024-05-08T20:55:04.100361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519609+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T20:55:04.519609+0000","last_peered":"2024-05-08T20:55:04.519609+0000","last_clean":"2024-05-08T20:55:04.519609+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T20:55:04.519609+0000","last_undegraded":"2024-05-08T20:55:04.519609+0000","last_fullsized":"2024-05-08T20:55:04.519609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106365+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T20:55:04.106365+0000","last_peered":"2024-05-08T20:55:04.106365+0000","last_clean":"2024-05-08T20:55:04.106365+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T20:55:04.106365+0000","last_undegraded":"2024-05-08T20:55:04.106365+0000","last_fullsized":"2024-05-08T20:55:04.106365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095830+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T20:55:04.095830+0000","last_peered":"2024-05-08T20:55:04.095830+0000","last_clean":"2024-05-08T20:55:04.095830+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T20:55:04.095830+0000","last_undegraded":"2024-05-08T20:55:04.095830+0000","last_fullsized":"2024-05-08T20:55:04.095830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872220+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T20:55:04.872220+0000","last_peered":"2024-05-08T20:55:04.872220+0000","last_clean":"2024-05-08T20:55:04.872220+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T20:55:04.872220+0000","last_undegraded":"2024-05-08T20:55:04.872220+0000","last_fullsized":"2024-05-08T20:55:04.872220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.651925+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T20:55:09.651925+0000","last_peered":"2024-05-08T20:55:09.651925+0000","last_clean":"2024-05-08T20:55:09.651925+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T20:55:09.651925+0000","last_undegraded":"2024-05-08T20:55:09.651925+0000","last_fullsized":"2024-05-08T20:55:09.651925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210218+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T20:55:04.210218+0000","last_peered":"2024-05-08T20:55:04.210218+0000","last_clean":"2024-05-08T20:55:04.210218+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T20:55:04.210218+0000","last_undegraded":"2024-05-08T20:55:04.210218+0000","last_fullsized":"2024-05-08T20:55:04.210218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.517096+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T20:55:04.517096+0000","last_peered":"2024-05-08T20:55:04.517096+0000","last_clean":"2024-05-08T20:55:04.517096+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T20:55:04.517096+0000","last_undegraded":"2024-05-08T20:55:04.517096+0000","last_fullsized":"2024-05-08T20:55:04.517096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100573+0000","last_change":"2024-05-08T20:54:59.629962+0000","last_active":"2024-05-08T20:55:04.100573+0000","last_peered":"2024-05-08T20:55:04.100573+0000","last_clean":"2024-05-08T20:55:04.100573+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T20:55:04.100573+0000","last_undegraded":"2024-05-08T20:55:04.100573+0000","last_fullsized":"2024-05-08T20:55:04.100573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100713+0000","last_change":"2024-05-08T20:55:00.102710+0000","last_active":"2024-05-08T20:55:04.100713+0000","last_peered":"2024-05-08T20:55:04.100713+0000","last_clean":"2024-05-08T20:55:04.100713+0000","last_became_active":"2024-05-08T20:55:00.102463+0000","last_became_peered":"2024-05-08T20:55:00.102463+0000","last_unstale":"2024-05-08T20:55:04.100713+0000","last_undegraded":"2024-05-08T20:55:04.100713+0000","last_fullsized":"2024-05-08T20:55:04.100713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512860+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T20:55:04.512860+0000","last_peered":"2024-05-08T20:55:04.512860+0000","last_clean":"2024-05-08T20:55:04.512860+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T20:55:04.512860+0000","last_undegraded":"2024-05-08T20:55:04.512860+0000","last_fullsized":"2024-05-08T20:55:04.512860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.959849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101724+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T20:55:04.101724+0000","last_peered":"2024-05-08T20:55:04.101724+0000","last_clean":"2024-05-08T20:55:04.101724+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T20:55:04.101724+0000","last_undegraded":"2024-05-08T20:55:04.101724+0000","last_fullsized":"2024-05-08T20:55:04.101724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209759+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T20:55:04.209759+0000","last_peered":"2024-05-08T20:55:04.209759+0000","last_clean":"2024-05-08T20:55:04.209759+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T20:55:04.209759+0000","last_undegraded":"2024-05-08T20:55:04.209759+0000","last_fullsized":"2024-05-08T20:55:04.209759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512867+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T20:55:04.512867+0000","last_peered":"2024-05-08T20:55:04.512867+0000","last_clean":"2024-05-08T20:55:04.512867+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T20:55:04.512867+0000","last_undegraded":"2024-05-08T20:55:04.512867+0000","last_fullsized":"2024-05-08T20:55:04.512867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:34.555272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091308+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T20:55:04.091308+0000","last_peered":"2024-05-08T20:55:04.091308+0000","last_clean":"2024-05-08T20:55:04.091308+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T20:55:04.091308+0000","last_undegraded":"2024-05-08T20:55:04.091308+0000","last_fullsized":"2024-05-08T20:55:04.091308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097710+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T20:55:04.097710+0000","last_peered":"2024-05-08T20:55:04.097710+0000","last_clean":"2024-05-08T20:55:04.097710+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T20:55:04.097710+0000","last_undegraded":"2024-05-08T20:55:04.097710+0000","last_fullsized":"2024-05-08T20:55:04.097710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209633+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T20:55:04.209633+0000","last_peered":"2024-05-08T20:55:04.209633+0000","last_clean":"2024-05-08T20:55:04.209633+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T20:55:04.209633+0000","last_undegraded":"2024-05-08T20:55:04.209633+0000","last_fullsized":"2024-05-08T20:55:04.209633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518929+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T20:55:04.518929+0000","last_peered":"2024-05-08T20:55:04.518929+0000","last_clean":"2024-05-08T20:55:04.518929+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T20:55:04.518929+0000","last_undegraded":"2024-05-08T20:55:04.518929+0000","last_fullsized":"2024-05-08T20:55:04.518929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095787+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T20:55:04.095787+0000","last_peered":"2024-05-08T20:55:04.095787+0000","last_clean":"2024-05-08T20:55:04.095787+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T20:55:04.095787+0000","last_undegraded":"2024-05-08T20:55:04.095787+0000","last_fullsized":"2024-05-08T20:55:04.095787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:17.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210177+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T20:55:04.210177+0000","last_peered":"2024-05-08T20:55:04.210177+0000","last_clean":"2024-05-08T20:55:04.210177+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T20:55:04.210177+0000","last_undegraded":"2024-05-08T20:55:04.210177+0000","last_fullsized":"2024-05-08T20:55:04.210177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871830+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T20:55:04.871830+0000","last_peered":"2024-05-08T20:55:04.871830+0000","last_clean":"2024-05-08T20:55:04.871830+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T20:55:04.871830+0000","last_undegraded":"2024-05-08T20:55:04.871830+0000","last_fullsized":"2024-05-08T20:55:04.871830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106256+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T20:55:04.106256+0000","last_peered":"2024-05-08T20:55:04.106256+0000","last_clean":"2024-05-08T20:55:04.106256+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T20:55:04.106256+0000","last_undegraded":"2024-05-08T20:55:04.106256+0000","last_fullsized":"2024-05-08T20:55:04.106256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102154+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T20:55:04.102154+0000","last_peered":"2024-05-08T20:55:04.102154+0000","last_clean":"2024-05-08T20:55:04.102154+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T20:55:04.102154+0000","last_undegraded":"2024-05-08T20:55:04.102154+0000","last_fullsized":"2024-05-08T20:55:04.102154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871697+0000","last_change":"2024-05-08T20:55:04.117093+0000","last_active":"2024-05-08T20:55:04.871697+0000","last_peered":"2024-05-08T20:55:04.871697+0000","last_clean":"2024-05-08T20:55:04.871697+0000","last_became_active":"2024-05-08T20:55:04.115995+0000","last_became_peered":"2024-05-08T20:55:04.115995+0000","last_unstale":"2024-05-08T20:55:04.871697+0000","last_undegraded":"2024-05-08T20:55:04.871697+0000","last_fullsized":"2024-05-08T20:55:04.871697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101637+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T20:55:04.101637+0000","last_peered":"2024-05-08T20:55:04.101637+0000","last_clean":"2024-05-08T20:55:04.101637+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T20:55:04.101637+0000","last_undegraded":"2024-05-08T20:55:04.101637+0000","last_fullsized":"2024-05-08T20:55:04.101637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095588+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T20:55:04.095588+0000","last_peered":"2024-05-08T20:55:04.095588+0000","last_clean":"2024-05-08T20:55:04.095588+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T20:55:04.095588+0000","last_undegraded":"2024-05-08T20:55:04.095588+0000","last_fullsized":"2024-05-08T20:55:04.095588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:30.883278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872006+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T20:55:04.872006+0000","last_peered":"2024-05-08T20:55:04.872006+0000","last_clean":"2024-05-08T20:55:04.872006+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T20:55:04.872006+0000","last_undegraded":"2024-05-08T20:55:04.872006+0000","last_fullsized":"2024-05-08T20:55:04.872006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105577+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T20:55:04.105577+0000","last_peered":"2024-05-08T20:55:04.105577+0000","last_clean":"2024-05-08T20:55:04.105577+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T20:55:04.105577+0000","last_undegraded":"2024-05-08T20:55:04.105577+0000","last_fullsized":"2024-05-08T20:55:04.105577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097867+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T20:55:04.097867+0000","last_peered":"2024-05-08T20:55:04.097867+0000","last_clean":"2024-05-08T20:55:04.097867+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T20:55:04.097867+0000","last_undegraded":"2024-05-08T20:55:04.097867+0000","last_fullsized":"2024-05-08T20:55:04.097867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655085+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T20:55:04.655085+0000","last_peered":"2024-05-08T20:55:04.655085+0000","last_clean":"2024-05-08T20:55:04.655085+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T20:55:04.655085+0000","last_undegraded":"2024-05-08T20:55:04.655085+0000","last_fullsized":"2024-05-08T20:55:04.655085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090921+0000","last_change":"2024-05-08T20:55:00.091803+0000","last_active":"2024-05-08T20:55:04.090921+0000","last_peered":"2024-05-08T20:55:04.090921+0000","last_clean":"2024-05-08T20:55:04.090921+0000","last_became_active":"2024-05-08T20:55:00.091556+0000","last_became_peered":"2024-05-08T20:55:00.091556+0000","last_unstale":"2024-05-08T20:55:04.090921+0000","last_undegraded":"2024-05-08T20:55:04.090921+0000","last_fullsized":"2024-05-08T20:55:04.090921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101787+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T20:55:04.101787+0000","last_peered":"2024-05-08T20:55:04.101787+0000","last_clean":"2024-05-08T20:55:04.101787+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T20:55:04.101787+0000","last_undegraded":"2024-05-08T20:55:04.101787+0000","last_fullsized":"2024-05-08T20:55:04.101787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209118+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T20:55:04.209118+0000","last_peered":"2024-05-08T20:55:04.209118+0000","last_clean":"2024-05-08T20:55:04.209118+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T20:55:04.209118+0000","last_undegraded":"2024-05-08T20:55:04.209118+0000","last_fullsized":"2024-05-08T20:55:04.209118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101104+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T20:55:04.101104+0000","last_peered":"2024-05-08T20:55:04.101104+0000","last_clean":"2024-05-08T20:55:04.101104+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T20:55:04.101104+0000","last_undegraded":"2024-05-08T20:55:04.101104+0000","last_fullsized":"2024-05-08T20:55:04.101104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:16.831824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209208+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T20:55:04.209208+0000","last_peered":"2024-05-08T20:55:04.209208+0000","last_clean":"2024-05-08T20:55:04.209208+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T20:55:04.209208+0000","last_undegraded":"2024-05-08T20:55:04.209208+0000","last_fullsized":"2024-05-08T20:55:04.209208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873248+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T20:55:04.873248+0000","last_peered":"2024-05-08T20:55:04.873248+0000","last_clean":"2024-05-08T20:55:04.873248+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T20:55:04.873248+0000","last_undegraded":"2024-05-08T20:55:04.873248+0000","last_fullsized":"2024-05-08T20:55:04.873248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209773+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T20:55:04.209773+0000","last_peered":"2024-05-08T20:55:04.209773+0000","last_clean":"2024-05-08T20:55:04.209773+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T20:55:04.209773+0000","last_undegraded":"2024-05-08T20:55:04.209773+0000","last_fullsized":"2024-05-08T20:55:04.209773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106292+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T20:55:04.106292+0000","last_peered":"2024-05-08T20:55:04.106292+0000","last_clean":"2024-05-08T20:55:04.106292+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T20:55:04.106292+0000","last_undegraded":"2024-05-08T20:55:04.106292+0000","last_fullsized":"2024-05-08T20:55:04.106292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512323+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T20:55:04.512323+0000","last_peered":"2024-05-08T20:55:04.512323+0000","last_clean":"2024-05-08T20:55:04.512323+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T20:55:04.512323+0000","last_undegraded":"2024-05-08T20:55:04.512323+0000","last_fullsized":"2024-05-08T20:55:04.512323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:18.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106745+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T20:55:04.106745+0000","last_peered":"2024-05-08T20:55:04.106745+0000","last_clean":"2024-05-08T20:55:04.106745+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T20:55:04.106745+0000","last_undegraded":"2024-05-08T20:55:04.106745+0000","last_fullsized":"2024-05-08T20:55:04.106745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091711+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T20:55:04.091711+0000","last_peered":"2024-05-08T20:55:04.091711+0000","last_clean":"2024-05-08T20:55:04.091711+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T20:55:04.091711+0000","last_undegraded":"2024-05-08T20:55:04.091711+0000","last_fullsized":"2024-05-08T20:55:04.091711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518932+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T20:55:04.518932+0000","last_peered":"2024-05-08T20:55:04.518932+0000","last_clean":"2024-05-08T20:55:04.518932+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T20:55:04.518932+0000","last_undegraded":"2024-05-08T20:55:04.518932+0000","last_fullsized":"2024-05-08T20:55:04.518932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:59.610624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093217+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T20:55:04.093217+0000","last_peered":"2024-05-08T20:55:04.093217+0000","last_clean":"2024-05-08T20:55:04.093217+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T20:55:04.093217+0000","last_undegraded":"2024-05-08T20:55:04.093217+0000","last_fullsized":"2024-05-08T20:55:04.093217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101416+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T20:55:04.101416+0000","last_peered":"2024-05-08T20:55:04.101416+0000","last_clean":"2024-05-08T20:55:04.101416+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T20:55:04.101416+0000","last_undegraded":"2024-05-08T20:55:04.101416+0000","last_fullsized":"2024-05-08T20:55:04.101416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519324+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T20:55:04.519324+0000","last_peered":"2024-05-08T20:55:04.519324+0000","last_clean":"2024-05-08T20:55:04.519324+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T20:55:04.519324+0000","last_undegraded":"2024-05-08T20:55:04.519324+0000","last_fullsized":"2024-05-08T20:55:04.519324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209104+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T20:55:04.209104+0000","last_peered":"2024-05-08T20:55:04.209104+0000","last_clean":"2024-05-08T20:55:04.209104+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T20:55:04.209104+0000","last_undegraded":"2024-05-08T20:55:04.209104+0000","last_fullsized":"2024-05-08T20:55:04.209104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095004+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T20:55:04.095004+0000","last_peered":"2024-05-08T20:55:04.095004+0000","last_clean":"2024-05-08T20:55:04.095004+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T20:55:04.095004+0000","last_undegraded":"2024-05-08T20:55:04.095004+0000","last_fullsized":"2024-05-08T20:55:04.095004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.899173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872102+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T20:55:04.872102+0000","last_peered":"2024-05-08T20:55:04.872102+0000","last_clean":"2024-05-08T20:55:04.872102+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T20:55:04.872102+0000","last_undegraded":"2024-05-08T20:55:04.872102+0000","last_fullsized":"2024-05-08T20:55:04.872102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105823+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T20:55:04.105823+0000","last_peered":"2024-05-08T20:55:04.105823+0000","last_clean":"2024-05-08T20:55:04.105823+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T20:55:04.105823+0000","last_undegraded":"2024-05-08T20:55:04.105823+0000","last_fullsized":"2024-05-08T20:55:04.105823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090691+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T20:55:04.090691+0000","last_peered":"2024-05-08T20:55:04.090691+0000","last_clean":"2024-05-08T20:55:04.090691+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T20:55:04.090691+0000","last_undegraded":"2024-05-08T20:55:04.090691+0000","last_fullsized":"2024-05-08T20:55:04.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519380+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T20:55:04.519380+0000","last_peered":"2024-05-08T20:55:04.519380+0000","last_clean":"2024-05-08T20:55:04.519380+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T20:55:04.519380+0000","last_undegraded":"2024-05-08T20:55:04.519380+0000","last_fullsized":"2024-05-08T20:55:04.519380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:27.059976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106930+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T20:55:04.106930+0000","last_peered":"2024-05-08T20:55:04.106930+0000","last_clean":"2024-05-08T20:55:04.106930+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T20:55:04.106930+0000","last_undegraded":"2024-05-08T20:55:04.106930+0000","last_fullsized":"2024-05-08T20:55:04.106930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091617+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T20:55:04.091617+0000","last_peered":"2024-05-08T20:55:04.091617+0000","last_clean":"2024-05-08T20:55:04.091617+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T20:55:04.091617+0000","last_undegraded":"2024-05-08T20:55:04.091617+0000","last_fullsized":"2024-05-08T20:55:04.091617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519561+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T20:55:04.519561+0000","last_peered":"2024-05-08T20:55:04.519561+0000","last_clean":"2024-05-08T20:55:04.519561+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T20:55:04.519561+0000","last_undegraded":"2024-05-08T20:55:04.519561+0000","last_fullsized":"2024-05-08T20:55:04.519561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209808+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T20:55:04.209808+0000","last_peered":"2024-05-08T20:55:04.209808+0000","last_clean":"2024-05-08T20:55:04.209808+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T20:55:04.209808+0000","last_undegraded":"2024-05-08T20:55:04.209808+0000","last_fullsized":"2024-05-08T20:55:04.209808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092750+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T20:55:04.092750+0000","last_peered":"2024-05-08T20:55:04.092750+0000","last_clean":"2024-05-08T20:55:04.092750+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T20:55:04.092750+0000","last_undegraded":"2024-05-08T20:55:04.092750+0000","last_fullsized":"2024-05-08T20:55:04.092750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.654813+0000","last_change":"2024-05-08T20:55:04.211367+0000","last_active":"2024-05-08T20:55:04.654813+0000","last_peered":"2024-05-08T20:55:04.654813+0000","last_clean":"2024-05-08T20:55:04.654813+0000","last_became_active":"2024-05-08T20:55:04.210862+0000","last_became_peered":"2024-05-08T20:55:04.210862+0000","last_unstale":"2024-05-08T20:55:04.654813+0000","last_undegraded":"2024-05-08T20:55:04.654813+0000","last_fullsized":"2024-05-08T20:55:04.654813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097858+0000","last_change":"2024-05-08T20:54:59.625358+0000","last_active":"2024-05-08T20:55:04.097858+0000","last_peered":"2024-05-08T20:55:04.097858+0000","last_clean":"2024-05-08T20:55:04.097858+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T20:55:04.097858+0000","last_undegraded":"2024-05-08T20:55:04.097858+0000","last_fullsized":"2024-05-08T20:55:04.097858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210050+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T20:55:04.210050+0000","last_peered":"2024-05-08T20:55:04.210050+0000","last_clean":"2024-05-08T20:55:04.210050+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T20:55:04.210050+0000","last_undegraded":"2024-05-08T20:55:04.210050+0000","last_fullsized":"2024-05-08T20:55:04.210050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873140+0000","last_change":"2024-05-08T20:55:04.116701+0000","last_active":"2024-05-08T20:55:04.873140+0000","last_peered":"2024-05-08T20:55:04.873140+0000","last_clean":"2024-05-08T20:55:04.873140+0000","last_became_active":"2024-05-08T20:55:04.116308+0000","last_became_peered":"2024-05-08T20:55:04.116308+0000","last_unstale":"2024-05-08T20:55:04.873140+0000","last_undegraded":"2024-05-08T20:55:04.873140+0000","last_fullsized":"2024-05-08T20:55:04.873140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106286+0000","last_change":"2024-05-08T20:54:59.618192+0000","last_active":"2024-05-08T20:55:04.106286+0000","last_peered":"2024-05-08T20:55:04.106286+0000","last_clean":"2024-05-08T20:55:04.106286+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T20:55:04.106286+0000","last_undegraded":"2024-05-08T20:55:04.106286+0000","last_fullsized":"2024-05-08T20:55:04.106286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101864+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T20:55:04.101864+0000","last_peered":"2024-05-08T20:55:04.101864+0000","last_clean":"2024-05-08T20:55:04.101864+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T20:55:04.101864+0000","last_undegraded":"2024-05-08T20:55:04.101864+0000","last_fullsized":"2024-05-08T20:55:04.101864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.516609+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T20:55:04.516609+0000","last_peered":"2024-05-08T20:55:04.516609+0000","last_clean":"2024-05-08T20:55:04.516609+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T20:55:04.516609+0000","last_undegraded":"2024-05-08T20:55:04.516609+0000","last_fullsized":"2024-05-08T20:55:04.516609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097649+0000","last_change":"2024-05-08T20:54:59.623921+0000","last_active":"2024-05-08T20:55:04.097649+0000","last_peered":"2024-05-08T20:55:04.097649+0000","last_clean":"2024-05-08T20:55:04.097649+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T20:55:04.097649+0000","last_undegraded":"2024-05-08T20:55:04.097649+0000","last_fullsized":"2024-05-08T20:55:04.097649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210761+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T20:55:04.210761+0000","last_peered":"2024-05-08T20:55:04.210761+0000","last_clean":"2024-05-08T20:55:04.210761+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T20:55:04.210761+0000","last_undegraded":"2024-05-08T20:55:04.210761+0000","last_fullsized":"2024-05-08T20:55:04.210761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092114+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T20:55:04.092114+0000","last_peered":"2024-05-08T20:55:04.092114+0000","last_clean":"2024-05-08T20:55:04.092114+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T20:55:04.092114+0000","last_undegraded":"2024-05-08T20:55:04.092114+0000","last_fullsized":"2024-05-08T20:55:04.092114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097934+0000","last_change":"2024-05-08T20:55:00.088933+0000","last_active":"2024-05-08T20:55:04.097934+0000","last_peered":"2024-05-08T20:55:04.097934+0000","last_clean":"2024-05-08T20:55:04.097934+0000","last_became_active":"2024-05-08T20:55:00.088651+0000","last_became_peered":"2024-05-08T20:55:00.088651+0000","last_unstale":"2024-05-08T20:55:04.097934+0000","last_undegraded":"2024-05-08T20:55:04.097934+0000","last_fullsized":"2024-05-08T20:55:04.097934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102032+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T20:55:04.102032+0000","last_peered":"2024-05-08T20:55:04.102032+0000","last_clean":"2024-05-08T20:55:04.102032+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T20:55:04.102032+0000","last_undegraded":"2024-05-08T20:55:04.102032+0000","last_fullsized":"2024-05-08T20:55:04.102032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100404+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T20:55:04.100404+0000","last_peered":"2024-05-08T20:55:04.100404+0000","last_clean":"2024-05-08T20:55:04.100404+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T20:55:04.100404+0000","last_undegraded":"2024-05-08T20:55:04.100404+0000","last_fullsized":"2024-05-08T20:55:04.100404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091752+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T20:55:04.091752+0000","last_peered":"2024-05-08T20:55:04.091752+0000","last_clean":"2024-05-08T20:55:04.091752+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T20:55:04.091752+0000","last_undegraded":"2024-05-08T20:55:04.091752+0000","last_fullsized":"2024-05-08T20:55:04.091752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106193+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T20:55:04.106193+0000","last_peered":"2024-05-08T20:55:04.106193+0000","last_clean":"2024-05-08T20:55:04.106193+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T20:55:04.106193+0000","last_undegraded":"2024-05-08T20:55:04.106193+0000","last_fullsized":"2024-05-08T20:55:04.106193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091956+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T20:55:04.091956+0000","last_peered":"2024-05-08T20:55:04.091956+0000","last_clean":"2024-05-08T20:55:04.091956+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T20:55:04.091956+0000","last_undegraded":"2024-05-08T20:55:04.091956+0000","last_fullsized":"2024-05-08T20:55:04.091956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091800+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T20:55:04.091800+0000","last_peered":"2024-05-08T20:55:04.091800+0000","last_clean":"2024-05-08T20:55:04.091800+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T20:55:04.091800+0000","last_undegraded":"2024-05-08T20:55:04.091800+0000","last_fullsized":"2024-05-08T20:55:04.091800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101516+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T20:55:04.101516+0000","last_peered":"2024-05-08T20:55:04.101516+0000","last_clean":"2024-05-08T20:55:04.101516+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T20:55:04.101516+0000","last_undegraded":"2024-05-08T20:55:04.101516+0000","last_fullsized":"2024-05-08T20:55:04.101516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090738+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T20:55:04.090738+0000","last_peered":"2024-05-08T20:55:04.090738+0000","last_clean":"2024-05-08T20:55:04.090738+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T20:55:04.090738+0000","last_undegraded":"2024-05-08T20:55:04.090738+0000","last_fullsized":"2024-05-08T20:55:04.090738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102133+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T20:55:04.102133+0000","last_peered":"2024-05-08T20:55:04.102133+0000","last_clean":"2024-05-08T20:55:04.102133+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T20:55:04.102133+0000","last_undegraded":"2024-05-08T20:55:04.102133+0000","last_fullsized":"2024-05-08T20:55:04.102133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100484+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T20:55:04.100484+0000","last_peered":"2024-05-08T20:55:04.100484+0000","last_clean":"2024-05-08T20:55:04.100484+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T20:55:04.100484+0000","last_undegraded":"2024-05-08T20:55:04.100484+0000","last_fullsized":"2024-05-08T20:55:04.100484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091573+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T20:55:04.091573+0000","last_peered":"2024-05-08T20:55:04.091573+0000","last_clean":"2024-05-08T20:55:04.091573+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T20:55:04.091573+0000","last_undegraded":"2024-05-08T20:55:04.091573+0000","last_fullsized":"2024-05-08T20:55:04.091573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:55:24.663 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:55:24.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.816+0000 7f74841a9700 1 Processor -- start 2024-05-08T20:55:24.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f74841a9700 1 -- start start 2024-05-08T20:55:24.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f74841a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c0c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f74841a9700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f747c0c6590 0x7f747c0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f74841a9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0c34d0 con 0x7f747c0c3960 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f74841a9700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c0c5800 con 0x7f747c0c6590 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f74841a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c5da0 con 0x7f747c1500a0 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f7482746700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f747c0c6590 0x7f747c0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f7482746700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f747c0c6590 0x7f747c0c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32982/0 (socket says 172.21.15.135:32982) 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.817+0000 7f7482746700 1 -- 172.21.15.135:0/1089867106 learned_addr learned my addr 172.21.15.135:0/1089867106 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7481f45700 1 --2- 172.21.15.135:0/1089867106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c0c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7482746700 1 -- 172.21.15.135:0/1089867106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 msgr2=0x7f747c0c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7482746700 1 --2- 172.21.15.135:0/1089867106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c0c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7482746700 1 -- 172.21.15.135:0/1089867106 >> v1:172.21.15.183:6789/0 conn(0x7f747c0c3960 legacy=0x7f747c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7482746700 1 -- 172.21.15.135:0/1089867106 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0c5ac0 con 0x7f747c0c6590 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7482746700 1 --2- 172.21.15.135:0/1089867106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c6590 0x7f747c0c6a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7474009e50 tx=0x7f747400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25d2c349c9016d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7480f43700 1 -- 172.21.15.135:0/1089867106 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400e070 con 0x7f747c0c6590 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7480f43700 1 -- 172.21.15.135:0/1089867106 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400b9c0 con 0x7f747c0c6590 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.818+0000 7f7480f43700 1 -- 172.21.15.135:0/1089867106 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400bd70 con 0x7f747c0c6590 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 -- 172.21.15.135:0/1089867106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c6590 msgr2=0x7f747c0c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 --2- 172.21.15.135:0/1089867106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c6590 0x7f747c0c6a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7474009e50 tx=0x7f747400b330 comp rx=0 tx=0).stop 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 -- 172.21.15.135:0/1089867106 shutdown_connections 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 --2- 172.21.15.135:0/1089867106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c6590 0x7f747c0c6a20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 --2- 172.21.15.135:0/1089867106 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c0c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 -- 172.21.15.135:0/1089867106 >> 172.21.15.135:0/1089867106 conn(0x7f747c06daf0 msgr2=0x7f747c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 -- 172.21.15.135:0/1089867106 shutdown_connections 2024-05-08T20:55:24.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.819+0000 7f74841a9700 1 -- 172.21.15.135:0/1089867106 wait complete. 2024-05-08T20:55:24.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.820+0000 7f74841a9700 1 Processor -- start 2024-05-08T20:55:24.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.820+0000 7f74841a9700 1 -- start start 2024-05-08T20:55:24.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.820+0000 7f74841a9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c3960 0x7f747c1f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.820+0000 7f74841a9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f747c0c6590 0x7f747c1ef670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.820+0000 7f74841a9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74841a9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c152850 con 0x7f747c0c3960 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74841a9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1edb30 con 0x7f747c0c6590 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74841a9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1ecfd0 con 0x7f747c1500a0 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c3960 0x7f747c1f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c3960 0x7f747c1f0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:32988/0 (socket says 172.21.15.135:32988) 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 -- 172.21.15.135:0/478556443 learned_addr learned my addr 172.21.15.135:0/478556443 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 -- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 msgr2=0x7f747c143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481744700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f747c0c6590 0x7f747c1ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7482746700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 -- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f747c0c6590 msgr2=0x7f747c1ef670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:24.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f747c0c6590 0x7f747c1ef670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 -- 172.21.15.135:0/478556443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009b30 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481744700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f747c0c6590 0x7f747c1ef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f7481f45700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c3960 0x7f747c1f0a80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f746c00d830 tx=0x7f746c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74727fc700 1 -- 172.21.15.135:0/478556443 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0125f0 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74727fc700 1 -- 172.21.15.135:0/478556443 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c012750 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c1ed290 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74727fc700 1 -- 172.21.15.135:0/478556443 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c012b00 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.821+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c1ed850 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.822+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0c4450 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.823+0000 7f74727fc700 1 -- 172.21.15.135:0/478556443 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f746c012c60 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.823+0000 7f74727fc700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f746006ac90 0x7f746006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.823+0000 7f7481744700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f746006ac90 0x7f746006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.823+0000 7f74727fc700 1 -- 172.21.15.135:0/478556443 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f746c0899d0 con 0x7f747c0c3960 2024-05-08T20:55:24.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.824+0000 7f7481744700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f746006ac90 0x7f746006d150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f747c149b70 tx=0x7f7478009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:24.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:24.828+0000 7f74727fc700 1 -- 172.21.15.135:0/478556443 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f746c054830 con 0x7f747c0c3960 2024-05-08T20:55:25.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.018+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f747c0c3160 con 0x7f746006ac90 2024-05-08T20:55:25.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.027+0000 7f74727fc700 1 -- 172.21.15.135:0/478556443 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345233 (secure 0 0 0) 0x7f7478014420 con 0x7f746006ac90 2024-05-08T20:55:25.033 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:25.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.030+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f746006ac90 msgr2=0x7f746006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.030+0000 7f74841a9700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f746006ac90 0x7f746006d150 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f747c149b70 tx=0x7f7478009040 comp rx=0 tx=0).stop 2024-05-08T20:55:25.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c3960 msgr2=0x7f747c1f0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c3960 0x7f747c1f0a80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f746c00d830 tx=0x7f746c00dbf0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 shutdown_connections 2024-05-08T20:55:25.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f746006ac90 0x7f746006d150 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f747c1500a0 0x7f747c143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f747c0c3960 0x7f747c1f0a80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 --2- 172.21.15.135:0/478556443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f747c0c6590 0x7f747c1ef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 >> 172.21.15.135:0/478556443 conn(0x7f747c06daf0 msgr2=0x7f747c0c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:25.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 shutdown_connections 2024-05-08T20:55:25.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.031+0000 7f74841a9700 1 -- 172.21.15.135:0/478556443 wait complete. 2024-05-08T20:55:25.037 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T20:55:25.044 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-05-08T20:55:24.460897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2025532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002977"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210658+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T20:55:04.210658+0000","last_peered":"2024-05-08T20:55:04.210658+0000","last_clean":"2024-05-08T20:55:04.210658+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T20:55:04.210658+0000","last_undegraded":"2024-05-08T20:55:04.210658+0000","last_fullsized":"2024-05-08T20:55:04.210658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106818+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T20:55:04.106818+0000","last_peered":"2024-05-08T20:55:04.106818+0000","last_clean":"2024-05-08T20:55:04.106818+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T20:55:04.106818+0000","last_undegraded":"2024-05-08T20:55:04.106818+0000","last_fullsized":"2024-05-08T20:55:04.106818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100019+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T20:55:04.100019+0000","last_peered":"2024-05-08T20:55:04.100019+0000","last_clean":"2024-05-08T20:55:04.100019+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T20:55:04.100019+0000","last_undegraded":"2024-05-08T20:55:04.100019+0000","last_fullsized":"2024-05-08T20:55:04.100019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101967+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T20:55:04.101967+0000","last_peered":"2024-05-08T20:55:04.101967+0000","last_clean":"2024-05-08T20:55:04.101967+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T20:55:04.101967+0000","last_undegraded":"2024-05-08T20:55:04.101967+0000","last_fullsized":"2024-05-08T20:55:04.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209670+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T20:55:04.209670+0000","last_peered":"2024-05-08T20:55:04.209670+0000","last_clean":"2024-05-08T20:55:04.209670+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T20:55:04.209670+0000","last_undegraded":"2024-05-08T20:55:04.209670+0000","last_fullsized":"2024-05-08T20:55:04.209670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102240+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T20:55:04.102240+0000","last_peered":"2024-05-08T20:55:04.102240+0000","last_clean":"2024-05-08T20:55:04.102240+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T20:55:04.102240+0000","last_undegraded":"2024-05-08T20:55:04.102240+0000","last_fullsized":"2024-05-08T20:55:04.102240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209219+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T20:55:04.209219+0000","last_peered":"2024-05-08T20:55:04.209219+0000","last_clean":"2024-05-08T20:55:04.209219+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T20:55:04.209219+0000","last_undegraded":"2024-05-08T20:55:04.209219+0000","last_fullsized":"2024-05-08T20:55:04.209219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091254+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T20:55:04.091254+0000","last_peered":"2024-05-08T20:55:04.091254+0000","last_clean":"2024-05-08T20:55:04.091254+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T20:55:04.091254+0000","last_undegraded":"2024-05-08T20:55:04.091254+0000","last_fullsized":"2024-05-08T20:55:04.091254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210538+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T20:55:04.210538+0000","last_peered":"2024-05-08T20:55:04.210538+0000","last_clean":"2024-05-08T20:55:04.210538+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T20:55:04.210538+0000","last_undegraded":"2024-05-08T20:55:04.210538+0000","last_fullsized":"2024-05-08T20:55:04.210538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091771+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T20:55:04.091771+0000","last_peered":"2024-05-08T20:55:04.091771+0000","last_clean":"2024-05-08T20:55:04.091771+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T20:55:04.091771+0000","last_undegraded":"2024-05-08T20:55:04.091771+0000","last_fullsized":"2024-05-08T20:55:04.091771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095917+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T20:55:04.095917+0000","last_peered":"2024-05-08T20:55:04.095917+0000","last_clean":"2024-05-08T20:55:04.095917+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T20:55:04.095917+0000","last_undegraded":"2024-05-08T20:55:04.095917+0000","last_fullsized":"2024-05-08T20:55:04.095917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090851+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T20:55:04.090851+0000","last_peered":"2024-05-08T20:55:04.090851+0000","last_clean":"2024-05-08T20:55:04.090851+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T20:55:04.090851+0000","last_undegraded":"2024-05-08T20:55:04.090851+0000","last_fullsized":"2024-05-08T20:55:04.090851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100626+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T20:55:04.100626+0000","last_peered":"2024-05-08T20:55:04.100626+0000","last_clean":"2024-05-08T20:55:04.100626+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T20:55:04.100626+0000","last_undegraded":"2024-05-08T20:55:04.100626+0000","last_fullsized":"2024-05-08T20:55:04.100626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105894+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T20:55:04.105894+0000","last_peered":"2024-05-08T20:55:04.105894+0000","last_clean":"2024-05-08T20:55:04.105894+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T20:55:04.105894+0000","last_undegraded":"2024-05-08T20:55:04.105894+0000","last_fullsized":"2024-05-08T20:55:04.105894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101412+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T20:55:04.101412+0000","last_peered":"2024-05-08T20:55:04.101412+0000","last_clean":"2024-05-08T20:55:04.101412+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T20:55:04.101412+0000","last_undegraded":"2024-05-08T20:55:04.101412+0000","last_fullsized":"2024-05-08T20:55:04.101412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102105+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T20:55:04.102105+0000","last_peered":"2024-05-08T20:55:04.102105+0000","last_clean":"2024-05-08T20:55:04.102105+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T20:55:04.102105+0000","last_undegraded":"2024-05-08T20:55:04.102105+0000","last_fullsized":"2024-05-08T20:55:04.102105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097726+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T20:55:04.097726+0000","last_peered":"2024-05-08T20:55:04.097726+0000","last_clean":"2024-05-08T20:55:04.097726+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T20:55:04.097726+0000","last_undegraded":"2024-05-08T20:55:04.097726+0000","last_fullsized":"2024-05-08T20:55:04.097726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210168+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T20:55:04.210168+0000","last_peered":"2024-05-08T20:55:04.210168+0000","last_clean":"2024-05-08T20:55:04.210168+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T20:55:04.210168+0000","last_undegraded":"2024-05-08T20:55:04.210168+0000","last_fullsized":"2024-05-08T20:55:04.210168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512517+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T20:55:04.512517+0000","last_peered":"2024-05-08T20:55:04.512517+0000","last_clean":"2024-05-08T20:55:04.512517+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T20:55:04.512517+0000","last_undegraded":"2024-05-08T20:55:04.512517+0000","last_fullsized":"2024-05-08T20:55:04.512517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:53.835534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100281+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T20:55:04.100281+0000","last_peered":"2024-05-08T20:55:04.100281+0000","last_clean":"2024-05-08T20:55:04.100281+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T20:55:04.100281+0000","last_undegraded":"2024-05-08T20:55:04.100281+0000","last_fullsized":"2024-05-08T20:55:04.100281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091690+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T20:55:04.091690+0000","last_peered":"2024-05-08T20:55:04.091690+0000","last_clean":"2024-05-08T20:55:04.091690+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T20:55:04.091690+0000","last_undegraded":"2024-05-08T20:55:04.091690+0000","last_fullsized":"2024-05-08T20:55:04.091690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519037+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T20:55:04.519037+0000","last_peered":"2024-05-08T20:55:04.519037+0000","last_clean":"2024-05-08T20:55:04.519037+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T20:55:04.519037+0000","last_undegraded":"2024-05-08T20:55:04.519037+0000","last_fullsized":"2024-05-08T20:55:04.519037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091796+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T20:55:04.091796+0000","last_peered":"2024-05-08T20:55:04.091796+0000","last_clean":"2024-05-08T20:55:04.091796+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T20:55:04.091796+0000","last_undegraded":"2024-05-08T20:55:04.091796+0000","last_fullsized":"2024-05-08T20:55:04.091796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100188+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T20:55:04.100188+0000","last_peered":"2024-05-08T20:55:04.100188+0000","last_clean":"2024-05-08T20:55:04.100188+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T20:55:04.100188+0000","last_undegraded":"2024-05-08T20:55:04.100188+0000","last_fullsized":"2024-05-08T20:55:04.100188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519193+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T20:55:04.519193+0000","last_peered":"2024-05-08T20:55:04.519193+0000","last_clean":"2024-05-08T20:55:04.519193+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T20:55:04.519193+0000","last_undegraded":"2024-05-08T20:55:04.519193+0000","last_fullsized":"2024-05-08T20:55:04.519193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:49.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209957+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T20:55:04.209957+0000","last_peered":"2024-05-08T20:55:04.209957+0000","last_clean":"2024-05-08T20:55:04.209957+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T20:55:04.209957+0000","last_undegraded":"2024-05-08T20:55:04.209957+0000","last_fullsized":"2024-05-08T20:55:04.209957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101756+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T20:55:04.101756+0000","last_peered":"2024-05-08T20:55:04.101756+0000","last_clean":"2024-05-08T20:55:04.101756+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T20:55:04.101756+0000","last_undegraded":"2024-05-08T20:55:04.101756+0000","last_fullsized":"2024-05-08T20:55:04.101756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519088+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T20:55:04.519088+0000","last_peered":"2024-05-08T20:55:04.519088+0000","last_clean":"2024-05-08T20:55:04.519088+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T20:55:04.519088+0000","last_undegraded":"2024-05-08T20:55:04.519088+0000","last_fullsized":"2024-05-08T20:55:04.519088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209700+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T20:55:04.209700+0000","last_peered":"2024-05-08T20:55:04.209700+0000","last_clean":"2024-05-08T20:55:04.209700+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T20:55:04.209700+0000","last_undegraded":"2024-05-08T20:55:04.209700+0000","last_fullsized":"2024-05-08T20:55:04.209700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102182+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T20:55:04.102182+0000","last_peered":"2024-05-08T20:55:04.102182+0000","last_clean":"2024-05-08T20:55:04.102182+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T20:55:04.102182+0000","last_undegraded":"2024-05-08T20:55:04.102182+0000","last_fullsized":"2024-05-08T20:55:04.102182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512895+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T20:55:04.512895+0000","last_peered":"2024-05-08T20:55:04.512895+0000","last_clean":"2024-05-08T20:55:04.512895+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T20:55:04.512895+0000","last_undegraded":"2024-05-08T20:55:04.512895+0000","last_fullsized":"2024-05-08T20:55:04.512895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:15.767597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091524+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T20:55:04.091524+0000","last_peered":"2024-05-08T20:55:04.091524+0000","last_clean":"2024-05-08T20:55:04.091524+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T20:55:04.091524+0000","last_undegraded":"2024-05-08T20:55:04.091524+0000","last_fullsized":"2024-05-08T20:55:04.091524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.094714+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T20:55:04.094714+0000","last_peered":"2024-05-08T20:55:04.094714+0000","last_clean":"2024-05-08T20:55:04.094714+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T20:55:04.094714+0000","last_undegraded":"2024-05-08T20:55:04.094714+0000","last_fullsized":"2024-05-08T20:55:04.094714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:00.135628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872171+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T20:55:04.872171+0000","last_peered":"2024-05-08T20:55:04.872171+0000","last_clean":"2024-05-08T20:55:04.872171+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T20:55:04.872171+0000","last_undegraded":"2024-05-08T20:55:04.872171+0000","last_fullsized":"2024-05-08T20:55:04.872171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:52.925278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092648+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T20:55:04.092648+0000","last_peered":"2024-05-08T20:55:04.092648+0000","last_clean":"2024-05-08T20:55:04.092648+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T20:55:04.092648+0000","last_undegraded":"2024-05-08T20:55:04.092648+0000","last_fullsized":"2024-05-08T20:55:04.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100316+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T20:55:04.100316+0000","last_peered":"2024-05-08T20:55:04.100316+0000","last_clean":"2024-05-08T20:55:04.100316+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T20:55:04.100316+0000","last_undegraded":"2024-05-08T20:55:04.100316+0000","last_fullsized":"2024-05-08T20:55:04.100316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655299+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T20:55:04.655299+0000","last_peered":"2024-05-08T20:55:04.655299+0000","last_clean":"2024-05-08T20:55:04.655299+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T20:55:04.655299+0000","last_undegraded":"2024-05-08T20:55:04.655299+0000","last_fullsized":"2024-05-08T20:55:04.655299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090657+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T20:55:04.090657+0000","last_peered":"2024-05-08T20:55:04.090657+0000","last_clean":"2024-05-08T20:55:04.090657+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T20:55:04.090657+0000","last_undegraded":"2024-05-08T20:55:04.090657+0000","last_fullsized":"2024-05-08T20:55:04.090657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090599+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T20:55:04.090599+0000","last_peered":"2024-05-08T20:55:04.090599+0000","last_clean":"2024-05-08T20:55:04.090599+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T20:55:04.090599+0000","last_undegraded":"2024-05-08T20:55:04.090599+0000","last_fullsized":"2024-05-08T20:55:04.090599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.874020+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T20:55:04.874020+0000","last_peered":"2024-05-08T20:55:04.874020+0000","last_clean":"2024-05-08T20:55:04.874020+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T20:55:04.874020+0000","last_undegraded":"2024-05-08T20:55:04.874020+0000","last_fullsized":"2024-05-08T20:55:04.874020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101470+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T20:55:04.101470+0000","last_peered":"2024-05-08T20:55:04.101470+0000","last_clean":"2024-05-08T20:55:04.101470+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T20:55:04.101470+0000","last_undegraded":"2024-05-08T20:55:04.101470+0000","last_fullsized":"2024-05-08T20:55:04.101470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105915+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T20:55:04.105915+0000","last_peered":"2024-05-08T20:55:04.105915+0000","last_clean":"2024-05-08T20:55:04.105915+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T20:55:04.105915+0000","last_undegraded":"2024-05-08T20:55:04.105915+0000","last_fullsized":"2024-05-08T20:55:04.105915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512493+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T20:55:04.512493+0000","last_peered":"2024-05-08T20:55:04.512493+0000","last_clean":"2024-05-08T20:55:04.512493+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T20:55:04.512493+0000","last_undegraded":"2024-05-08T20:55:04.512493+0000","last_fullsized":"2024-05-08T20:55:04.512493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:25.005036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093315+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T20:55:04.093315+0000","last_peered":"2024-05-08T20:55:04.093315+0000","last_clean":"2024-05-08T20:55:04.093315+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T20:55:04.093315+0000","last_undegraded":"2024-05-08T20:55:04.093315+0000","last_fullsized":"2024-05-08T20:55:04.093315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101936+0000","last_change":"2024-05-08T20:55:00.101507+0000","last_active":"2024-05-08T20:55:04.101936+0000","last_peered":"2024-05-08T20:55:04.101936+0000","last_clean":"2024-05-08T20:55:04.101936+0000","last_became_active":"2024-05-08T20:55:00.101218+0000","last_became_peered":"2024-05-08T20:55:00.101218+0000","last_unstale":"2024-05-08T20:55:04.101936+0000","last_undegraded":"2024-05-08T20:55:04.101936+0000","last_fullsized":"2024-05-08T20:55:04.101936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512444+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T20:55:04.512444+0000","last_peered":"2024-05-08T20:55:04.512444+0000","last_clean":"2024-05-08T20:55:04.512444+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T20:55:04.512444+0000","last_undegraded":"2024-05-08T20:55:04.512444+0000","last_fullsized":"2024-05-08T20:55:04.512444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101935+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T20:55:04.101935+0000","last_peered":"2024-05-08T20:55:04.101935+0000","last_clean":"2024-05-08T20:55:04.101935+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T20:55:04.101935+0000","last_undegraded":"2024-05-08T20:55:04.101935+0000","last_fullsized":"2024-05-08T20:55:04.101935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100361+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T20:55:04.100361+0000","last_peered":"2024-05-08T20:55:04.100361+0000","last_clean":"2024-05-08T20:55:04.100361+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T20:55:04.100361+0000","last_undegraded":"2024-05-08T20:55:04.100361+0000","last_fullsized":"2024-05-08T20:55:04.100361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519609+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T20:55:04.519609+0000","last_peered":"2024-05-08T20:55:04.519609+0000","last_clean":"2024-05-08T20:55:04.519609+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T20:55:04.519609+0000","last_undegraded":"2024-05-08T20:55:04.519609+0000","last_fullsized":"2024-05-08T20:55:04.519609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106365+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T20:55:04.106365+0000","last_peered":"2024-05-08T20:55:04.106365+0000","last_clean":"2024-05-08T20:55:04.106365+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T20:55:04.106365+0000","last_undegraded":"2024-05-08T20:55:04.106365+0000","last_fullsized":"2024-05-08T20:55:04.106365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095830+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T20:55:04.095830+0000","last_peered":"2024-05-08T20:55:04.095830+0000","last_clean":"2024-05-08T20:55:04.095830+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T20:55:04.095830+0000","last_undegraded":"2024-05-08T20:55:04.095830+0000","last_fullsized":"2024-05-08T20:55:04.095830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872220+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T20:55:04.872220+0000","last_peered":"2024-05-08T20:55:04.872220+0000","last_clean":"2024-05-08T20:55:04.872220+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T20:55:04.872220+0000","last_undegraded":"2024-05-08T20:55:04.872220+0000","last_fullsized":"2024-05-08T20:55:04.872220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.651925+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T20:55:09.651925+0000","last_peered":"2024-05-08T20:55:09.651925+0000","last_clean":"2024-05-08T20:55:09.651925+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T20:55:09.651925+0000","last_undegraded":"2024-05-08T20:55:09.651925+0000","last_fullsized":"2024-05-08T20:55:09.651925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210218+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T20:55:04.210218+0000","last_peered":"2024-05-08T20:55:04.210218+0000","last_clean":"2024-05-08T20:55:04.210218+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T20:55:04.210218+0000","last_undegraded":"2024-05-08T20:55:04.210218+0000","last_fullsized":"2024-05-08T20:55:04.210218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.517096+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T20:55:04.517096+0000","last_peered":"2024-05-08T20:55:04.517096+0000","last_clean":"2024-05-08T20:55:04.517096+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T20:55:04.517096+0000","last_undegraded":"2024-05-08T20:55:04.517096+0000","last_fullsized":"2024-05-08T20:55:04.517096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100573+0000","last_change":"2024-05-08T20:54:59.629962+0000","last_active":"2024-05-08T20:55:04.100573+0000","last_peered":"2024-05-08T20:55:04.100573+0000","last_clean":"2024-05-08T20:55:04.100573+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T20:55:04.100573+0000","last_undegraded":"2024-05-08T20:55:04.100573+0000","last_fullsized":"2024-05-08T20:55:04.100573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100713+0000","last_change":"2024-05-08T20:55:00.102710+0000","last_active":"2024-05-08T20:55:04.100713+0000","last_peered":"2024-05-08T20:55:04.100713+0000","last_clean":"2024-05-08T20:55:04.100713+0000","last_became_active":"2024-05-08T20:55:00.102463+0000","last_became_peered":"2024-05-08T20:55:00.102463+0000","last_unstale":"2024-05-08T20:55:04.100713+0000","last_undegraded":"2024-05-08T20:55:04.100713+0000","last_fullsized":"2024-05-08T20:55:04.100713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512860+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T20:55:04.512860+0000","last_peered":"2024-05-08T20:55:04.512860+0000","last_clean":"2024-05-08T20:55:04.512860+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T20:55:04.512860+0000","last_undegraded":"2024-05-08T20:55:04.512860+0000","last_fullsized":"2024-05-08T20:55:04.512860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.959849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101724+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T20:55:04.101724+0000","last_peered":"2024-05-08T20:55:04.101724+0000","last_clean":"2024-05-08T20:55:04.101724+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T20:55:04.101724+0000","last_undegraded":"2024-05-08T20:55:04.101724+0000","last_fullsized":"2024-05-08T20:55:04.101724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209759+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T20:55:04.209759+0000","last_peered":"2024-05-08T20:55:04.209759+0000","last_clean":"2024-05-08T20:55:04.209759+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T20:55:04.209759+0000","last_undegraded":"2024-05-08T20:55:04.209759+0000","last_fullsized":"2024-05-08T20:55:04.209759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512867+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T20:55:04.512867+0000","last_peered":"2024-05-08T20:55:04.512867+0000","last_clean":"2024-05-08T20:55:04.512867+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T20:55:04.512867+0000","last_undegraded":"2024-05-08T20:55:04.512867+0000","last_fullsized":"2024-05-08T20:55:04.512867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:34.555272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091308+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T20:55:04.091308+0000","last_peered":"2024-05-08T20:55:04.091308+0000","last_clean":"2024-05-08T20:55:04.091308+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T20:55:04.091308+0000","last_undegraded":"2024-05-08T20:55:04.091308+0000","last_fullsized":"2024-05-08T20:55:04.091308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097710+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T20:55:04.097710+0000","last_peered":"2024-05-08T20:55:04.097710+0000","last_clean":"2024-05-08T20:55:04.097710+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T20:55:04.097710+0000","last_undegraded":"2024-05-08T20:55:04.097710+0000","last_fullsized":"2024-05-08T20:55:04.097710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209633+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T20:55:04.209633+0000","last_peered":"2024-05-08T20:55:04.209633+0000","last_clean":"2024-05-08T20:55:04.209633+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T20:55:04.209633+0000","last_undegraded":"2024-05-08T20:55:04.209633+0000","last_fullsized":"2024-05-08T20:55:04.209633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518929+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T20:55:04.518929+0000","last_peered":"2024-05-08T20:55:04.518929+0000","last_clean":"2024-05-08T20:55:04.518929+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T20:55:04.518929+0000","last_undegraded":"2024-05-08T20:55:04.518929+0000","last_fullsized":"2024-05-08T20:55:04.518929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095787+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T20:55:04.095787+0000","last_peered":"2024-05-08T20:55:04.095787+0000","last_clean":"2024-05-08T20:55:04.095787+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T20:55:04.095787+0000","last_undegraded":"2024-05-08T20:55:04.095787+0000","last_fullsized":"2024-05-08T20:55:04.095787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:17.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210177+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T20:55:04.210177+0000","last_peered":"2024-05-08T20:55:04.210177+0000","last_clean":"2024-05-08T20:55:04.210177+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T20:55:04.210177+0000","last_undegraded":"2024-05-08T20:55:04.210177+0000","last_fullsized":"2024-05-08T20:55:04.210177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871830+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T20:55:04.871830+0000","last_peered":"2024-05-08T20:55:04.871830+0000","last_clean":"2024-05-08T20:55:04.871830+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T20:55:04.871830+0000","last_undegraded":"2024-05-08T20:55:04.871830+0000","last_fullsized":"2024-05-08T20:55:04.871830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106256+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T20:55:04.106256+0000","last_peered":"2024-05-08T20:55:04.106256+0000","last_clean":"2024-05-08T20:55:04.106256+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T20:55:04.106256+0000","last_undegraded":"2024-05-08T20:55:04.106256+0000","last_fullsized":"2024-05-08T20:55:04.106256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102154+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T20:55:04.102154+0000","last_peered":"2024-05-08T20:55:04.102154+0000","last_clean":"2024-05-08T20:55:04.102154+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T20:55:04.102154+0000","last_undegraded":"2024-05-08T20:55:04.102154+0000","last_fullsized":"2024-05-08T20:55:04.102154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871697+0000","last_change":"2024-05-08T20:55:04.117093+0000","last_active":"2024-05-08T20:55:04.871697+0000","last_peered":"2024-05-08T20:55:04.871697+0000","last_clean":"2024-05-08T20:55:04.871697+0000","last_became_active":"2024-05-08T20:55:04.115995+0000","last_became_peered":"2024-05-08T20:55:04.115995+0000","last_unstale":"2024-05-08T20:55:04.871697+0000","last_undegraded":"2024-05-08T20:55:04.871697+0000","last_fullsized":"2024-05-08T20:55:04.871697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101637+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T20:55:04.101637+0000","last_peered":"2024-05-08T20:55:04.101637+0000","last_clean":"2024-05-08T20:55:04.101637+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T20:55:04.101637+0000","last_undegraded":"2024-05-08T20:55:04.101637+0000","last_fullsized":"2024-05-08T20:55:04.101637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095588+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T20:55:04.095588+0000","last_peered":"2024-05-08T20:55:04.095588+0000","last_clean":"2024-05-08T20:55:04.095588+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T20:55:04.095588+0000","last_undegraded":"2024-05-08T20:55:04.095588+0000","last_fullsized":"2024-05-08T20:55:04.095588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:30.883278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872006+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T20:55:04.872006+0000","last_peered":"2024-05-08T20:55:04.872006+0000","last_clean":"2024-05-08T20:55:04.872006+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T20:55:04.872006+0000","last_undegraded":"2024-05-08T20:55:04.872006+0000","last_fullsized":"2024-05-08T20:55:04.872006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105577+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T20:55:04.105577+0000","last_peered":"2024-05-08T20:55:04.105577+0000","last_clean":"2024-05-08T20:55:04.105577+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T20:55:04.105577+0000","last_undegraded":"2024-05-08T20:55:04.105577+0000","last_fullsized":"2024-05-08T20:55:04.105577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097867+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T20:55:04.097867+0000","last_peered":"2024-05-08T20:55:04.097867+0000","last_clean":"2024-05-08T20:55:04.097867+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T20:55:04.097867+0000","last_undegraded":"2024-05-08T20:55:04.097867+0000","last_fullsized":"2024-05-08T20:55:04.097867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655085+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T20:55:04.655085+0000","last_peered":"2024-05-08T20:55:04.655085+0000","last_clean":"2024-05-08T20:55:04.655085+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T20:55:04.655085+0000","last_undegraded":"2024-05-08T20:55:04.655085+0000","last_fullsized":"2024-05-08T20:55:04.655085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090921+0000","last_change":"2024-05-08T20:55:00.091803+0000","last_active":"2024-05-08T20:55:04.090921+0000","last_peered":"2024-05-08T20:55:04.090921+0000","last_clean":"2024-05-08T20:55:04.090921+0000","last_became_active":"2024-05-08T20:55:00.091556+0000","last_became_peered":"2024-05-08T20:55:00.091556+0000","last_unstale":"2024-05-08T20:55:04.090921+0000","last_undegraded":"2024-05-08T20:55:04.090921+0000","last_fullsized":"2024-05-08T20:55:04.090921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101787+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T20:55:04.101787+0000","last_peered":"2024-05-08T20:55:04.101787+0000","last_clean":"2024-05-08T20:55:04.101787+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T20:55:04.101787+0000","last_undegraded":"2024-05-08T20:55:04.101787+0000","last_fullsized":"2024-05-08T20:55:04.101787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209118+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T20:55:04.209118+0000","last_peered":"2024-05-08T20:55:04.209118+0000","last_clean":"2024-05-08T20:55:04.209118+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T20:55:04.209118+0000","last_undegraded":"2024-05-08T20:55:04.209118+0000","last_fullsized":"2024-05-08T20:55:04.209118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101104+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T20:55:04.101104+0000","last_peered":"2024-05-08T20:55:04.101104+0000","last_clean":"2024-05-08T20:55:04.101104+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T20:55:04.101104+0000","last_undegraded":"2024-05-08T20:55:04.101104+0000","last_fullsized":"2024-05-08T20:55:04.101104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:16.831824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209208+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T20:55:04.209208+0000","last_peered":"2024-05-08T20:55:04.209208+0000","last_clean":"2024-05-08T20:55:04.209208+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T20:55:04.209208+0000","last_undegraded":"2024-05-08T20:55:04.209208+0000","last_fullsized":"2024-05-08T20:55:04.209208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873248+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T20:55:04.873248+0000","last_peered":"2024-05-08T20:55:04.873248+0000","last_clean":"2024-05-08T20:55:04.873248+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T20:55:04.873248+0000","last_undegraded":"2024-05-08T20:55:04.873248+0000","last_fullsized":"2024-05-08T20:55:04.873248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209773+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T20:55:04.209773+0000","last_peered":"2024-05-08T20:55:04.209773+0000","last_clean":"2024-05-08T20:55:04.209773+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T20:55:04.209773+0000","last_undegraded":"2024-05-08T20:55:04.209773+0000","last_fullsized":"2024-05-08T20:55:04.209773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106292+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T20:55:04.106292+0000","last_peered":"2024-05-08T20:55:04.106292+0000","last_clean":"2024-05-08T20:55:04.106292+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T20:55:04.106292+0000","last_undegraded":"2024-05-08T20:55:04.106292+0000","last_fullsized":"2024-05-08T20:55:04.106292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512323+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T20:55:04.512323+0000","last_peered":"2024-05-08T20:55:04.512323+0000","last_clean":"2024-05-08T20:55:04.512323+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T20:55:04.512323+0000","last_undegraded":"2024-05-08T20:55:04.512323+0000","last_fullsized":"2024-05-08T20:55:04.512323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:18.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106745+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T20:55:04.106745+0000","last_peered":"2024-05-08T20:55:04.106745+0000","last_clean":"2024-05-08T20:55:04.106745+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T20:55:04.106745+0000","last_undegraded":"2024-05-08T20:55:04.106745+0000","last_fullsized":"2024-05-08T20:55:04.106745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091711+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T20:55:04.091711+0000","last_peered":"2024-05-08T20:55:04.091711+0000","last_clean":"2024-05-08T20:55:04.091711+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T20:55:04.091711+0000","last_undegraded":"2024-05-08T20:55:04.091711+0000","last_fullsized":"2024-05-08T20:55:04.091711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518932+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T20:55:04.518932+0000","last_peered":"2024-05-08T20:55:04.518932+0000","last_clean":"2024-05-08T20:55:04.518932+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T20:55:04.518932+0000","last_undegraded":"2024-05-08T20:55:04.518932+0000","last_fullsized":"2024-05-08T20:55:04.518932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:59.610624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093217+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T20:55:04.093217+0000","last_peered":"2024-05-08T20:55:04.093217+0000","last_clean":"2024-05-08T20:55:04.093217+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T20:55:04.093217+0000","last_undegraded":"2024-05-08T20:55:04.093217+0000","last_fullsized":"2024-05-08T20:55:04.093217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101416+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T20:55:04.101416+0000","last_peered":"2024-05-08T20:55:04.101416+0000","last_clean":"2024-05-08T20:55:04.101416+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T20:55:04.101416+0000","last_undegraded":"2024-05-08T20:55:04.101416+0000","last_fullsized":"2024-05-08T20:55:04.101416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519324+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T20:55:04.519324+0000","last_peered":"2024-05-08T20:55:04.519324+0000","last_clean":"2024-05-08T20:55:04.519324+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T20:55:04.519324+0000","last_undegraded":"2024-05-08T20:55:04.519324+0000","last_fullsized":"2024-05-08T20:55:04.519324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209104+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T20:55:04.209104+0000","last_peered":"2024-05-08T20:55:04.209104+0000","last_clean":"2024-05-08T20:55:04.209104+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T20:55:04.209104+0000","last_undegraded":"2024-05-08T20:55:04.209104+0000","last_fullsized":"2024-05-08T20:55:04.209104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095004+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T20:55:04.095004+0000","last_peered":"2024-05-08T20:55:04.095004+0000","last_clean":"2024-05-08T20:55:04.095004+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T20:55:04.095004+0000","last_undegraded":"2024-05-08T20:55:04.095004+0000","last_fullsized":"2024-05-08T20:55:04.095004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.899173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872102+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T20:55:04.872102+0000","last_peered":"2024-05-08T20:55:04.872102+0000","last_clean":"2024-05-08T20:55:04.872102+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T20:55:04.872102+0000","last_undegraded":"2024-05-08T20:55:04.872102+0000","last_fullsized":"2024-05-08T20:55:04.872102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105823+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T20:55:04.105823+0000","last_peered":"2024-05-08T20:55:04.105823+0000","last_clean":"2024-05-08T20:55:04.105823+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T20:55:04.105823+0000","last_undegraded":"2024-05-08T20:55:04.105823+0000","last_fullsized":"2024-05-08T20:55:04.105823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090691+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T20:55:04.090691+0000","last_peered":"2024-05-08T20:55:04.090691+0000","last_clean":"2024-05-08T20:55:04.090691+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T20:55:04.090691+0000","last_undegraded":"2024-05-08T20:55:04.090691+0000","last_fullsized":"2024-05-08T20:55:04.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519380+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T20:55:04.519380+0000","last_peered":"2024-05-08T20:55:04.519380+0000","last_clean":"2024-05-08T20:55:04.519380+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T20:55:04.519380+0000","last_undegraded":"2024-05-08T20:55:04.519380+0000","last_fullsized":"2024-05-08T20:55:04.519380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:27.059976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106930+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T20:55:04.106930+0000","last_peered":"2024-05-08T20:55:04.106930+0000","last_clean":"2024-05-08T20:55:04.106930+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T20:55:04.106930+0000","last_undegraded":"2024-05-08T20:55:04.106930+0000","last_fullsized":"2024-05-08T20:55:04.106930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091617+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T20:55:04.091617+0000","last_peered":"2024-05-08T20:55:04.091617+0000","last_clean":"2024-05-08T20:55:04.091617+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T20:55:04.091617+0000","last_undegraded":"2024-05-08T20:55:04.091617+0000","last_fullsized":"2024-05-08T20:55:04.091617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519561+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T20:55:04.519561+0000","last_peered":"2024-05-08T20:55:04.519561+0000","last_clean":"2024-05-08T20:55:04.519561+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T20:55:04.519561+0000","last_undegraded":"2024-05-08T20:55:04.519561+0000","last_fullsized":"2024-05-08T20:55:04.519561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209808+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T20:55:04.209808+0000","last_peered":"2024-05-08T20:55:04.209808+0000","last_clean":"2024-05-08T20:55:04.209808+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T20:55:04.209808+0000","last_undegraded":"2024-05-08T20:55:04.209808+0000","last_fullsized":"2024-05-08T20:55:04.209808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092750+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T20:55:04.092750+0000","last_peered":"2024-05-08T20:55:04.092750+0000","last_clean":"2024-05-08T20:55:04.092750+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T20:55:04.092750+0000","last_undegraded":"2024-05-08T20:55:04.092750+0000","last_fullsized":"2024-05-08T20:55:04.092750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.654813+0000","last_change":"2024-05-08T20:55:04.211367+0000","last_active":"2024-05-08T20:55:04.654813+0000","last_peered":"2024-05-08T20:55:04.654813+0000","last_clean":"2024-05-08T20:55:04.654813+0000","last_became_active":"2024-05-08T20:55:04.210862+0000","last_became_peered":"2024-05-08T20:55:04.210862+0000","last_unstale":"2024-05-08T20:55:04.654813+0000","last_undegraded":"2024-05-08T20:55:04.654813+0000","last_fullsized":"2024-05-08T20:55:04.654813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097858+0000","last_change":"2024-05-08T20:54:59.625358+0000","last_active":"2024-05-08T20:55:04.097858+0000","last_peered":"2024-05-08T20:55:04.097858+0000","last_clean":"2024-05-08T20:55:04.097858+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T20:55:04.097858+0000","last_undegraded":"2024-05-08T20:55:04.097858+0000","last_fullsized":"2024-05-08T20:55:04.097858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210050+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T20:55:04.210050+0000","last_peered":"2024-05-08T20:55:04.210050+0000","last_clean":"2024-05-08T20:55:04.210050+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T20:55:04.210050+0000","last_undegraded":"2024-05-08T20:55:04.210050+0000","last_fullsized":"2024-05-08T20:55:04.210050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873140+0000","last_change":"2024-05-08T20:55:04.116701+0000","last_active":"2024-05-08T20:55:04.873140+0000","last_peered":"2024-05-08T20:55:04.873140+0000","last_clean":"2024-05-08T20:55:04.873140+0000","last_became_active":"2024-05-08T20:55:04.116308+0000","last_became_peered":"2024-05-08T20:55:04.116308+0000","last_unstale":"2024-05-08T20:55:04.873140+0000","last_undegraded":"2024-05-08T20:55:04.873140+0000","last_fullsized":"2024-05-08T20:55:04.873140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106286+0000","last_change":"2024-05-08T20:54:59.618192+0000","last_active":"2024-05-08T20:55:04.106286+0000","last_peered":"2024-05-08T20:55:04.106286+0000","last_clean":"2024-05-08T20:55:04.106286+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T20:55:04.106286+0000","last_undegraded":"2024-05-08T20:55:04.106286+0000","last_fullsized":"2024-05-08T20:55:04.106286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101864+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T20:55:04.101864+0000","last_peered":"2024-05-08T20:55:04.101864+0000","last_clean":"2024-05-08T20:55:04.101864+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T20:55:04.101864+0000","last_undegraded":"2024-05-08T20:55:04.101864+0000","last_fullsized":"2024-05-08T20:55:04.101864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.516609+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T20:55:04.516609+0000","last_peered":"2024-05-08T20:55:04.516609+0000","last_clean":"2024-05-08T20:55:04.516609+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T20:55:04.516609+0000","last_undegraded":"2024-05-08T20:55:04.516609+0000","last_fullsized":"2024-05-08T20:55:04.516609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097649+0000","last_change":"2024-05-08T20:54:59.623921+0000","last_active":"2024-05-08T20:55:04.097649+0000","last_peered":"2024-05-08T20:55:04.097649+0000","last_clean":"2024-05-08T20:55:04.097649+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T20:55:04.097649+0000","last_undegraded":"2024-05-08T20:55:04.097649+0000","last_fullsized":"2024-05-08T20:55:04.097649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210761+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T20:55:04.210761+0000","last_peered":"2024-05-08T20:55:04.210761+0000","last_clean":"2024-05-08T20:55:04.210761+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T20:55:04.210761+0000","last_undegraded":"2024-05-08T20:55:04.210761+0000","last_fullsized":"2024-05-08T20:55:04.210761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092114+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T20:55:04.092114+0000","last_peered":"2024-05-08T20:55:04.092114+0000","last_clean":"2024-05-08T20:55:04.092114+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T20:55:04.092114+0000","last_undegraded":"2024-05-08T20:55:04.092114+0000","last_fullsized":"2024-05-08T20:55:04.092114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097934+0000","last_change":"2024-05-08T20:55:00.088933+0000","last_active":"2024-05-08T20:55:04.097934+0000","last_peered":"2024-05-08T20:55:04.097934+0000","last_clean":"2024-05-08T20:55:04.097934+0000","last_became_active":"2024-05-08T20:55:00.088651+0000","last_became_peered":"2024-05-08T20:55:00.088651+0000","last_unstale":"2024-05-08T20:55:04.097934+0000","last_undegraded":"2024-05-08T20:55:04.097934+0000","last_fullsized":"2024-05-08T20:55:04.097934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102032+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T20:55:04.102032+0000","last_peered":"2024-05-08T20:55:04.102032+0000","last_clean":"2024-05-08T20:55:04.102032+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T20:55:04.102032+0000","last_undegraded":"2024-05-08T20:55:04.102032+0000","last_fullsized":"2024-05-08T20:55:04.102032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100404+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T20:55:04.100404+0000","last_peered":"2024-05-08T20:55:04.100404+0000","last_clean":"2024-05-08T20:55:04.100404+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T20:55:04.100404+0000","last_undegraded":"2024-05-08T20:55:04.100404+0000","last_fullsized":"2024-05-08T20:55:04.100404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091752+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T20:55:04.091752+0000","last_peered":"2024-05-08T20:55:04.091752+0000","last_clean":"2024-05-08T20:55:04.091752+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T20:55:04.091752+0000","last_undegraded":"2024-05-08T20:55:04.091752+0000","last_fullsized":"2024-05-08T20:55:04.091752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106193+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T20:55:04.106193+0000","last_peered":"2024-05-08T20:55:04.106193+0000","last_clean":"2024-05-08T20:55:04.106193+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T20:55:04.106193+0000","last_undegraded":"2024-05-08T20:55:04.106193+0000","last_fullsized":"2024-05-08T20:55:04.106193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091956+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T20:55:04.091956+0000","last_peered":"2024-05-08T20:55:04.091956+0000","last_clean":"2024-05-08T20:55:04.091956+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T20:55:04.091956+0000","last_undegraded":"2024-05-08T20:55:04.091956+0000","last_fullsized":"2024-05-08T20:55:04.091956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091800+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T20:55:04.091800+0000","last_peered":"2024-05-08T20:55:04.091800+0000","last_clean":"2024-05-08T20:55:04.091800+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T20:55:04.091800+0000","last_undegraded":"2024-05-08T20:55:04.091800+0000","last_fullsized":"2024-05-08T20:55:04.091800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101516+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T20:55:04.101516+0000","last_peered":"2024-05-08T20:55:04.101516+0000","last_clean":"2024-05-08T20:55:04.101516+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T20:55:04.101516+0000","last_undegraded":"2024-05-08T20:55:04.101516+0000","last_fullsized":"2024-05-08T20:55:04.101516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090738+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T20:55:04.090738+0000","last_peered":"2024-05-08T20:55:04.090738+0000","last_clean":"2024-05-08T20:55:04.090738+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T20:55:04.090738+0000","last_undegraded":"2024-05-08T20:55:04.090738+0000","last_fullsized":"2024-05-08T20:55:04.090738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102133+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T20:55:04.102133+0000","last_peered":"2024-05-08T20:55:04.102133+0000","last_clean":"2024-05-08T20:55:04.102133+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T20:55:04.102133+0000","last_undegraded":"2024-05-08T20:55:04.102133+0000","last_fullsized":"2024-05-08T20:55:04.102133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100484+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T20:55:04.100484+0000","last_peered":"2024-05-08T20:55:04.100484+0000","last_clean":"2024-05-08T20:55:04.100484+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T20:55:04.100484+0000","last_undegraded":"2024-05-08T20:55:04.100484+0000","last_fullsized":"2024-05-08T20:55:04.100484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091573+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T20:55:04.091573+0000","last_peered":"2024-05-08T20:55:04.091573+0000","last_clean":"2024-05-08T20:55:04.091573+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T20:55:04.091573+0000","last_undegraded":"2024-05-08T20:55:04.091573+0000","last_fullsized":"2024-05-08T20:55:04.091573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:55:25.050 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T20:55:25.050 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T20:55:25.050 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T20:55:25.051 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T20:55:25.051 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T20:55:25.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.205+0000 7f25134cc700 1 Processor -- start 2024-05-08T20:55:25.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.205+0000 7f25134cc700 1 -- start start 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f25134cc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f250c1535a0 0x7f250c06a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f25134cc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f250c0cbf50 0x7f250c06aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f25134cc700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c15c990 con 0x7f250c072ae0 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f25134cc700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250c15cbc0 con 0x7f250c0cbf50 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f25134cc700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250c15ce60 con 0x7f250c1535a0 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f250c0cbf50 0x7f250c06aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f250c0cbf50 0x7f250c06aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33002/0 (socket says 172.21.15.135:33002) 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2511a69700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f250c072ae0 0x7f250c0c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59796/0 (socket says 172.21.15.135:59796) 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 -- 172.21.15.135:0/1360963137 learned_addr learned my addr 172.21.15.135:0/1360963137 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:25.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2511268700 1 --2- 172.21.15.135:0/1360963137 >> v2:172.21.15.183:3300/0 conn(0x7f250c1535a0 0x7f250c06a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 -- 172.21.15.135:0/1360963137 >> v2:172.21.15.183:3300/0 conn(0x7f250c1535a0 msgr2=0x7f250c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 --2- 172.21.15.135:0/1360963137 >> v2:172.21.15.183:3300/0 conn(0x7f250c1535a0 0x7f250c06a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 -- 172.21.15.135:0/1360963137 >> v1:172.21.15.135:6789/0 conn(0x7f250c072ae0 legacy=0x7f250c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2503fff700 1 -- 172.21.15.135:0/1360963137 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041840504 0 0) 0x7f250c15c990 con 0x7f250c072ae0 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 -- 172.21.15.135:0/1360963137 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c15d140 con 0x7f250c0cbf50 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.206+0000 7f2510a67700 1 --2- 172.21.15.135:0/1360963137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c0cbf50 0x7f250c06aea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f250c0cca20 tx=0x7f24fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c06dbdbfc85e60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f2503fff700 1 -- 172.21.15.135:0/1360963137 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00b870 con 0x7f250c0cbf50 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f2503fff700 1 -- 172.21.15.135:0/1360963137 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc00b9d0 con 0x7f250c0cbf50 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f2503fff700 1 -- 172.21.15.135:0/1360963137 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00bd60 con 0x7f250c0cbf50 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 -- 172.21.15.135:0/1360963137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c0cbf50 msgr2=0x7f250c06aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 --2- 172.21.15.135:0/1360963137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c0cbf50 0x7f250c06aea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f250c0cca20 tx=0x7f24fc009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 -- 172.21.15.135:0/1360963137 shutdown_connections 2024-05-08T20:55:25.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 --2- 172.21.15.135:0/1360963137 >> v2:172.21.15.183:3300/0 conn(0x7f250c1535a0 0x7f250c06a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 --2- 172.21.15.135:0/1360963137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c0cbf50 0x7f250c06aea0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 -- 172.21.15.135:0/1360963137 >> 172.21.15.135:0/1360963137 conn(0x7f250c06daf0 msgr2=0x7f250c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:25.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 -- 172.21.15.135:0/1360963137 shutdown_connections 2024-05-08T20:55:25.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.207+0000 7f25134cc700 1 -- 172.21.15.135:0/1360963137 wait complete. 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.209+0000 7f25134cc700 1 Processor -- start 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.209+0000 7f25134cc700 1 -- start start 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f25134cc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c072ae0 0x7f250c1ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f25134cc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f250c0cbf50 0x7f250c14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f25134cc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f250c1535a0 0x7f250c1f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f25134cc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c1efca0 con 0x7f250c072ae0 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f25134cc700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c153c50 con 0x7f250c0cbf50 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f25134cc700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c14db40 con 0x7f250c1535a0 2024-05-08T20:55:25.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c072ae0 0x7f250c1ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c072ae0 0x7f250c1ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33018/0 (socket says 172.21.15.135:33018) 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 -- 172.21.15.135:0/2399249276 learned_addr learned my addr 172.21.15.135:0/2399249276 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511a69700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f250c1535a0 0x7f250c1f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2510a67700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f250c0cbf50 0x7f250c14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 -- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f250c1535a0 msgr2=0x7f250c1f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f250c1535a0 0x7f250c1f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 -- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f250c0cbf50 msgr2=0x7f250c14d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f250c0cbf50 0x7f250c14d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 -- 172.21.15.135:0/2399249276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc009550 con 0x7f250c072ae0 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511a69700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f250c1535a0 0x7f250c1f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2510a67700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f250c0cbf50 0x7f250c14d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2511268700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c072ae0 0x7f250c1ef760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f250800d800 tx=0x7f250800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2501ffb700 1 -- 172.21.15.135:0/2399249276 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25080125f0 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2501ffb700 1 -- 172.21.15.135:0/2399249276 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2508012750 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f2501ffb700 1 -- 172.21.15.135:0/2399249276 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508012b00 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.210+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c158de0 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.211+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c153ea0 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.212+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c0c33c0 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.212+0000 7f2501ffb700 1 -- 172.21.15.135:0/2399249276 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2508012c60 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.212+0000 7f2501ffb700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f24f006ac90 0x7f24f006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.212+0000 7f2501ffb700 1 -- 172.21.15.135:0/2399249276 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2508089b40 con 0x7f250c072ae0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.212+0000 7f2510a67700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f24f006ac90 0x7f24f006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.213+0000 7f2510a67700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f24f006ac90 0x7f24f006d150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000c00 tx=0x7f24fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.217+0000 7f2501ffb700 1 -- 172.21.15.135:0/2399249276 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25080549a0 con 0x7f250c072ae0 2024-05-08T20:55:25.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.471+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f250c067fa0 con 0x7f250c072ae0 2024-05-08T20:55:25.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.474+0000 7f2501ffb700 1 -- 172.21.15.135:0/2399249276 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170940 (secure 0 0 0) 0x7f2508057fc0 con 0x7f250c072ae0 2024-05-08T20:55:25.478 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:25.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f24f006ac90 msgr2=0x7f24f006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f24f006ac90 0x7f24f006d150 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000c00 tx=0x7f24fc008030 comp rx=0 tx=0).stop 2024-05-08T20:55:25.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c072ae0 msgr2=0x7f250c1ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c072ae0 0x7f250c1ef760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f250800d800 tx=0x7f250800dbc0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 shutdown_connections 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f24f006ac90 0x7f24f006d150 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f250c1535a0 0x7f250c1f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f250c072ae0 0x7f250c1ef760 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 --2- 172.21.15.135:0/2399249276 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f250c0cbf50 0x7f250c14d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 >> 172.21.15.135:0/2399249276 conn(0x7f250c06daf0 msgr2=0x7f250c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 shutdown_connections 2024-05-08T20:55:25.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.477+0000 7f25134cc700 1 -- 172.21.15.135:0/2399249276 wait complete. 2024-05-08T20:55:25.491 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":46829},{"type":"v1","addr":"172.21.15.135:6833","nonce":46829}]},"active_addr":"172.21.15.135:6833/46829","active_change":"2024-05-08T20:54:40.445250+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1180246204}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":242492867}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":4759715}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1387693947}]}]} 2024-05-08T20:55:25.494 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T20:55:25.494 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T20:55:25.494 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:25.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.615+0000 7efc9c52f700 1 Processor -- start 2024-05-08T20:55:25.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.615+0000 7efc9c52f700 1 -- start start 2024-05-08T20:55:25.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9c52f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efc940c2680 0x7efc9415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9c52f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9415b620 con 0x7efc94151400 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9c52f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940ccd60 con 0x7efc940c9e80 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9c52f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940c1b20 con 0x7efc940c2680 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9aacc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7efc940c2680 0x7efc9415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9a2cb700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7efc94151400 0x7efc94070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59802/0 (socket says 172.21.15.135:59802) 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9a2cb700 1 -- 172.21.15.135:0/4146093321 learned_addr learned my addr 172.21.15.135:0/4146093321 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc992c9700 1 -- 172.21.15.135:0/4146093321 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536903553 0 0) 0x7efc9415b620 con 0x7efc94151400 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc992c9700 1 -- 172.21.15.135:0/4146093321 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc800035b0 con 0x7efc94151400 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9aacc700 1 -- 172.21.15.135:0/4146093321 >> v1:172.21.15.183:6789/0 conn(0x7efc940c9e80 legacy=0x7efc940c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9aacc700 1 -- 172.21.15.135:0/4146093321 >> v1:172.21.15.135:6789/0 conn(0x7efc94151400 legacy=0x7efc94070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.616+0000 7efc9aacc700 1 -- 172.21.15.135:0/4146093321 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940cd040 con 0x7efc940c2680 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9aacc700 1 --2- 172.21.15.135:0/4146093321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc9415b0e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009d90 tx=0x7efc8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564a16b4db0a8e6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc992c9700 1 -- 172.21.15.135:0/4146093321 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00e070 con 0x7efc940c2680 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc992c9700 1 -- 172.21.15.135:0/4146093321 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00bb20 con 0x7efc940c2680 2024-05-08T20:55:25.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc992c9700 1 -- 172.21.15.135:0/4146093321 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c012430 con 0x7efc940c2680 2024-05-08T20:55:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9c52f700 1 -- 172.21.15.135:0/4146093321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 msgr2=0x7efc9415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9c52f700 1 --2- 172.21.15.135:0/4146093321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc9415b0e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009d90 tx=0x7efc8c00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9c52f700 1 -- 172.21.15.135:0/4146093321 shutdown_connections 2024-05-08T20:55:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9c52f700 1 --2- 172.21.15.135:0/4146093321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc9415b0e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9c52f700 1 -- 172.21.15.135:0/4146093321 >> 172.21.15.135:0/4146093321 conn(0x7efc94066d70 msgr2=0x7efc9406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9c52f700 1 -- 172.21.15.135:0/4146093321 shutdown_connections 2024-05-08T20:55:25.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.617+0000 7efc9c52f700 1 -- 172.21.15.135:0/4146093321 wait complete. 2024-05-08T20:55:25.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 Processor -- start 2024-05-08T20:55:25.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 -- start start 2024-05-08T20:55:25.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc940cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc940c9e80 0x7efc94159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc94151400 0x7efc941ee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940cb6e0 con 0x7efc940c2680 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94154690 con 0x7efc940c9e80 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9c52f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc941f2430 con 0x7efc94151400 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9a2cb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc940cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9a2cb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc940cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33028/0 (socket says 172.21.15.135:33028) 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.619+0000 7efc9a2cb700 1 -- 172.21.15.135:0/3224011914 learned_addr learned my addr 172.21.15.135:0/3224011914 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9aacc700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc94151400 0x7efc941ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc99aca700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc940c9e80 0x7efc94159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9a2cb700 1 -- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc94151400 msgr2=0x7efc941ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9a2cb700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc94151400 0x7efc941ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9a2cb700 1 -- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc940c9e80 msgr2=0x7efc94159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9a2cb700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc940c9e80 0x7efc94159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9a2cb700 1 -- 172.21.15.135:0/3224011914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c009a70 con 0x7efc940c2680 2024-05-08T20:55:25.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc99aca700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc940c9e80 0x7efc94159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9aacc700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc94151400 0x7efc941ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9a2cb700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc940cb1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc8400c4d0 tx=0x7efc8400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc8affd700 1 -- 172.21.15.135:0/3224011914 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84005d70 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc8affd700 1 -- 172.21.15.135:0/3224011914 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc840070d0 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc94154bc0 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc8affd700 1 -- 172.21.15.135:0/3224011914 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84007460 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.620+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc941548e0 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.621+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc941f2710 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.621+0000 7efc8affd700 1 -- 172.21.15.135:0/3224011914 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc840075c0 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.622+0000 7efc8affd700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efc7806ac90 0x7efc7806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.622+0000 7efc8affd700 1 -- 172.21.15.135:0/3224011914 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc84088b10 con 0x7efc940c2680 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.622+0000 7efc99aca700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efc7806ac90 0x7efc7806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.622+0000 7efc99aca700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efc7806ac90 0x7efc7806d150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc941ec0b0 tx=0x7efc90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.626+0000 7efc8affd700 1 -- 172.21.15.135:0/3224011914 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efc84053a00 con 0x7efc940c2680 2024-05-08T20:55:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.823+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc94067fa0 con 0x7efc940c2680 2024-05-08T20:55:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.824+0000 7efc8affd700 1 -- 172.21.15.135:0/3224011914 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7efc84017090 con 0x7efc940c2680 2024-05-08T20:55:25.826 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:25.826 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efc7806ac90 msgr2=0x7efc7806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efc7806ac90 0x7efc7806d150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc941ec0b0 tx=0x7efc90009040 comp rx=0 tx=0).stop 2024-05-08T20:55:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 msgr2=0x7efc940cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc940cb1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc8400c4d0 tx=0x7efc8400c890 comp rx=0 tx=0).stop 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 shutdown_connections 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7efc7806ac90 0x7efc7806d150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc94151400 0x7efc941ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc940c2680 0x7efc940cb1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 --2- 172.21.15.135:0/3224011914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc940c9e80 0x7efc94159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 >> 172.21.15.135:0/3224011914 conn(0x7efc94066d70 msgr2=0x7efc940c1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 shutdown_connections 2024-05-08T20:55:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.826+0000 7efc9c52f700 1 -- 172.21.15.135:0/3224011914 wait complete. 2024-05-08T20:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T20:55:25.841 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:25.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.959+0000 7f958513b700 1 Processor -- start 2024-05-08T20:55:25.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.960+0000 7f958513b700 1 -- start start 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.960+0000 7f958513b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f95800c62d0 0x7f958015d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.960+0000 7f958513b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580159390 0x7f95800cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.960+0000 7f958513b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9580159cb0 con 0x7f9580153410 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.960+0000 7f958513b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95800c3240 con 0x7f95800c62d0 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.960+0000 7f958513b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9580159f90 con 0x7f9580159390 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.960+0000 7f957e59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f95800c62d0 0x7f958015d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957ed9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f9580153410 0x7f958006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59816/0 (socket says 172.21.15.135:59816) 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957ed9d700 1 -- 172.21.15.135:0/1068136474 learned_addr learned my addr 172.21.15.135:0/1068136474 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957f59e700 1 --2- 172.21.15.135:0/1068136474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580159390 0x7f95800cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957e59c700 1 -- 172.21.15.135:0/1068136474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580159390 msgr2=0x7f95800cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:25.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957e59c700 1 --2- 172.21.15.135:0/1068136474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580159390 0x7f95800cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957e59c700 1 -- 172.21.15.135:0/1068136474 >> v1:172.21.15.135:6789/0 conn(0x7f9580153410 legacy=0x7f958006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957dd9b700 1 -- 172.21.15.135:0/1068136474 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363119823 0 0) 0x7f9580159cb0 con 0x7f9580153410 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957e59c700 1 -- 172.21.15.135:0/1068136474 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958015ca20 con 0x7f95800c62d0 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957e59c700 1 --2- 172.21.15.135:0/1068136474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95800c62d0 0x7f958015d500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9570009840 tx=0x7f9570009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167c8bc03b843fdd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957dd9b700 1 -- 172.21.15.135:0/1068136474 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570011830 con 0x7f95800c62d0 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957dd9b700 1 -- 172.21.15.135:0/1068136474 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9570011990 con 0x7f95800c62d0 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.961+0000 7f957dd9b700 1 -- 172.21.15.135:0/1068136474 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570011d20 con 0x7f95800c62d0 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 -- 172.21.15.135:0/1068136474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95800c62d0 msgr2=0x7f958015d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 --2- 172.21.15.135:0/1068136474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95800c62d0 0x7f958015d500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9570009840 tx=0x7f9570009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 -- 172.21.15.135:0/1068136474 shutdown_connections 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 --2- 172.21.15.135:0/1068136474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580159390 0x7f95800cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 --2- 172.21.15.135:0/1068136474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95800c62d0 0x7f958015d500 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 -- 172.21.15.135:0/1068136474 >> 172.21.15.135:0/1068136474 conn(0x7f958006d3e0 msgr2=0x7f958006d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:25.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 -- 172.21.15.135:0/1068136474 shutdown_connections 2024-05-08T20:55:25.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.962+0000 7f958513b700 1 -- 172.21.15.135:0/1068136474 wait complete. 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.963+0000 7f958513b700 1 Processor -- start 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.963+0000 7f958513b700 1 -- start start 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f958513b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95800c62d0 0x7f958014cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f958513b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580153410 0x7f95801efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f958513b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9580159390 0x7f95801f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f958513b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95801578e0 con 0x7f9580159390 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f958513b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800c9100 con 0x7f95800c62d0 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f958513b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95801581c0 con 0x7f9580153410 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9580159390 0x7f95801f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9580159390 0x7f95801f0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33040/0 (socket says 172.21.15.135:33040) 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 -- 172.21.15.135:0/158540316 learned_addr learned my addr 172.21.15.135:0/158540316 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957e59c700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580153410 0x7f95801efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957ed9d700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95800c62d0 0x7f958014cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 -- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580153410 msgr2=0x7f95801efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580153410 0x7f95801efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 -- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95800c62d0 msgr2=0x7f958014cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95800c62d0 0x7f958014cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.964+0000 7f957f59e700 1 -- 172.21.15.135:0/158540316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700094a0 con 0x7f9580159390 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.965+0000 7f957f59e700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9580159390 0x7f95801f0190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9578007e60 tx=0x7f957800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.965+0000 7f95677fe700 1 -- 172.21.15.135:0/158540316 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800ed30 con 0x7f9580159390 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.965+0000 7f95677fe700 1 -- 172.21.15.135:0/158540316 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9578014420 con 0x7f9580159390 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.965+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95800c9f20 con 0x7f9580159390 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.965+0000 7f95677fe700 1 -- 172.21.15.135:0/158540316 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95780147d0 con 0x7f9580159390 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.965+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95800c95f0 con 0x7f9580159390 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.966+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95800ca0b0 con 0x7f9580159390 2024-05-08T20:55:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.966+0000 7f95677fe700 1 -- 172.21.15.135:0/158540316 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9578014930 con 0x7f9580159390 2024-05-08T20:55:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.966+0000 7f95677fe700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f956c06ac90 0x7f956c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.966+0000 7f95677fe700 1 -- 172.21.15.135:0/158540316 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9578089cc0 con 0x7f9580159390 2024-05-08T20:55:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.967+0000 7f957ed9d700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f956c06ac90 0x7f956c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.967+0000 7f957ed9d700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f956c06ac90 0x7f956c06d150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95740010e0 tx=0x7f9574009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:25.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:25.971+0000 7f95677fe700 1 -- 172.21.15.135:0/158540316 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9578054bd0 con 0x7f9580159390 2024-05-08T20:55:26.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.165+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9580067fa0 con 0x7f9580159390 2024-05-08T20:55:26.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.166+0000 7f95677fe700 1 -- 172.21.15.135:0/158540316 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f95780581f0 con 0x7f9580159390 2024-05-08T20:55:26.168 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:26.169 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:26.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f956c06ac90 msgr2=0x7f956c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f956c06ac90 0x7f956c06d150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95740010e0 tx=0x7f9574009040 comp rx=0 tx=0).stop 2024-05-08T20:55:26.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9580159390 msgr2=0x7f95801f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9580159390 0x7f95801f0190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9578007e60 tx=0x7f957800e3c0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 shutdown_connections 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f956c06ac90 0x7f956c06d150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95800c62d0 0x7f958014cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9580159390 0x7f95801f0190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 --2- 172.21.15.135:0/158540316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9580153410 0x7f95801efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 >> 172.21.15.135:0/158540316 conn(0x7f958006d3e0 msgr2=0x7f958006b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.168+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 shutdown_connections 2024-05-08T20:55:26.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.169+0000 7f958513b700 1 -- 172.21.15.135:0/158540316 wait complete. 2024-05-08T20:55:26.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T20:55:26.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T20:55:26.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T20:55:26.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T20:55:26.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T20:55:26.185 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T20:55:26.186 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T20:55:26.186 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T20:55:26.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f3bf85e7700 1 Processor -- start 2024-05-08T20:55:26.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.395+0000 7f54c93e0700 1 Processor -- start 2024-05-08T20:55:26.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f54c93e0700 1 -- start start 2024-05-08T20:55:26.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f3bf85e7700 1 -- start start 2024-05-08T20:55:26.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f54c93e0700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f54c40c5e50 0x7f54c4155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f54c93e0700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f54c40cac60 0x7f54c40cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f54c93e0700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c4156360 con 0x7f54c406b450 2024-05-08T20:55:26.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f54c93e0700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40c6c20 con 0x7f54c40cac60 2024-05-08T20:55:26.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.396+0000 7f54c93e0700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c40c6300 con 0x7f54c40c5e50 2024-05-08T20:55:26.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7fdebbaea700 1 Processor -- start 2024-05-08T20:55:26.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7fdebbaea700 1 -- start start 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7f3bf85e7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7f3bf85e7700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf0156360 con 0x7f3bf00c5e50 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7f3bf85e7700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00c6300 con 0x7f3bf014f560 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7f3bf85e7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00c6c20 con 0x7f3bf006b450 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7f3bf6383700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f3bf014f560 0x7f3bf00cac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.135:59624/0 (socket says 172.21.15.135:59624) 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7f3bf6383700 1 -- 172.21.15.135:0/4039420932 learned_addr learned my addr 172.21.15.135:0/4039420932 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.397+0000 7f3bf6b84700 1 --2- 172.21.15.135:0/4039420932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7f3bf6b84700 1 -- 172.21.15.135:0/4039420932 >> v1:172.21.15.183:6789/0 conn(0x7f3bf014f560 legacy=0x7f3bf00cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7f3bf6b84700 1 -- 172.21.15.135:0/4039420932 >> v1:172.21.15.135:6789/0 conn(0x7f3bf00c5e50 legacy=0x7f3bf00c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7f3bf6b84700 1 -- 172.21.15.135:0/4039420932 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00c65e0 con 0x7f3bf006b450 2024-05-08T20:55:26.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7f3bf6b84700 1 --2- 172.21.15.135:0/4039420932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0155e20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009dc0 tx=0x7f3be800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3133da82c1cee8a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7f54c37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f54c40cac60 0x7f54c40cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7f54c37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f54c40cac60 0x7f54c40cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33046/0 (socket says 172.21.15.135:33046) 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7f54c37fe700 1 -- 172.21.15.135:0/876218537 learned_addr learned my addr 172.21.15.135:0/876218537 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7fdebbaea700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdeb40c6630 0x7fdeb40c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7fdebbaea700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb40c2a80 con 0x7fdeb41512c0 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7fdebbaea700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb40c7530 con 0x7fdeb41570d0 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.398+0000 7fdebbaea700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb4157560 con 0x7fdeb40c6630 2024-05-08T20:55:26.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7fdeba087700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdeb40c6630 0x7fdeb40c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7fdeba087700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdeb40c6630 0x7fdeb40c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33050/0 (socket says 172.21.15.135:33050) 2024-05-08T20:55:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7fdeba087700 1 -- 172.21.15.135:0/4040503223 learned_addr learned my addr 172.21.15.135:0/4040503223 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7f54c37fe700 1 -- 172.21.15.135:0/876218537 >> v2:172.21.15.183:3300/0 conn(0x7f54c40c5e50 msgr2=0x7f54c4155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7f54c37fe700 1 --2- 172.21.15.135:0/876218537 >> v2:172.21.15.183:3300/0 conn(0x7f54c40c5e50 0x7f54c4155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7f54c37fe700 1 -- 172.21.15.135:0/876218537 >> v1:172.21.15.135:6789/0 conn(0x7f54c406b450 legacy=0x7f54c414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7f54c37fe700 1 -- 172.21.15.135:0/876218537 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40c65e0 con 0x7f54c40cac60 2024-05-08T20:55:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7fdeb8884700 1 -- 172.21.15.135:0/4040503223 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159583332 0 0) 0x7fdeb40c2a80 con 0x7fdeb41512c0 2024-05-08T20:55:26.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7fdeb8884700 1 -- 172.21.15.135:0/4040503223 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea00035b0 con 0x7fdeb41512c0 2024-05-08T20:55:26.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7f54c37fe700 1 --2- 172.21.15.135:0/876218537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c40cb090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f54c40cb850 tx=0x7f54b400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51884ca850a48ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7f92cdd68700 1 Processor -- start 2024-05-08T20:55:26.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.399+0000 7f92cdd68700 1 -- start start 2024-05-08T20:55:26.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7fdeba087700 1 -- 172.21.15.135:0/4040503223 >> v1:172.21.15.183:6789/0 conn(0x7fdeb41570d0 legacy=0x7fdeb40c79c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7fdeba087700 1 -- 172.21.15.135:0/4040503223 >> v1:172.21.15.135:6789/0 conn(0x7fdeb41512c0 legacy=0x7fdeb40c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7fdeba087700 1 -- 172.21.15.135:0/4040503223 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4157840 con 0x7fdeb40c6630 2024-05-08T20:55:26.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7f3bf5381700 1 -- 172.21.15.135:0/4039420932 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800e070 con 0x7f3bf006b450 2024-05-08T20:55:26.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7f3bf5381700 1 -- 172.21.15.135:0/4039420932 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be800bad0 con 0x7f3bf006b450 2024-05-08T20:55:26.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7f3bf5381700 1 -- 172.21.15.135:0/4039420932 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800be60 con 0x7f3bf006b450 2024-05-08T20:55:26.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7fdeba087700 1 --2- 172.21.15.135:0/4040503223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb40c6630 0x7fdeb40c6a80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009e50 tx=0x7fdeac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2450a98d4614d24e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7fdeb8884700 1 -- 172.21.15.135:0/4040503223 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00e070 con 0x7fdeb40c6630 2024-05-08T20:55:26.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7fdeb8884700 1 -- 172.21.15.135:0/4040503223 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac003a20 con 0x7fdeb40c6630 2024-05-08T20:55:26.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7fdeb8884700 1 -- 172.21.15.135:0/4040503223 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac003dd0 con 0x7fdeb40c6630 2024-05-08T20:55:26.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f3bf85e7700 1 -- 172.21.15.135:0/4039420932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 msgr2=0x7f3bf0155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f3bf85e7700 1 --2- 172.21.15.135:0/4039420932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0155e20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009dc0 tx=0x7f3be800b330 comp rx=0 tx=0).stop 2024-05-08T20:55:26.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7fdebbaea700 1 -- 172.21.15.135:0/4040503223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb40c6630 msgr2=0x7fdeb40c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7fdebbaea700 1 --2- 172.21.15.135:0/4040503223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb40c6630 0x7fdeb40c6a80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009e50 tx=0x7fdeac00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:26.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f3bf85e7700 1 -- 172.21.15.135:0/4039420932 shutdown_connections 2024-05-08T20:55:26.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f3bf85e7700 1 --2- 172.21.15.135:0/4039420932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0155e20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f3bf85e7700 1 -- 172.21.15.135:0/4039420932 >> 172.21.15.135:0/4039420932 conn(0x7f3bf006a960 msgr2=0x7f3bf006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7fdebbaea700 1 -- 172.21.15.135:0/4040503223 shutdown_connections 2024-05-08T20:55:26.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7fdebbaea700 1 --2- 172.21.15.135:0/4040503223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb40c6630 0x7fdeb40c6a80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7fdebbaea700 1 -- 172.21.15.135:0/4040503223 >> 172.21.15.135:0/4040503223 conn(0x7fdeb406a960 msgr2=0x7fdeb406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7fdebbaea700 1 -- 172.21.15.135:0/4040503223 shutdown_connections 2024-05-08T20:55:26.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7fdebbaea700 1 -- 172.21.15.135:0/4040503223 wait complete. 2024-05-08T20:55:26.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.404+0000 7fdebbaea700 1 Processor -- start 2024-05-08T20:55:26.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.404+0000 7f3c32e18700 1 Processor -- start 2024-05-08T20:55:26.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f3c32e18700 1 -- start start 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.404+0000 7fdebbaea700 1 -- start start 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7fdebbaea700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdeb40c6630 0x7fdeb41f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7fdebbaea700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdeb41512c0 0x7fdeb415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7fdebbaea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb41501b0 0x7fdeb4150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7fdebbaea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41f79b0 con 0x7fdeb41501b0 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7fdebbaea700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41543e0 con 0x7fdeb41512c0 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7fdebbaea700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41f3520 con 0x7fdeb40c6630 2024-05-08T20:55:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3bf85e7700 1 -- 172.21.15.135:0/4039420932 shutdown_connections 2024-05-08T20:55:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdeb40c6630 0x7fdeb41f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdeb40c6630 0x7fdeb41f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50212/0 (socket says 172.21.15.135:50212) 2024-05-08T20:55:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 -- 172.21.15.135:0/3458604059 learned_addr learned my addr 172.21.15.135:0/3458604059 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f54c1ffb700 1 -- 172.21.15.135:0/876218537 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400dcf0 con 0x7f54c40cac60 2024-05-08T20:55:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f54c1ffb700 1 -- 172.21.15.135:0/876218537 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b400de50 con 0x7f54c40cac60 2024-05-08T20:55:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f54c1ffb700 1 -- 172.21.15.135:0/876218537 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4004250 con 0x7f54c40cac60 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7f92cdd68700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f92c81535a0 0x7f92c80c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7f92cdd68700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f92c8159390 0x7f92c81597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.400+0000 7f92cdd68700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c806a960 con 0x7f92c806bc50 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92cdd68700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c806b7c0 con 0x7f92c8159390 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92cdd68700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c806e700 con 0x7f92c81535a0 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f92c81535a0 0x7f92c80c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f92c81535a0 0x7f92c80c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:46474/0 (socket says 172.21.15.135:46474) 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 -- 172.21.15.135:0/572716040 learned_addr learned my addr 172.21.15.135:0/572716040 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 -- 172.21.15.135:0/572716040 >> v2:172.21.15.135:3300/0 conn(0x7f92c8159390 msgr2=0x7f92c81597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 --2- 172.21.15.135:0/572716040 >> v2:172.21.15.135:3300/0 conn(0x7f92c8159390 0x7f92c81597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 -- 172.21.15.135:0/572716040 >> v1:172.21.15.135:6789/0 conn(0x7f92c806bc50 legacy=0x7f92c806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 -- 172.21.15.135:0/572716040 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c806abb0 con 0x7f92c81535a0 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c77fe700 1 --2- 172.21.15.135:0/572716040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c81535a0 0x7f92c80c63f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92c806c3d0 tx=0x7f92b8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6daaa4dc05ef3e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.401+0000 7f92c6ffd700 1 -- 172.21.15.135:0/572716040 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8004230 con 0x7f92c81535a0 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92c6ffd700 1 -- 172.21.15.135:0/572716040 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8004390 con 0x7f92c81535a0 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92c6ffd700 1 -- 172.21.15.135:0/572716040 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80036a0 con 0x7f92c81535a0 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92cdd68700 1 -- 172.21.15.135:0/572716040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c81535a0 msgr2=0x7f92c80c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92cdd68700 1 --2- 172.21.15.135:0/572716040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c81535a0 0x7f92c80c63f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92c806c3d0 tx=0x7f92b8009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92cdd68700 1 -- 172.21.15.135:0/572716040 shutdown_connections 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92cdd68700 1 --2- 172.21.15.135:0/572716040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c81535a0 0x7f92c80c63f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92cdd68700 1 --2- 172.21.15.135:0/572716040 >> v2:172.21.15.135:3300/0 conn(0x7f92c8159390 0x7f92c81597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.402+0000 7f92cdd68700 1 -- 172.21.15.135:0/572716040 >> 172.21.15.135:0/572716040 conn(0x7f92c80cb200 msgr2=0x7f92c80cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.403+0000 7f92cdd68700 1 -- 172.21.15.135:0/572716040 shutdown_connections 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.403+0000 7f92cdd68700 1 -- 172.21.15.135:0/572716040 wait complete. 2024-05-08T20:55:26.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.404+0000 7f92cdd68700 1 Processor -- start 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.404+0000 7f92cdd68700 1 -- start start 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92cdd68700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c806bc50 0x7f92c80c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92cdd68700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c81535a0 0x7f92c80c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92cdd68700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c8159390 0x7f92c82036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92cdd68700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81f2b40 con 0x7f92c806bc50 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92cdd68700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80c9000 con 0x7f92c8159390 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92cdd68700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81f1340 con 0x7f92c81535a0 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92beffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c81535a0 0x7f92c80c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92beffd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c81535a0 0x7f92c80c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50206/0 (socket says 172.21.15.135:50206) 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92beffd700 1 -- 172.21.15.135:0/3047822386 learned_addr learned my addr 172.21.15.135:0/3047822386 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92c77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c806bc50 0x7f92c80c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.405+0000 7f92c7fff700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c8159390 0x7f92c82036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92beffd700 1 -- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c8159390 msgr2=0x7f92c82036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92beffd700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c8159390 0x7f92c82036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92beffd700 1 -- 172.21.15.135:0/3047822386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c806bc50 msgr2=0x7f92c80c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92beffd700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92c806bc50 0x7f92c80c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92beffd700 1 -- 172.21.15.135:0/3047822386 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8009550 con 0x7f92c81535a0 2024-05-08T20:55:26.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3bf85e7700 1 -- 172.21.15.135:0/4039420932 wait complete. 2024-05-08T20:55:26.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeba087700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb41501b0 0x7fdeb4150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c32e18700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c1513c0 0x7f3c2c0c6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c32e18700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3c2c0c1430 0x7f3c2c1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c32e18700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2c15b190 con 0x7f3c2c0c1870 2024-05-08T20:55:26.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c32e18700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2c15b620 con 0x7f3c2c0c1430 2024-05-08T20:55:26.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c32e18700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c0c6f00 con 0x7f3c2c1513c0 2024-05-08T20:55:26.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92beffd700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c81535a0 0x7f92c80c9cb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c4a0 tx=0x7f92b000c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00054e0 con 0x7f92c81535a0 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0003680 con 0x7f92c81535a0 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003a30 con 0x7f92c81535a0 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 -- 172.21.15.135:0/3458604059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdeb41512c0 msgr2=0x7fdeb415a040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdeb41512c0 0x7fdeb415a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 -- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb41501b0 msgr2=0x7fdeb4150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdeb41501b0 0x7fdeb4150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7fdeb9886700 1 -- 172.21.15.135:0/3458604059 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac009b30 con 0x7fdeb40c6630 2024-05-08T20:55:26.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7fdeb9886700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdeb40c6630 0x7fdeb41f7470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c520 tx=0x7fdeb000c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f54c93e0700 1 -- 172.21.15.135:0/876218537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 msgr2=0x7f54c40cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f54c93e0700 1 --2- 172.21.15.135:0/876218537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c40cb090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f54c40cb850 tx=0x7f54b400be70 comp rx=0 tx=0).stop 2024-05-08T20:55:26.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f2061b5d700 1 Processor -- start 2024-05-08T20:55:26.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c81f22a0 con 0x7f92c81535a0 2024-05-08T20:55:26.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c81f2860 con 0x7f92c81535a0 2024-05-08T20:55:26.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92c806b450 con 0x7f92c81535a0 2024-05-08T20:55:26.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3bf85e7700 1 Processor -- start 2024-05-08T20:55:26.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f3bf85e7700 1 -- start start 2024-05-08T20:55:26.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f54c93e0700 1 -- 172.21.15.135:0/876218537 shutdown_connections 2024-05-08T20:55:26.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f54c93e0700 1 --2- 172.21.15.135:0/876218537 >> v2:172.21.15.183:3300/0 conn(0x7f54c40c5e50 0x7f54c4155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f54c93e0700 1 --2- 172.21.15.135:0/876218537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c40cb090 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f54c93e0700 1 -- 172.21.15.135:0/876218537 >> 172.21.15.135:0/876218537 conn(0x7f54c406a960 msgr2=0x7f54c406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00052d0 con 0x7fdeb40c6630 2024-05-08T20:55:26.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb0005430 con 0x7fdeb40c6630 2024-05-08T20:55:26.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00038c0 con 0x7fdeb40c6630 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f54c93e0700 1 -- 172.21.15.135:0/876218537 shutdown_connections 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f54c93e0700 1 -- 172.21.15.135:0/876218537 wait complete. 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f2061b5d700 1 -- start start 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f2061b5d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c14f560 0x7f205c155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f2061b5d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f205c0c5e50 0x7f205c0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f2061b5d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c156360 con 0x7f205c0cb1a0 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f2061b5d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205c0c6c20 con 0x7f205c0c5e50 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f2061b5d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c6300 con 0x7f205c14f560 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f205bfff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f205c0cb1a0 0x7f205c0c7910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59866/0 (socket says 172.21.15.135:59866) 2024-05-08T20:55:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f205bfff700 1 -- 172.21.15.135:0/3094609428 learned_addr learned my addr 172.21.15.135:0/3094609428 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597505276 0 0) 0x7f2054001490 con 0x7f205c0cb1a0 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20440035b0 con 0x7f205c0cb1a0 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757054634 0 0) 0x7f20440035b0 con 0x7f205c0cb1a0 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c14f560 msgr2=0x7f205c155e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c14f560 0x7f205c155e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 >> v2:172.21.15.135:3300/0 conn(0x7f205c0c5e50 msgr2=0x7f205c0cac60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 --2- 172.21.15.135:0/3094609428 >> v2:172.21.15.135:3300/0 conn(0x7f205c0c5e50 0x7f205c0cac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0c65e0 con 0x7f205c0cb1a0 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f2054001b80 con 0x7f205c0cb1a0 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 >> v1:172.21.15.135:6789/0 conn(0x7f205c0cb1a0 legacy=0x7f205c0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2044003a00 0x7f2044003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044004850 0x7f2044004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440052e0 0x7f204402da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c6c20 con 0x7f2044003a00 2024-05-08T20:55:26.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0c6300 con 0x7f2044004850 2024-05-08T20:55:26.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204402e200 con 0x7f20440052e0 2024-05-08T20:55:26.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f205bfff700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440052e0 0x7f204402da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7feaaa37d700 1 Processor -- start 2024-05-08T20:55:26.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f92b0003b90 con 0x7f92c81535a0 2024-05-08T20:55:26.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205b7fe700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2044003a00 0x7f2044003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205bfff700 1 -- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044004850 msgr2=0x7f2044004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:55:26.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205bfff700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2044004850 0x7f2044004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205bfff700 1 -- 172.21.15.135:0/3094609428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2044003a00 msgr2=0x7f2044003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205bfff700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2044003a00 0x7f2044003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205bfff700 1 -- 172.21.15.135:0/3094609428 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0c65e0 con 0x7f20440052e0 2024-05-08T20:55:26.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f54c93e0700 1 Processor -- start 2024-05-08T20:55:26.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f54c93e0700 1 -- start start 2024-05-08T20:55:26.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205bfff700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440052e0 0x7f204402da20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f20540098d0 tx=0x7f2044005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f3ae3e9e9dc791 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f92c4ff9700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f92a806ac90 0x7f92a806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92b00888b0 con 0x7f92c81535a0 2024-05-08T20:55:26.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f92c77fe700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f92a806ac90 0x7f92a806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054011070 con 0x7f20440052e0 2024-05-08T20:55:26.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205400e920 con 0x7f20440052e0 2024-05-08T20:55:26.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f205a7fc700 1 -- 172.21.15.135:0/3094609428 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054009560 con 0x7f20440052e0 2024-05-08T20:55:26.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f92c4ff9700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7f92a8074250 0x7f92a8076690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 --> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92a8076d60 con 0x7f92a8074250 2024-05-08T20:55:26.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b0088d00 con 0x7f92c81535a0 2024-05-08T20:55:26.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf85e7700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf85e7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf00c5e50 0x7f3bf0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf85e7700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bf014f560 0x7f3bf0149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf85e7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01248c0 con 0x7f3bf00c5e50 2024-05-08T20:55:26.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf85e7700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01f4030 con 0x7f3bf014f560 2024-05-08T20:55:26.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf85e7700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf014a3d0 con 0x7f3bf006b450 2024-05-08T20:55:26.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7feaaa37d700 1 -- start start 2024-05-08T20:55:26.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaaa37d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feaa4157cd0 0x7feaa4071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaaa37d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa40c6f40 0x7feaa40c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaaa37d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa40c7380 con 0x7feaa4160f90 2024-05-08T20:55:26.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaaa37d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa40725c0 con 0x7feaa4157cd0 2024-05-08T20:55:26.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaaa37d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c6120 con 0x7feaa40c6f40 2024-05-08T20:55:26.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaa37fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa40c6f40 0x7feaa40c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaa37fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa40c6f40 0x7feaa40c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50232/0 (socket says 172.21.15.135:50232) 2024-05-08T20:55:26.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7feaa37fe700 1 -- 172.21.15.135:0/1798744957 learned_addr learned my addr 172.21.15.135:0/1798744957 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf6383700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf5b82700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf00c5e50 0x7f3bf0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf5b82700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf00c5e50 0x7f3bf0151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33088/0 (socket says 172.21.15.135:33088) 2024-05-08T20:55:26.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf6383700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50234/0 (socket says 172.21.15.135:50234) 2024-05-08T20:55:26.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf5b82700 1 -- 172.21.15.135:0/1156216883 learned_addr learned my addr 172.21.15.135:0/1156216883 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f2061b5d700 1 -- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440052e0 msgr2=0x7f204402da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f2061b5d700 1 --2- 172.21.15.135:0/3094609428 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20440052e0 0x7f204402da20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f20540098d0 tx=0x7f2044005880 comp rx=0 tx=0).stop 2024-05-08T20:55:26.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7feaa3fff700 1 --2- 172.21.15.135:0/1798744957 >> v2:172.21.15.135:3300/0 conn(0x7feaa4157cd0 0x7feaa4071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f7b0a3da700 1 Processor -- start 2024-05-08T20:55:26.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f3bf6b84700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bf014f560 0x7f3bf0149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f7b0a3da700 1 -- start start 2024-05-08T20:55:26.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3bf6383700 1 -- 172.21.15.135:0/1156216883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bf014f560 msgr2=0x7f3bf0149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3bf6383700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bf014f560 0x7f3bf0149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3bf6383700 1 -- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf00c5e50 msgr2=0x7f3bf0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3bf6383700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf00c5e50 0x7f3bf0151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3bf6383700 1 -- 172.21.15.135:0/1156216883 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009a70 con 0x7f3bf006b450 2024-05-08T20:55:26.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c93e0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54c406b450 0x7f54c40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c93e0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c40c5e50 0x7f54c41ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c93e0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c41ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c93e0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c414fa10 con 0x7f54c40cac60 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c93e0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c41e2380 con 0x7f54c40c5e50 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c93e0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c41ea9a0 con 0x7f54c406b450 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c41ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c37fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c41ec2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33090/0 (socket says 172.21.15.135:33090) 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.411+0000 7f54c37fe700 1 -- 172.21.15.135:0/1350908542 learned_addr learned my addr 172.21.15.135:0/1350908542 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c27fc700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c40c5e50 0x7f54c41ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c2ffd700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54c406b450 0x7f54c40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c37fe700 1 -- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54c406b450 msgr2=0x7f54c40c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f205bfff700 1 -- 172.21.15.135:0/3094609428 reap_dead start 2024-05-08T20:55:26.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f92c7fff700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7f92a8074250 0x7f92a8076690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f2061b5d700 1 -- 172.21.15.135:0/3094609428 shutdown_connections 2024-05-08T20:55:26.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f2061b5d700 1 -- 172.21.15.135:0/3094609428 >> 172.21.15.135:0/3094609428 conn(0x7f205c06a960 msgr2=0x7f205c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c37fe700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54c406b450 0x7f54c40c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c37fe700 1 -- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c40c5e50 msgr2=0x7f54c41ebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c37fe700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c40c5e50 0x7f54c41ebd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c37fe700 1 -- 172.21.15.135:0/1350908542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b400b7f0 con 0x7f54c40cac60 2024-05-08T20:55:26.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c2ffd700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54c406b450 0x7f54c40c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:26.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7feaa37fe700 1 -- 172.21.15.135:0/1798744957 >> v2:172.21.15.135:3300/0 conn(0x7feaa4157cd0 msgr2=0x7feaa4071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7feaa37fe700 1 --2- 172.21.15.135:0/1798744957 >> v2:172.21.15.135:3300/0 conn(0x7feaa4157cd0 0x7feaa4071250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7feaa37fe700 1 -- 172.21.15.135:0/1798744957 >> v1:172.21.15.183:6789/0 conn(0x7feaa4160f90 legacy=0x7feaa4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7feaa37fe700 1 -- 172.21.15.135:0/1798744957 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40c1a60 con 0x7feaa40c6f40 2024-05-08T20:55:26.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c27fc700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c40c5e50 0x7f54c41ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:26.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f54c37fe700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c41ec2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f54b400beb0 tx=0x7f54b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7feaa37fe700 1 --2- 172.21.15.135:0/1798744957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa40c6f40 0x7feaa40c5be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea940098f0 tx=0x7fea94009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce658dbfa0e75c0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f92c7fff700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7f92a8074250 0x7f92a8076690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f92c77fe700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f92a806ac90 0x7f92a806d150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009130 tx=0x7f92b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7feaa2ffd700 1 -- 172.21.15.135:0/1798744957 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400b8a0 con 0x7feaa40c6f40 2024-05-08T20:55:26.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7feaa2ffd700 1 -- 172.21.15.135:0/1798744957 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9400ba00 con 0x7feaa40c6f40 2024-05-08T20:55:26.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7feaa2ffd700 1 -- 172.21.15.135:0/1798744957 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9400bd90 con 0x7feaa40c6f40 2024-05-08T20:55:26.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f54ab7fe700 1 -- 172.21.15.135:0/1350908542 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010670 con 0x7f54c40cac60 2024-05-08T20:55:26.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f3bf6383700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0151770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c520 tx=0x7f3be000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f54ab7fe700 1 -- 172.21.15.135:0/1350908542 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4004240 con 0x7f54c40cac60 2024-05-08T20:55:26.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c41eac40 con 0x7f54c40cac60 2024-05-08T20:55:26.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f2061b5d700 1 -- 172.21.15.135:0/3094609428 shutdown_connections 2024-05-08T20:55:26.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0004c80 con 0x7f3bf006b450 2024-05-08T20:55:26.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f2061b5d700 1 -- 172.21.15.135:0/3094609428 wait complete. 2024-05-08T20:55:26.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0004e00 con 0x7f3bf006b450 2024-05-08T20:55:26.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0007310 con 0x7f3bf006b450 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== osd.7 v2:172.21.15.183:6808/47309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f92a8076d60 con 0x7f92a8074250 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c30bb4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c1513c0 0x7f3c2c0c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c313b5700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f3c2c0c1870 0x7f3c2c0cabb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59864/0 (socket says 172.21.15.135:59864) 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c313b5700 1 -- 172.21.15.135:0/3745193841 learned_addr learned my addr 172.21.15.135:0/3745193841 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c2bfff700 1 --2- 172.21.15.135:0/3745193841 >> v2:172.21.15.183:3300/0 conn(0x7f3c2c0c1430 0x7f3c2c1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c2b7fe700 1 -- 172.21.15.135:0/3745193841 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364782004 0 0) 0x7f3c2c15b190 con 0x7f3c2c0c1870 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.406+0000 7f3c2b7fe700 1 -- 172.21.15.135:0/3745193841 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c1c0035b0 con 0x7f3c2c0c1870 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c30bb4700 1 -- 172.21.15.135:0/3745193841 >> v2:172.21.15.183:3300/0 conn(0x7f3c2c0c1430 msgr2=0x7f3c2c1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c30bb4700 1 --2- 172.21.15.135:0/3745193841 >> v2:172.21.15.183:3300/0 conn(0x7f3c2c0c1430 0x7f3c2c1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c30bb4700 1 -- 172.21.15.135:0/3745193841 >> v1:172.21.15.135:6789/0 conn(0x7f3c2c0c1870 legacy=0x7f3c2c0cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c30bb4700 1 -- 172.21.15.135:0/3745193841 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c15a860 con 0x7f3c2c1513c0 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c30bb4700 1 --2- 172.21.15.135:0/3745193841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c1513c0 0x7f3c2c0c6650 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009840 tx=0x7f3c20009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8173996192e98b03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c2b7fe700 1 -- 172.21.15.135:0/3745193841 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20011830 con 0x7f3c2c1513c0 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c2b7fe700 1 -- 172.21.15.135:0/3745193841 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c20011990 con 0x7f3c2c1513c0 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.407+0000 7f3c2b7fe700 1 -- 172.21.15.135:0/3745193841 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20011d20 con 0x7f3c2c1513c0 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f3c32e18700 1 -- 172.21.15.135:0/3745193841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c1513c0 msgr2=0x7f3c2c0c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f3c32e18700 1 --2- 172.21.15.135:0/3745193841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c1513c0 0x7f3c2c0c6650 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009840 tx=0x7f3c20009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f3c32e18700 1 -- 172.21.15.135:0/3745193841 shutdown_connections 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f3c32e18700 1 --2- 172.21.15.135:0/3745193841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c1513c0 0x7f3c2c0c6650 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f3c32e18700 1 --2- 172.21.15.135:0/3745193841 >> v2:172.21.15.183:3300/0 conn(0x7f3c2c0c1430 0x7f3c2c1570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.408+0000 7f3c32e18700 1 -- 172.21.15.135:0/3745193841 >> 172.21.15.135:0/3745193841 conn(0x7f3c2c06a960 msgr2=0x7f3c2c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f3c32e18700 1 -- 172.21.15.135:0/3745193841 shutdown_connections 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.409+0000 7f3c32e18700 1 -- 172.21.15.135:0/3745193841 wait complete. 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f3c32e18700 1 Processor -- start 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.410+0000 7f3c32e18700 1 -- start start 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c32e18700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c2c0c1430 0x7f3c2c203ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c32e18700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c0c1870 0x7f3c2c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c32e18700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c2c1513c0 0x7f3c2c089520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c32e18700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1617d0 con 0x7f3c2c1513c0 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c32e18700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c161210 con 0x7f3c2c0c1430 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c32e18700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1614f0 con 0x7f3c2c0c1870 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c2c1513c0 0x7f3c2c089520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c2c1513c0 0x7f3c2c089520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33104/0 (socket says 172.21.15.135:33104) 2024-05-08T20:55:26.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 -- 172.21.15.135:0/3435974918 learned_addr learned my addr 172.21.15.135:0/3435974918 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c2bfff700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c0c1870 0x7f3c2c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 -- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c0c1870 msgr2=0x7f3c2c14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3c2c0c1870 0x7f3c2c14f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 -- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c2c0c1430 msgr2=0x7f3c2c203ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3c2c0c1430 0x7f3c2c203ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.412+0000 7f3c313b5700 1 -- 172.21.15.135:0/3435974918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200094a0 con 0x7f3c2c1513c0 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f3c313b5700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c2c1513c0 0x7f3c2c089520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400cae0 tx=0x7f3c2400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7feaaa37d700 1 -- 172.21.15.135:0/1798744957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa40c6f40 msgr2=0x7feaa40c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7feaaa37d700 1 --2- 172.21.15.135:0/1798744957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa40c6f40 0x7feaa40c5be0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea940098f0 tx=0x7fea94009c00 comp rx=0 tx=0).stop 2024-05-08T20:55:26.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f54ab7fe700 1 -- 172.21.15.135:0/1350908542 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b40109f0 con 0x7f54c40cac60 2024-05-08T20:55:26.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c41eb200 con 0x7f54c40cac60 2024-05-08T20:55:26.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400aac0 con 0x7f3c2c1513c0 2024-05-08T20:55:26.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2400ac20 con 0x7f3c2c1513c0 2024-05-08T20:55:26.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24012400 con 0x7f3c2c1513c0 2024-05-08T20:55:26.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb4154680 con 0x7fdeb40c6630 2024-05-08T20:55:26.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb41f37e0 con 0x7fdeb40c6630 2024-05-08T20:55:26.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdeb40c6b10 con 0x7fdeb40c6630 2024-05-08T20:55:26.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf014a690 con 0x7f3bf006b450 2024-05-08T20:55:26.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf00c4720 con 0x7f3bf006b450 2024-05-08T20:55:26.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f7b0a3da700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b040c7320 0x7f7b04161a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f7b0a3da700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b04157080 con 0x7f7b04150320 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f7b0a3da700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b041597e0 con 0x7f7b04156b40 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f7b0a3da700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0415a460 con 0x7f7b040c7320 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f7b03fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7b04150320 0x7f7b040c4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59870/0 (socket says 172.21.15.135:59870) 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f7b03fff700 1 -- 172.21.15.135:0/1351557878 learned_addr learned my addr 172.21.15.135:0/1351557878 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.413+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434510511 0 0) 0x7f7b04157080 con 0x7f7b04150320 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.414+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aec00bdc0 con 0x7f7b04150320 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 125142119 0 0) 0x7f7aec00bdc0 con 0x7f7b04150320 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b040c7320 msgr2=0x7f7b04161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b08977700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b040c7320 0x7f7b04161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b040c7320 0x7f7b04161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 >> v1:172.21.15.183:6789/0 conn(0x7f7b04156b40 legacy=0x7f7b040c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04159ac0 con 0x7f7b04150320 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f7afc0019f0 con 0x7f7b04150320 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 >> v1:172.21.15.135:6789/0 conn(0x7f7b04150320 legacy=0x7f7b040c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00c240 0x7f7aec00c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aec00d060 0x7f7aec00d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec00db40 0x7f7aec014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0415a460 con 0x7f7aec00d060 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0149a0 con 0x7f7aec00c240 2024-05-08T20:55:26.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec014b60 con 0x7f7aec00db40 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c15b9b0 con 0x7f3c2c1513c0 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.416+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c14fda0 con 0x7f3c2c1513c0 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b03fff700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00c240 0x7f7aec00c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b037fe700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aec00d060 0x7f7aec00d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b08977700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec00db40 0x7f7aec014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b037fe700 1 -- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec00db40 msgr2=0x7f7aec014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b037fe700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec00db40 0x7f7aec014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b037fe700 1 -- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00c240 msgr2=0x7f7aec00c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b037fe700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00c240 0x7f7aec00c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f7b037fe700 1 -- 172.21.15.135:0/1351557878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04159ac0 con 0x7f7aec00d060 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.416+0000 7f7b08977700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7aec00db40 0x7f7aec014220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.416+0000 7f7b037fe700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aec00d060 0x7f7aec00d4e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7af8007fd0 tx=0x7f7aec00e090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e4ec3a7b108a38 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f54ab7fe700 1 -- 172.21.15.135:0/1350908542 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f54b4010b50 con 0x7f54c40cac60 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.416+0000 7f54ab7fe700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f54ac06aea0 0x7f54ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.416+0000 7f54c2ffd700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f54ac06aea0 0x7f54ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f54c2ffd700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f54ac06aea0 0x7f54ac06d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54bc007eb0 tx=0x7f54bc0073c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdeb0003a20 con 0x7fdeb40c6630 2024-05-08T20:55:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f54ab7fe700 1 -- 172.21.15.135:0/1350908542 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54b400dc70 con 0x7f54c40cac60 2024-05-08T20:55:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8016070 con 0x7f7aec00d060 2024-05-08T20:55:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8006860 con 0x7f7aec00d060 2024-05-08T20:55:26.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f7b02ffd700 1 -- 172.21.15.135:0/1351557878 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8003970 con 0x7f7aec00d060 2024-05-08T20:55:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3be0007470 con 0x7f3bf006b450 2024-05-08T20:55:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3bd8000fc0 con 0x7f3bf006b450 2024-05-08T20:55:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7feaaa37d700 1 -- 172.21.15.135:0/1798744957 shutdown_connections 2024-05-08T20:55:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7feaaa37d700 1 --2- 172.21.15.135:0/1798744957 >> v2:172.21.15.135:3300/0 conn(0x7feaa4157cd0 0x7feaa4071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7feaaa37d700 1 --2- 172.21.15.135:0/1798744957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa40c6f40 0x7feaa40c5be0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7feaaa37d700 1 -- 172.21.15.135:0/1798744957 >> 172.21.15.135:0/1798744957 conn(0x7feaa40c7920 msgr2=0x7feaa40c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7f54c93e0700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7f54a40015e0 0x7f54a4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 --> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54a4006bd0 con 0x7f54a40015e0 2024-05-08T20:55:26.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7fdeaa7fc700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fde9806ac90 0x7fde9806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdeb0089390 con 0x7fdeb40c6630 2024-05-08T20:55:26.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7fdeb9085700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fde9806ac90 0x7fde9806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7fdeaa7fc700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7fde98074250 0x7fde98076690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 --> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde98076d60 con 0x7fde98074250 2024-05-08T20:55:26.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.417+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdeb0089700 con 0x7fdeb40c6630 2024-05-08T20:55:26.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7fdeba087700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7fde98074250 0x7fde98076690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c2c1517a0 con 0x7f3c2c1513c0 2024-05-08T20:55:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3be6ffd700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3bd406ac90 0x7f3bd406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3be00892e0 con 0x7f3bf006b450 2024-05-08T20:55:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3be6ffd700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f3bd40741d0 0x7f3bd4076610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 --> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3bd4076ce0 con 0x7f3bd40741d0 2024-05-08T20:55:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3bf6b84700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f3bd40741d0 0x7f3bd4076610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3bf5b82700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3bd406ac90 0x7f3bd406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3bf6b84700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f3bd40741d0 0x7f3bd4076610 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.415+0000 7f2061b5d700 1 Processor -- start 2024-05-08T20:55:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.419+0000 7f2061b5d700 1 -- start start 2024-05-08T20:55:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.419+0000 7f54c27fc700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7f54a40015e0 0x7f54a4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c2401b3b0 con 0x7f3c2c1513c0 2024-05-08T20:55:26.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3c297fa700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3c1006ad60 0x7f3c1006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== osd.0 v2:172.21.15.135:6824/47109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3bd4076ce0 con 0x7f3bd40741d0 2024-05-08T20:55:26.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7fdeba087700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7fde98074250 0x7fde98076690 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7fdeb9085700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fde9806ac90 0x7fde9806d150 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40c7e10 tx=0x7fdea4006c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f2061b5d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20440052e0 0x7f205c1ea890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f2061b5d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c071fd0 0x7f205c1dc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f2061b5d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205c072410 0x7f205c1dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f2061b5d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c1dcf30 con 0x7f20440052e0 2024-05-08T20:55:26.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f2061b5d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c1509f0 con 0x7f205c072410 2024-05-08T20:55:26.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f2061b5d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c14fe70 con 0x7f205c071fd0 2024-05-08T20:55:26.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f54c27fc700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7f54a40015e0 0x7f54a4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f205affd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c071fd0 0x7f205c1dc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f205affd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c071fd0 0x7f205c1dc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50294/0 (socket says 172.21.15.135:50294) 2024-05-08T20:55:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7f205affd700 1 -- 172.21.15.135:0/4009104809 learned_addr learned my addr 172.21.15.135:0/4009104809 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.420+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== osd.1 v2:172.21.15.135:6808/47107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fde98076d60 con 0x7fde98074250 2024-05-08T20:55:26.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f205affd700 1 -- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205c072410 msgr2=0x7f205c1dc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f205affd700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f205c072410 0x7f205c1dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f205affd700 1 -- 172.21.15.135:0/4009104809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20440052e0 msgr2=0x7f205c1ea890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f205affd700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20440052e0 0x7f205c1ea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f205affd700 1 -- 172.21.15.135:0/4009104809 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c150150 con 0x7f205c071fd0 2024-05-08T20:55:26.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f3c30bb4700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3c1006ad60 0x7f3c1006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f3bf5b82700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3bd406ac90 0x7f3bd406d150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00c2a70 tx=0x7f3bec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.418+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c24089420 con 0x7f3c2c1513c0 2024-05-08T20:55:26.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f54ab7fe700 1 -- 172.21.15.135:0/1350908542 <== osd.3 v2:172.21.15.135:6800/47105 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f54a4006bd0 con 0x7f54a40015e0 2024-05-08T20:55:26.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f3c297fa700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f3c10074320 0x7f3c10076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 --> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c10076e30 con 0x7f3c10074320 2024-05-08T20:55:26.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f205affd700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c071fd0 0x7f205c1dc4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f204c00b480 tx=0x7f204c00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f3c2bfff700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f3c10074320 0x7f3c10076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c011830 con 0x7f205c071fd0 2024-05-08T20:55:26.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c011990 con 0x7f205c071fd0 2024-05-08T20:55:26.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.421+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c011d40 con 0x7f205c071fd0 2024-05-08T20:55:26.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.422+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c150430 con 0x7f205c071fd0 2024-05-08T20:55:26.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.422+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c1dbfb0 con 0x7f205c071fd0 2024-05-08T20:55:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.423+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f205c0c73f0 con 0x7f205c071fd0 2024-05-08T20:55:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.423+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3be0001250 con 0x7f3bf006b450 2024-05-08T20:55:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.424+0000 7f7b0a3da700 1 -- 172.21.15.135:0/1351557878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aec00d060 msgr2=0x7f7aec00d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.424+0000 7f7b0a3da700 1 --2- 172.21.15.135:0/1351557878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7aec00d060 0x7f7aec00d4e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7af8007fd0 tx=0x7f7aec00e090 comp rx=0 tx=0).stop 2024-05-08T20:55:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.424+0000 7f7b08977700 1 -- 172.21.15.135:0/1351557878 reap_dead start 2024-05-08T20:55:26.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.425+0000 7f7b0a3da700 1 -- 172.21.15.135:0/1351557878 shutdown_connections 2024-05-08T20:55:26.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.425+0000 7f7b0a3da700 1 -- 172.21.15.135:0/1351557878 >> 172.21.15.135:0/1351557878 conn(0x7f7b040cb200 msgr2=0x7f7b040cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.425+0000 7f7b0a3da700 1 -- 172.21.15.135:0/1351557878 shutdown_connections 2024-05-08T20:55:26.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.426+0000 7feaaa37d700 1 -- 172.21.15.135:0/1798744957 shutdown_connections 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.425+0000 7f7b0a3da700 1 -- 172.21.15.135:0/1351557878 wait complete. 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.427+0000 7f7b0a3da700 1 Processor -- start 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.427+0000 7f7b0a3da700 1 -- start start 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b0a3da700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00d060 0x7f7b04157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b0a3da700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04157dd0 0x7f7b04150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b0a3da700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b0414f6a0 0x7f7b04151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b0a3da700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04153b00 con 0x7f7b04157dd0 2024-05-08T20:55:26.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b0a3da700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04158530 con 0x7f7aec00d060 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b0a3da700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041fc3f0 con 0x7f7b0414f6a0 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b037fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04157dd0 0x7f7b04150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00d060 0x7f7b04157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b037fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04157dd0 0x7f7b04150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33136/0 (socket says 172.21.15.135:33136) 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.428+0000 7f7b03fff700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00d060 0x7f7b04157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:46554/0 (socket says 172.21.15.135:46554) 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.429+0000 7f7b037fe700 1 -- 172.21.15.135:0/677256620 learned_addr learned my addr 172.21.15.135:0/677256620 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.429+0000 7f7b037fe700 1 -- 172.21.15.135:0/677256620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b0414f6a0 msgr2=0x7f7b04151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.429+0000 7f7b037fe700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b0414f6a0 0x7f7b04151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.429+0000 7f7b037fe700 1 -- 172.21.15.135:0/677256620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00d060 msgr2=0x7f7b04157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.429+0000 7f7b037fe700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aec00d060 0x7f7b04157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.429+0000 7f7b037fe700 1 -- 172.21.15.135:0/677256620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04150a50 con 0x7f7b04157dd0 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.429+0000 7f7b037fe700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04157dd0 0x7f7b04150f30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7af8004490 tx=0x7f7af8003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8016040 con 0x7f7b04157dd0 2024-05-08T20:55:26.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af8025660 con 0x7f7b04157dd0 2024-05-08T20:55:26.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af80259f0 con 0x7f7b04157dd0 2024-05-08T20:55:26.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b04158250 con 0x7f7b04157dd0 2024-05-08T20:55:26.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b041fc8b0 con 0x7f7b04157dd0 2024-05-08T20:55:26.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f3c2bfff700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f3c10074320 0x7f3c10076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c24054260 con 0x7f3c2c1513c0 2024-05-08T20:55:26.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.430+0000 7f3c30bb4700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3c1006ad60 0x7f3c1006d220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3c20014040 tx=0x7f3c20008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.431+0000 7feaaa37d700 1 -- 172.21.15.135:0/1798744957 wait complete. 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.432+0000 7feaaa37d700 1 Processor -- start 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.432+0000 7feaaa37d700 1 -- start start 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaaa37d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa40c6f40 0x7feaa41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaaa37d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa4157cd0 0x7feaa415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaaa37d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4160f90 0x7feaa41468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaaa37d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c2ac0 con 0x7feaa40c6f40 2024-05-08T20:55:26.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaaa37d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415b4e0 con 0x7feaa4160f90 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaaa37d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415dd50 con 0x7feaa4157cd0 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaa37fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa4157cd0 0x7feaa415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.432+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7af801c420 con 0x7f7b04157dd0 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b0415a080 con 0x7f7b04157dd0 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7f7b00ff9700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7af006acc0 0x7f7af006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7af808a610 con 0x7f7b04157dd0 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7f7b00ff9700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7f7af0074200 0x7f7af0076640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 --> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7af0076d10 con 0x7f7af0074200 2024-05-08T20:55:26.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7f7b08977700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7f7af0074200 0x7f7af0076640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7f7b03fff700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7af006acc0 0x7f7af006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7f7b08977700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7f7af0074200 0x7f7af0076640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f204c023430 con 0x7f205c071fd0 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7f2043fff700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f204806ac50 0x7f204806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f204c089870 con 0x7f205c071fd0 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7f2043fff700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f2048074290 0x7f20480766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 --> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2048076da0 con 0x7f2048074290 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f204c089c20 con 0x7f205c071fd0 2024-05-08T20:55:26.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.436+0000 7f205b7fe700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f204806ac50 0x7f204806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.433+0000 7feaa891a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4160f90 0x7feaa41468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa4157cd0 0x7feaa415e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50312/0 (socket says 172.21.15.135:50312) 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 -- 172.21.15.135:0/3154691373 learned_addr learned my addr 172.21.15.135:0/3154691373 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 -- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4160f90 msgr2=0x7feaa41468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaa4160f90 0x7feaa41468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 -- 172.21.15.135:0/3154691373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa40c6f40 msgr2=0x7feaa41588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa40c6f40 0x7feaa41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 -- 172.21.15.135:0/3154691373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea94009550 con 0x7feaa4157cd0 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa37fe700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa4157cd0 0x7feaa415e1e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fea94000c00 tx=0x7fea94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.434+0000 7feaa0ff9700 1 -- 172.21.15.135:0/3154691373 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940045d0 con 0x7feaa4157cd0 2024-05-08T20:55:26.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7feaa0ff9700 1 -- 172.21.15.135:0/3154691373 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9401e070 con 0x7feaa4157cd0 2024-05-08T20:55:26.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7feaa0ff9700 1 -- 172.21.15.135:0/3154691373 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea940038a0 con 0x7feaa4157cd0 2024-05-08T20:55:26.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa415b220 con 0x7feaa4157cd0 2024-05-08T20:55:26.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.435+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa415d700 con 0x7feaa4157cd0 2024-05-08T20:55:26.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.437+0000 7f7b03fff700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7af006acc0 0x7f7af006d180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7afc001370 tx=0x7f7afc006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.437+0000 7feaa0ff9700 1 -- 172.21.15.135:0/3154691373 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea94003a00 con 0x7feaa4157cd0 2024-05-08T20:55:26.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.437+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== osd.2 v2:172.21.15.135:6813/47110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7af0076d10 con 0x7f7af0074200 2024-05-08T20:55:26.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.437+0000 7f205b7fe700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f204806ac50 0x7f204806d110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2050006fd0 tx=0x7f2050008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.437+0000 7feaa0ff9700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fea8c06ae20 0x7fea8c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.437+0000 7feaa0ff9700 1 -- 172.21.15.135:0/3154691373 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea94020070 con 0x7feaa4157cd0 2024-05-08T20:55:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.438+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7af8055590 con 0x7f7b04157dd0 2024-05-08T20:55:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.438+0000 7f205bfff700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f2048074290 0x7f20480766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.438+0000 7feaaa37d700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7fea800015e0 0x7fea80003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.438+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 --> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea80006bd0 con 0x7fea800015e0 2024-05-08T20:55:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.438+0000 7feaa3fff700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fea8c06ae20 0x7fea8c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.438+0000 7feaa891a700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7fea800015e0 0x7fea80003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.436+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== osd.5 v2:172.21.15.183:6824/47320 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3c10076e30 con 0x7f3c10074320 2024-05-08T20:55:26.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.439+0000 7f205bfff700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f2048074290 0x7f20480766d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.439+0000 7feaa891a700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7fea800015e0 0x7fea80003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.439+0000 7feaa3fff700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fea8c06ae20 0x7fea8c06d2e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0070b0 tx=0x7fea9c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.439+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== osd.4 v2:172.21.15.183:6800/47308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2048076da0 con 0x7f2048074290 2024-05-08T20:55:26.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.439+0000 7feaa0ff9700 1 -- 172.21.15.135:0/3154691373 <== osd.6 v2:172.21.15.183:6816/47323 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fea80006bd0 con 0x7fea800015e0 2024-05-08T20:55:26.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.440+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 --> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f92c806b170 con 0x7f92a8074250 2024-05-08T20:55:26.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.441+0000 7f92c4ff9700 1 -- 172.21.15.135:0/3047822386 <== osd.7 v2:172.21.15.183:6808/47309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f92c0009bb0 con 0x7f92a8074250 2024-05-08T20:55:26.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.441+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 --> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54a4005cb0 con 0x7f54a40015e0 2024-05-08T20:55:26.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.442+0000 7f54ab7fe700 1 -- 172.21.15.135:0/1350908542 <== osd.3 v2:172.21.15.135:6800/47105 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f54a4005cb0 con 0x7f54a40015e0 2024-05-08T20:55:26.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.442+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7f54a40015e0 msgr2=0x7f54a4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.442+0000 7f54c93e0700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7f54a40015e0 0x7f54a4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.443+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f54ac06aea0 msgr2=0x7f54ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.443+0000 7f54c93e0700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f54ac06aea0 0x7f54ac06d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54bc007eb0 tx=0x7f54bc0073c0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.443+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 msgr2=0x7f54c41ec2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.443+0000 7f54c93e0700 1 --2- 172.21.15.135:0/1350908542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c40cac60 0x7f54c41ec2b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f54b400beb0 tx=0x7f54b4004750 comp rx=0 tx=0).stop 2024-05-08T20:55:26.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.444+0000 7f54c37fe700 1 -- 172.21.15.135:0/1350908542 reap_dead start 2024-05-08T20:55:26.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.444+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 --> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3bd8002d00 con 0x7f3bd40741d0 2024-05-08T20:55:26.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f3be6ffd700 1 -- 172.21.15.135:0/1156216883 <== osd.0 v2:172.21.15.135:6824/47109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3bd8002d00 con 0x7f3bd40741d0 2024-05-08T20:55:26.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7f92a8074250 msgr2=0x7f92a8076690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f92cdd68700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7f92a8074250 0x7f92a8076690 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f92a806ac90 msgr2=0x7f92a806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f92cdd68700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f92a806ac90 0x7f92a806d150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009130 tx=0x7f92b8008030 comp rx=0 tx=0).stop 2024-05-08T20:55:26.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c81535a0 msgr2=0x7f92c80c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f92cdd68700 1 --2- 172.21.15.135:0/3047822386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c81535a0 0x7f92c80c9cb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c4a0 tx=0x7f92b000c7b0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.445+0000 7f92c7fff700 1 -- 172.21.15.135:0/3047822386 reap_dead start 2024-05-08T20:55:26.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.447+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 shutdown_connections 2024-05-08T20:55:26.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.447+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 >> 172.21.15.135:0/3047822386 conn(0x7f92c80cb200 msgr2=0x7f92c80c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.447+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 shutdown_connections 2024-05-08T20:55:26.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.447+0000 7f92cdd68700 1 -- 172.21.15.135:0/3047822386 wait complete. 2024-05-08T20:55:26.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.454+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 --> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdeb40c80d0 con 0x7fde98074250 2024-05-08T20:55:26.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.456+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 shutdown_connections 2024-05-08T20:55:26.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.456+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 >> 172.21.15.135:0/1350908542 conn(0x7f54c406a960 msgr2=0x7f54c40c8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.457+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 --> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f205c0c7110 con 0x7f2048074290 2024-05-08T20:55:26.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.458+0000 7f2043fff700 1 -- 172.21.15.135:0/4009104809 <== osd.4 v2:172.21.15.183:6800/47308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2054009480 con 0x7f2048074290 2024-05-08T20:55:26.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.458+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f2048074290 msgr2=0x7f20480766d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.458+0000 7f2061b5d700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f2048074290 0x7f20480766d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.486 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:26.486 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T20:55:26.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.459+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f3bd40741d0 msgr2=0x7f3bd4076610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.459+0000 7f3bf85e7700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f3bd40741d0 0x7f3bd4076610 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.459+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3bd406ac90 msgr2=0x7f3bd406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.459+0000 7f3bf85e7700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3bd406ac90 0x7f3bd406d150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00c2a70 tx=0x7f3bec009040 comp rx=0 tx=0).stop 2024-05-08T20:55:26.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.459+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 msgr2=0x7f3bf0151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.459+0000 7f3bf85e7700 1 --2- 172.21.15.135:0/1156216883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bf006b450 0x7f3bf0151770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3be000c520 tx=0x7f3be000c830 comp rx=0 tx=0).stop 2024-05-08T20:55:26.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.459+0000 7f3bf6b84700 1 -- 172.21.15.135:0/1156216883 reap_dead start 2024-05-08T20:55:26.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdeaa7fc700 1 -- 172.21.15.135:0/3458604059 <== osd.1 v2:172.21.15.135:6808/47107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdeac003cb0 con 0x7fde98074250 2024-05-08T20:55:26.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 shutdown_connections 2024-05-08T20:55:26.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f204806ac50 msgr2=0x7f204806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f204806ac50 0x7f204806d110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2050006fd0 tx=0x7f2050008040 comp rx=0 tx=0).stop 2024-05-08T20:55:26.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c071fd0 msgr2=0x7f205c1dc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 --2- 172.21.15.135:0/4009104809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f205c071fd0 0x7f205c1dc4b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f204c00b480 tx=0x7f204c00b840 comp rx=0 tx=0).stop 2024-05-08T20:55:26.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f205bfff700 1 -- 172.21.15.135:0/4009104809 reap_dead start 2024-05-08T20:55:26.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 shutdown_connections 2024-05-08T20:55:26.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 >> 172.21.15.135:0/4009104809 conn(0x7f205c06a960 msgr2=0x7f205c0c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7fde98074250 msgr2=0x7fde98076690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7fde98074250 0x7fde98076690 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fde9806ac90 msgr2=0x7fde9806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fde9806ac90 0x7fde9806d150 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40c7e10 tx=0x7fdea4006c60 comp rx=0 tx=0).stop 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdeb40c6630 msgr2=0x7fdeb41f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 --2- 172.21.15.135:0/3458604059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdeb40c6630 0x7fdeb41f7470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c520 tx=0x7fdeb000c8e0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdeba087700 1 -- 172.21.15.135:0/3458604059 reap_dead start 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 shutdown_connections 2024-05-08T20:55:26.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 >> 172.21.15.135:0/3458604059 conn(0x7fdeb406a960 msgr2=0x7fdeb4155780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 shutdown_connections 2024-05-08T20:55:26.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.460+0000 7f2061b5d700 1 -- 172.21.15.135:0/4009104809 wait complete. 2024-05-08T20:55:26.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.461+0000 7f54c93e0700 1 -- 172.21.15.135:0/1350908542 wait complete. 2024-05-08T20:55:26.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.461+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 shutdown_connections 2024-05-08T20:55:26.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.461+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 >> 172.21.15.135:0/1156216883 conn(0x7f3bf006a960 msgr2=0x7f3bf00cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.462+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 shutdown_connections 2024-05-08T20:55:26.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.462+0000 7f3bf85e7700 1 -- 172.21.15.135:0/1156216883 wait complete. 2024-05-08T20:55:26.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.462+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 shutdown_connections 2024-05-08T20:55:26.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.462+0000 7fdebbaea700 1 -- 172.21.15.135:0/3458604059 wait complete. 2024-05-08T20:55:26.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.464+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 --> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b040c4450 con 0x7f7af0074200 2024-05-08T20:55:26.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.465+0000 7f7b00ff9700 1 -- 172.21.15.135:0/677256620 <== osd.2 v2:172.21.15.135:6813/47110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b040c4450 con 0x7f7af0074200 2024-05-08T20:55:26.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.465+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7f7af0074200 msgr2=0x7f7af0076640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.465+0000 7f7b0a3da700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7f7af0074200 0x7f7af0076640 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.467+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7af006acc0 msgr2=0x7f7af006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.467+0000 7f7b0a3da700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7af006acc0 0x7f7af006d180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7afc001370 tx=0x7f7afc006040 comp rx=0 tx=0).stop 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.467+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04157dd0 msgr2=0x7f7b04150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.467+0000 7f7b0a3da700 1 --2- 172.21.15.135:0/677256620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b04157dd0 0x7f7b04150f30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7af8004490 tx=0x7f7af8003780 comp rx=0 tx=0).stop 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.467+0000 7f7b08977700 1 -- 172.21.15.135:0/677256620 reap_dead start 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.468+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 shutdown_connections 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.468+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 >> 172.21.15.135:0/677256620 conn(0x7f7b040cb200 msgr2=0x7f7b040c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.471+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 shutdown_connections 2024-05-08T20:55:26.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.471+0000 7f7b0a3da700 1 -- 172.21.15.135:0/677256620 wait complete. 2024-05-08T20:55:26.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.472+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 --> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c2c15ae20 con 0x7f3c10074320 2024-05-08T20:55:26.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.472+0000 7f3c297fa700 1 -- 172.21.15.135:0/3435974918 <== osd.5 v2:172.21.15.183:6824/47320 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c18009700 con 0x7f3c10074320 2024-05-08T20:55:26.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.473+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f3c10074320 msgr2=0x7f3c10076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.473+0000 7f3c32e18700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f3c10074320 0x7f3c10076760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.475+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3c1006ad60 msgr2=0x7f3c1006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.475+0000 7f3c32e18700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f3c1006ad60 0x7f3c1006d220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3c20014040 tx=0x7f3c20008030 comp rx=0 tx=0).stop 2024-05-08T20:55:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.475+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c2c1513c0 msgr2=0x7f3c2c089520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.475+0000 7f3c32e18700 1 --2- 172.21.15.135:0/3435974918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c2c1513c0 0x7f3c2c089520 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400cae0 tx=0x7f3c2400cea0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.478+0000 7f3c313b5700 1 -- 172.21.15.135:0/3435974918 reap_dead start 2024-05-08T20:55:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.478+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 --> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea80005cb0 con 0x7fea800015e0 2024-05-08T20:55:26.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.478+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 shutdown_connections 2024-05-08T20:55:26.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.478+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 >> 172.21.15.135:0/3435974918 conn(0x7f3c2c06a960 msgr2=0x7f3c2c0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.497 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:26.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T20:55:26.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.479+0000 7feaa0ff9700 1 -- 172.21.15.135:0/3154691373 <== osd.6 v2:172.21.15.183:6816/47323 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea80005cb0 con 0x7fea800015e0 2024-05-08T20:55:26.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.479+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7fea800015e0 msgr2=0x7fea80003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.479+0000 7feaaa37d700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7fea800015e0 0x7fea80003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.481+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 shutdown_connections 2024-05-08T20:55:26.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.481+0000 7f3c32e18700 1 -- 172.21.15.135:0/3435974918 wait complete. 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.481+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fea8c06ae20 msgr2=0x7fea8c06d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.481+0000 7feaaa37d700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fea8c06ae20 0x7fea8c06d2e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0070b0 tx=0x7fea9c007040 comp rx=0 tx=0).stop 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.481+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa4157cd0 msgr2=0x7feaa415e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.481+0000 7feaaa37d700 1 --2- 172.21.15.135:0/3154691373 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaa4157cd0 0x7feaa415e1e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fea94000c00 tx=0x7fea94004750 comp rx=0 tx=0).stop 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.482+0000 7feaa891a700 1 -- 172.21.15.135:0/3154691373 reap_dead start 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.482+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 shutdown_connections 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.482+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 >> 172.21.15.135:0/3154691373 conn(0x7feaa40c7920 msgr2=0x7feaa406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.483+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 shutdown_connections 2024-05-08T20:55:26.501 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:26.502 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T20:55:26.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.483+0000 7feaaa37d700 1 -- 172.21.15.135:0/3154691373 wait complete. 2024-05-08T20:55:26.503 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:26.506 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T20:55:26.507 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:26.508 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T20:55:26.508 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:26.509 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T20:55:26.510 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:26.510 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T20:55:26.511 INFO:teuthology.orchestra.run.smithi135.stdout:55834574860 2024-05-08T20:55:26.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T20:55:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.747+0000 7f5fd31be700 1 Processor -- start 2024-05-08T20:55:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.747+0000 7f5fd31be700 1 -- start start 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.748+0000 7f5fd31be700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.748+0000 7f5fd31be700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5fcc15e190 0x7f5fcc0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.748+0000 7f5fd31be700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fcc15e5c0 con 0x7f5fcc0c1830 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.748+0000 7f5fd31be700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fcc157d90 con 0x7f5fcc15e190 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.748+0000 7f5fd31be700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0c2d30 con 0x7f5fcc1579b0 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5fcc15e190 0x7f5fcc0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5fcc15e190 0x7f5fcc0caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33150/0 (socket says 172.21.15.135:33150) 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 -- 172.21.15.135:0/2296691903 learned_addr learned my addr 172.21.15.135:0/2296691903 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 -- 172.21.15.135:0/2296691903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 msgr2=0x7f5fcc0c7260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 --2- 172.21.15.135:0/2296691903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc0c7260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 -- 172.21.15.135:0/2296691903 >> v1:172.21.15.183:6789/0 conn(0x7f5fcc0c1830 legacy=0x7f5fcc0c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 -- 172.21.15.135:0/2296691903 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc15d6f0 con 0x7f5fcc15e190 2024-05-08T20:55:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.749+0000 7f5fd175b700 1 --2- 172.21.15.135:0/2296691903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc15e190 0x7f5fcc0caab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009e50 tx=0x7f5fc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a75693d9ae82af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.750+0000 7effc17ed700 1 Processor -- start 2024-05-08T20:55:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.750+0000 7effc17ed700 1 -- start start 2024-05-08T20:55:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7effc17ed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc161770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7effc17ed700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7effbc0c5fa0 0x7effbc0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7effc17ed700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc06bb70 con 0x7effbc06d610 2024-05-08T20:55:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7effc17ed700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc157fc0 con 0x7effbc0c5fa0 2024-05-08T20:55:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7effc17ed700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc06c000 con 0x7effbc157be0 2024-05-08T20:55:26.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effba7fc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7effbc0c5fa0 0x7effbc0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effba7fc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7effbc0c5fa0 0x7effbc0c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:46570/0 (socket says 172.21.15.135:46570) 2024-05-08T20:55:26.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effba7fc700 1 -- 172.21.15.135:0/1974977114 learned_addr learned my addr 172.21.15.135:0/1974977114 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.750+0000 7f1b9a9d0700 1 Processor -- start 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.750+0000 7f1b9a9d0700 1 -- start start 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7f1b9a9d0700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1b940c5a40 0x7f1b940c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7f1b9a9d0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 0x7f1b940cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7f1b9a9d0700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b940cb210 con 0x7f1b941635b0 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7f1b9a9d0700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b940c2510 con 0x7f1b940c5a40 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.751+0000 7f1b9a9d0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94166fd0 con 0x7f1b940ca840 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7f1b937fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1b940c5a40 0x7f1b940c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7f1b937fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f1b940c5a40 0x7f1b940c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33156/0 (socket says 172.21.15.135:33156) 2024-05-08T20:55:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7f1b937fe700 1 -- 172.21.15.135:0/2447837460 learned_addr learned my addr 172.21.15.135:0/2447837460 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effbaffd700 1 --2- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effba7fc700 1 -- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 msgr2=0x7effbc161770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effba7fc700 1 --2- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc161770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effba7fc700 1 -- 172.21.15.135:0/1974977114 >> v1:172.21.15.183:6789/0 conn(0x7effbc06d610 legacy=0x7effbc06daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7effba7fc700 1 -- 172.21.15.135:0/1974977114 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc06ee10 con 0x7effbc0c5fa0 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.752+0000 7f1b98f6d700 1 --2- 172.21.15.135:0/2447837460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 0x7f1b940cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b937fe700 1 -- 172.21.15.135:0/2447837460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 msgr2=0x7f1b940cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b937fe700 1 --2- 172.21.15.135:0/2447837460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 0x7f1b940cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b937fe700 1 -- 172.21.15.135:0/2447837460 >> v1:172.21.15.183:6789/0 conn(0x7f1b941635b0 legacy=0x7f1b941668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b937fe700 1 -- 172.21.15.135:0/2447837460 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b941695c0 con 0x7f1b940c5a40 2024-05-08T20:55:26.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b937fe700 1 --2- 172.21.15.135:0/2447837460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b940c5a40 0x7f1b940c5ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b88008970 tx=0x7f1b88008c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcee33e0c16a9526 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f5fcb7fe700 1 -- 172.21.15.135:0/2296691903 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400e070 con 0x7f5fcc15e190 2024-05-08T20:55:26.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b92ffd700 1 -- 172.21.15.135:0/2447837460 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88016ce0 con 0x7f1b940c5a40 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7effba7fc700 1 --2- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc0c5fa0 0x7effbc0c6400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effb4009e50 tx=0x7effb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8956a7c40ae82313 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7effb9ffb700 1 -- 172.21.15.135:0/1974977114 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400e070 con 0x7effbc0c5fa0 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7effb9ffb700 1 -- 172.21.15.135:0/1974977114 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400b910 con 0x7effbc0c5fa0 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7effb9ffb700 1 -- 172.21.15.135:0/1974977114 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400bcc0 con 0x7effbc0c5fa0 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f5fcb7fe700 1 -- 172.21.15.135:0/2296691903 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc4003a20 con 0x7f5fcc15e190 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f5fcb7fe700 1 -- 172.21.15.135:0/2296691903 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4003dd0 con 0x7f5fcc15e190 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7f5fd31be700 1 -- 172.21.15.135:0/2296691903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc15e190 msgr2=0x7f5fcc0caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7f5fd31be700 1 --2- 172.21.15.135:0/2296691903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc15e190 0x7f5fcc0caab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009e50 tx=0x7f5fc400b330 comp rx=0 tx=0).stop 2024-05-08T20:55:26.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f5fd31be700 1 -- 172.21.15.135:0/2296691903 shutdown_connections 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f5fd31be700 1 --2- 172.21.15.135:0/2296691903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc15e190 0x7f5fcc0caab0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f5fd31be700 1 --2- 172.21.15.135:0/2296691903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f5fd31be700 1 -- 172.21.15.135:0/2296691903 >> 172.21.15.135:0/2296691903 conn(0x7f5fcc06a960 msgr2=0x7f5fcc06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b92ffd700 1 -- 172.21.15.135:0/2447837460 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b88016e40 con 0x7f1b940c5a40 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.753+0000 7f1b92ffd700 1 -- 172.21.15.135:0/2447837460 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88004250 con 0x7f1b940c5a40 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/2447837460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b940c5a40 msgr2=0x7f1b940c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.754+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/2447837460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b940c5a40 0x7f1b940c5ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b88008970 tx=0x7f1b88008c80 comp rx=0 tx=0).stop 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/2447837460 shutdown_connections 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/2447837460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 0x7f1b940cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/2447837460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b940c5a40 0x7f1b940c5ea0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/2447837460 >> 172.21.15.135:0/2447837460 conn(0x7f1b9406a960 msgr2=0x7f1b9406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7effc17ed700 1 -- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc0c5fa0 msgr2=0x7effbc0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7effc17ed700 1 --2- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc0c5fa0 0x7effbc0c6400 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effb4009e50 tx=0x7effb400b330 comp rx=0 tx=0).stop 2024-05-08T20:55:26.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7effc17ed700 1 -- 172.21.15.135:0/1974977114 shutdown_connections 2024-05-08T20:55:26.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7effc17ed700 1 --2- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc161770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7effc17ed700 1 --2- 172.21.15.135:0/1974977114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc0c5fa0 0x7effbc0c6400 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7effc17ed700 1 -- 172.21.15.135:0/1974977114 >> 172.21.15.135:0/1974977114 conn(0x7effbc0cb200 msgr2=0x7effbc0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/2447837460 shutdown_connections 2024-05-08T20:55:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/2447837460 wait complete. 2024-05-08T20:55:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.755+0000 7f5fd31be700 1 -- 172.21.15.135:0/2296691903 shutdown_connections 2024-05-08T20:55:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.757+0000 7f44f3149700 1 Processor -- start 2024-05-08T20:55:26.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.757+0000 7f44f3149700 1 -- start start 2024-05-08T20:55:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.757+0000 7f1b9a9d0700 1 Processor -- start 2024-05-08T20:55:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.757+0000 7f5fd31be700 1 -- 172.21.15.135:0/2296691903 wait complete. 2024-05-08T20:55:26.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.758+0000 7effc17ed700 1 -- 172.21.15.135:0/1974977114 shutdown_connections 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.757+0000 7f1b9a9d0700 1 -- start start 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b9a9d0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 0x7f1b941fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b9a9d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b941671b0 0x7f1b941f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b9a9d0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9415ed70 0x7f1b9415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b9a9d0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9415d510 con 0x7f1b941671b0 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b9a9d0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b941fd460 con 0x7f1b9415ed70 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b9a9d0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b941fc460 con 0x7f1b940ca840 2024-05-08T20:55:26.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b941671b0 0x7f1b941f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b941671b0 0x7f1b941f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33160/0 (socket says 172.21.15.135:33160) 2024-05-08T20:55:26.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f1b937fe700 1 -- 172.21.15.135:0/189662625 learned_addr learned my addr 172.21.15.135:0/189662625 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f5fd31be700 1 Processor -- start 2024-05-08T20:55:26.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.758+0000 7effc17ed700 1 -- 172.21.15.135:0/1974977114 wait complete. 2024-05-08T20:55:26.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7effc17ed700 1 Processor -- start 2024-05-08T20:55:26.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7effc17ed700 1 -- start start 2024-05-08T20:55:26.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7f1b937fe700 1 -- 172.21.15.135:0/189662625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 msgr2=0x7f1b941fcf20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:55:26.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7f1b937fe700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 0x7f1b941fcf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7f1b937fe700 1 -- 172.21.15.135:0/189662625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9415ed70 msgr2=0x7f1b9415c110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:55:26.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7f1b937fe700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9415ed70 0x7f1b9415c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7f1b937fe700 1 -- 172.21.15.135:0/189662625 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880085d0 con 0x7f1b941671b0 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7f1b937fe700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b941671b0 0x7f1b941f18c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b88016fd0 tx=0x7f1b88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.760+0000 7f1b90ff9700 1 -- 172.21.15.135:0/189662625 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88016ce0 con 0x7f1b941671b0 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f1b90ff9700 1 -- 172.21.15.135:0/189662625 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b88003e40 con 0x7f1b941671b0 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f1b90ff9700 1 -- 172.21.15.135:0/189662625 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800b870 con 0x7f1b941671b0 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.759+0000 7f5fd31be700 1 -- start start 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fd31be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc0c1830 0x7f5fcc0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fd31be700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc1ea030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effc17ed700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc06d610 0x7effbc158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effc17ed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc0c5fa0 0x7effbc1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effc17ed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effc17ed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc159900 con 0x7effbc0c5fa0 2024-05-08T20:55:26.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effc17ed700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc141f20 con 0x7effbc06d610 2024-05-08T20:55:26.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effc17ed700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc158720 con 0x7effbc157be0 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fd31be700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fcc15e190 0x7f5fcc1f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fd31be700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc15b760 con 0x7f5fcc0c1830 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fd31be700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc0c86d0 con 0x7f5fcc15e190 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fd31be700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc1f3530 con 0x7f5fcc1579b0 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fcbfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc1ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fcbfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc1ea030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50350/0 (socket says 172.21.15.135:50350) 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fcbfff700 1 -- 172.21.15.135:0/3802258294 learned_addr learned my addr 172.21.15.135:0/3802258294 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f5fd175b700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fcc15e190 0x7f5fcc1f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc1537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50364/0 (socket says 172.21.15.135:50364) 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effbb7fe700 1 -- 172.21.15.135:0/1959588121 learned_addr learned my addr 172.21.15.135:0/1959588121 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effbaffd700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc06d610 0x7effbc158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7effba7fc700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc0c5fa0 0x7effbc1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effbaffd700 1 -- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 msgr2=0x7effbc1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effbaffd700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effbaffd700 1 -- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc0c5fa0 msgr2=0x7effbc1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effbaffd700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc0c5fa0 0x7effbc1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effbaffd700 1 -- 172.21.15.135:0/1959588121 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009b30 con 0x7effbc06d610 2024-05-08T20:55:26.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b940c87e0 con 0x7f1b941671b0 2024-05-08T20:55:26.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.761+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b940c8da0 con 0x7f1b941671b0 2024-05-08T20:55:26.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effbaffd700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc06d610 0x7effbc158100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7effb000e8a0 tx=0x7effb000ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f44f3149700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f44ec0b1c70 0x7f44ec14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f44f3149700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec0c1540 con 0x7f44ec072390 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f44f3149700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec0c6670 con 0x7f44ec072770 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f44f3149700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec0c19d0 con 0x7f44ec0b1c70 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44ebfff700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f44ec072770 0x7f44ec156050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.135:59664/0 (socket says 172.21.15.135:59664) 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44ebfff700 1 -- 172.21.15.135:0/3107017839 learned_addr learned my addr 172.21.15.135:0/3107017839 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd175b700 1 -- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 msgr2=0x7f5fcc1ea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd175b700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc1ea030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd175b700 1 -- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc0c1830 msgr2=0x7f5fcc0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd175b700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc0c1830 0x7f5fcc0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd175b700 1 -- 172.21.15.135:0/3802258294 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4009b30 con 0x7f5fcc15e190 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd175b700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fcc15e190 0x7f5fcc1f3c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4014000 tx=0x7f5fc4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fc97fa700 1 -- 172.21.15.135:0/3802258294 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4004440 con 0x7f5fcc15e190 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fc97fa700 1 -- 172.21.15.135:0/3802258294 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc40045a0 con 0x7f5fcc15e190 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fc97fa700 1 -- 172.21.15.135:0/3802258294 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4004950 con 0x7f5fcc15e190 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc0ca060 con 0x7f5fcc15e190 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc1f37d0 con 0x7f5fcc15e190 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44f16e6700 1 --2- 172.21.15.135:0/3107017839 >> v2:172.21.15.135:3300/0 conn(0x7f44ec0b1c70 0x7f44ec14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44eb7fe700 1 -- 172.21.15.135:0/3107017839 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085683199 0 0) 0x7f44ec0c6670 con 0x7f44ec072770 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44eb7fe700 1 -- 172.21.15.135:0/3107017839 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44dc0035b0 con 0x7f44ec072770 2024-05-08T20:55:26.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44f16e6700 1 -- 172.21.15.135:0/3107017839 >> v1:172.21.15.183:6789/0 conn(0x7f44ec072770 legacy=0x7f44ec156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44f16e6700 1 -- 172.21.15.135:0/3107017839 >> v1:172.21.15.135:6789/0 conn(0x7f44ec072390 legacy=0x7f44ec0cbf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7f44f16e6700 1 -- 172.21.15.135:0/3107017839 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec0c6930 con 0x7f44ec0b1c70 2024-05-08T20:55:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effa37fe700 1 -- 172.21.15.135:0/1959588121 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0013680 con 0x7effbc06d610 2024-05-08T20:55:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effa37fe700 1 -- 172.21.15.135:0/1959588121 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb00137e0 con 0x7effbc06d610 2024-05-08T20:55:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.762+0000 7effa37fe700 1 -- 172.21.15.135:0/1959588121 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0013b70 con 0x7effbc06d610 2024-05-08T20:55:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc154db0 con 0x7effbc06d610 2024-05-08T20:55:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.763+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc1418d0 con 0x7effbc06d610 2024-05-08T20:55:26.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.764+0000 7f44f16e6700 1 --2- 172.21.15.135:0/3107017839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 0x7f44ec14fe10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009d90 tx=0x7f44e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbbc5fb8499ab92 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.764+0000 7f44eb7fe700 1 -- 172.21.15.135:0/3107017839 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e400e070 con 0x7f44ec0b1c70 2024-05-08T20:55:26.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.764+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc067890 con 0x7f5fcc15e190 2024-05-08T20:55:26.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.764+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc0c3a20 con 0x7effbc06d610 2024-05-08T20:55:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f1b90ff9700 1 -- 172.21.15.135:0/189662625 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b8800b9d0 con 0x7f1b941671b0 2024-05-08T20:55:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.764+0000 7f44eb7fe700 1 -- 172.21.15.135:0/3107017839 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e400baa0 con 0x7f44ec0b1c70 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.764+0000 7f44eb7fe700 1 -- 172.21.15.135:0/3107017839 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e400be50 con 0x7f44ec0b1c70 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f44f3149700 1 -- 172.21.15.135:0/3107017839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 msgr2=0x7f44ec14fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f44f3149700 1 --2- 172.21.15.135:0/3107017839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 0x7f44ec14fe10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009d90 tx=0x7f44e400b330 comp rx=0 tx=0).stop 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f44f3149700 1 -- 172.21.15.135:0/3107017839 shutdown_connections 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f44f3149700 1 --2- 172.21.15.135:0/3107017839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 0x7f44ec14fe10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f44f3149700 1 -- 172.21.15.135:0/3107017839 >> 172.21.15.135:0/3107017839 conn(0x7f44ec06ec40 msgr2=0x7f44ec06ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.766+0000 7f44f3149700 1 -- 172.21.15.135:0/3107017839 shutdown_connections 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7effa37fe700 1 -- 172.21.15.135:0/1959588121 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7effb0013cd0 con 0x7effbc06d610 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.766+0000 7effa37fe700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7effa806ad10 0x7effa806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.766+0000 7effa37fe700 1 -- 172.21.15.135:0/1959588121 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effb0089b50 con 0x7effbc06d610 2024-05-08T20:55:26.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.766+0000 7effba7fc700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7effa806ad10 0x7effa806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.766+0000 7f5fc97fa700 1 -- 172.21.15.135:0/3802258294 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5fc4012430 con 0x7f5fcc15e190 2024-05-08T20:55:26.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.766+0000 7f44f3149700 1 -- 172.21.15.135:0/3107017839 wait complete. 2024-05-08T20:55:26.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7f5fc97fa700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5fb806ad60 0x7f5fb806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7effba7fc700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7effa806ad10 0x7effa806d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7effb400b370 tx=0x7effb4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7f5fc97fa700 1 -- 172.21.15.135:0/3802258294 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fc408aa60 con 0x7f5fcc15e190 2024-05-08T20:55:26.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f1b90ff9700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1b8006ad10 0x7f1b8006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.765+0000 7f1b90ff9700 1 -- 172.21.15.135:0/189662625 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b8808a140 con 0x7f1b941671b0 2024-05-08T20:55:26.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.766+0000 7f1b93fff700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1b8006ad10 0x7f1b8006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7f1b93fff700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1b8006ad10 0x7f1b8006d1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b940cb8c0 tx=0x7f1b84007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b940cb210 con 0x7f1b941671b0 2024-05-08T20:55:26.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7fb582eb9700 1 Processor -- start 2024-05-08T20:55:26.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7f44f3149700 1 Processor -- start 2024-05-08T20:55:26.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.768+0000 7f5fd0f5a700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5fb806ad60 0x7f5fb806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.768+0000 7f5fd0f5a700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5fb806ad60 0x7f5fb806d220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009770 tx=0x7f5fc0006cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.768+0000 7f44f3149700 1 -- start start 2024-05-08T20:55:26.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.767+0000 7f2a40350700 1 Processor -- start 2024-05-08T20:55:26.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7fb582eb9700 1 -- start start 2024-05-08T20:55:26.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f3149700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44ec072390 0x7f44ec150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f3149700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44ec072770 0x7f44ec1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f3149700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 0x7f44ec0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f3149700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0c8590 con 0x7f44ec0b1c70 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f3149700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec150990 con 0x7f44ec072390 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f3149700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec153840 con 0x7f44ec072770 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44ebfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44ec072770 0x7f44ec1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44ebfff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44ec072770 0x7f44ec1513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50376/0 (socket says 172.21.15.135:50376) 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44ebfff700 1 -- 172.21.15.135:0/2225855866 learned_addr learned my addr 172.21.15.135:0/2225855866 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7effa37fe700 1 -- 172.21.15.135:0/1959588121 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7effb0054b20 con 0x7effbc06d610 2024-05-08T20:55:26.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f0ee5700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44ec072390 0x7f44ec150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.770+0000 7f44f16e6700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 0x7f44ec0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44ebfff700 1 -- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44ec072390 msgr2=0x7f44ec150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44ebfff700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44ec072390 0x7f44ec150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44ebfff700 1 -- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 msgr2=0x7f44ec0c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44ebfff700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 0x7f44ec0c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44ebfff700 1 -- 172.21.15.135:0/2225855866 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4009a70 con 0x7f44ec072770 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44ebfff700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44ec072770 0x7f44ec1513b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44e0001eb0 tx=0x7f44e000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44e97fa700 1 -- 172.21.15.135:0/2225855866 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0004c80 con 0x7f44ec072770 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44e97fa700 1 -- 172.21.15.135:0/2225855866 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0004de0 con 0x7f44ec072770 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44e97fa700 1 -- 172.21.15.135:0/2225855866 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0007310 con 0x7f44ec072770 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ec153560 con 0x7f44ec072770 2024-05-08T20:55:26.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec13c9c0 con 0x7f44ec072770 2024-05-08T20:55:26.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7f2a40350700 1 -- start start 2024-05-08T20:55:26.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a40350700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a38157860 0x7f2a38160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a40350700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a38157c40 0x7f2a380c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a40350700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a380c2e80 con 0x7f2a380c2970 2024-05-08T20:55:26.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a40350700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a380c3140 con 0x7f2a38157860 2024-05-08T20:55:26.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a40350700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380c3420 con 0x7f2a38157c40 2024-05-08T20:55:26.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a3d8eb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a38157c40 0x7f2a380c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a3d8eb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a38157c40 0x7f2a380c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50394/0 (socket says 172.21.15.135:50394) 2024-05-08T20:55:26.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7f2a3d8eb700 1 -- 172.21.15.135:0/2373991017 learned_addr learned my addr 172.21.15.135:0/2373991017 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.773+0000 7f2a3d8eb700 1 -- 172.21.15.135:0/2373991017 >> v2:172.21.15.183:3300/0 conn(0x7f2a38157860 msgr2=0x7f2a38160d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.773+0000 7f2a3d8eb700 1 --2- 172.21.15.135:0/2373991017 >> v2:172.21.15.183:3300/0 conn(0x7f2a38157860 0x7f2a38160d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.773+0000 7f2a3d8eb700 1 -- 172.21.15.135:0/2373991017 >> v1:172.21.15.183:6789/0 conn(0x7f2a380c2970 legacy=0x7f2a380c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.773+0000 7f2a3d8eb700 1 -- 172.21.15.135:0/2373991017 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3815dad0 con 0x7f2a38157c40 2024-05-08T20:55:26.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.773+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec067fa0 con 0x7f44ec072770 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb582eb9700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb57c0cae00 0x7fb57c0c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb582eb9700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb57c0c5e30 0x7fb57c0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb582eb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c0cb1e0 0x7fb57c153000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb582eb9700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c15a130 con 0x7fb57c0cae00 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb582eb9700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c15c870 con 0x7fb57c0c5e30 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb582eb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c15cb50 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb580c55700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb57c0cae00 0x7fb57c0c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb580c55700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb57c0cae00 0x7fb57c0c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33196/0 (socket says 172.21.15.135:33196) 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.771+0000 7fb580c55700 1 -- 172.21.15.135:0/1868676410 learned_addr learned my addr 172.21.15.135:0/1868676410 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7fb581456700 1 --2- 172.21.15.135:0/1868676410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c0cb1e0 0x7fb57c153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7fb580c55700 1 -- 172.21.15.135:0/1868676410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c0cb1e0 msgr2=0x7fb57c153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7fb580c55700 1 --2- 172.21.15.135:0/1868676410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c0cb1e0 0x7fb57c153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7fb580c55700 1 -- 172.21.15.135:0/1868676410 >> v2:172.21.15.183:3300/0 conn(0x7fb57c0c5e30 msgr2=0x7fb57c0c35e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7fb580c55700 1 --2- 172.21.15.135:0/1868676410 >> v2:172.21.15.183:3300/0 conn(0x7fb57c0c5e30 0x7fb57c0c35e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7fb580c55700 1 -- 172.21.15.135:0/1868676410 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c15ce30 con 0x7fb57c0cae00 2024-05-08T20:55:26.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.772+0000 7fb580c55700 1 --2- 172.21.15.135:0/1868676410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cae00 0x7fb57c0c30a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb57c06e3e0 tx=0x7fb570009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b87e01a7cf6c23d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.774+0000 7f2a3d8eb700 1 --2- 172.21.15.135:0/2373991017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a38157c40 0x7f2a380c8470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a340098f0 tx=0x7f2a34009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cfbccacda866273 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.774+0000 7f2a3d0ea700 1 -- 172.21.15.135:0/2373991017 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400b8a0 con 0x7f2a38157c40 2024-05-08T20:55:26.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.774+0000 7f2a3d0ea700 1 -- 172.21.15.135:0/2373991017 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400ba00 con 0x7f2a38157c40 2024-05-08T20:55:26.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.774+0000 7f2a3d0ea700 1 -- 172.21.15.135:0/2373991017 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400bd90 con 0x7f2a38157c40 2024-05-08T20:55:26.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.774+0000 7f44e97fa700 1 -- 172.21.15.135:0/2225855866 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44e0007470 con 0x7f44ec072770 2024-05-08T20:55:26.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.774+0000 7f44e97fa700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f44d006ad90 0x7f44d006d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.774+0000 7f9042ad2700 1 Processor -- start 2024-05-08T20:55:26.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f44e97fa700 1 -- 172.21.15.135:0/2225855866 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44e0089440 con 0x7f44ec072770 2024-05-08T20:55:26.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f44f0ee5700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f44d006ad90 0x7f44d006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 -- 172.21.15.135:0/2373991017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a38157c40 msgr2=0x7f2a380c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 --2- 172.21.15.135:0/2373991017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a38157c40 0x7f2a380c8470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a340098f0 tx=0x7f2a34009c00 comp rx=0 tx=0).stop 2024-05-08T20:55:26.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 -- 172.21.15.135:0/2373991017 shutdown_connections 2024-05-08T20:55:26.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 --2- 172.21.15.135:0/2373991017 >> v2:172.21.15.183:3300/0 conn(0x7f2a38157860 0x7f2a38160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 --2- 172.21.15.135:0/2373991017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a38157c40 0x7f2a380c8470 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 -- 172.21.15.135:0/2373991017 >> 172.21.15.135:0/2373991017 conn(0x7f2a3806a960 msgr2=0x7f2a3806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f5fc97fa700 1 -- 172.21.15.135:0/3802258294 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5fc40558a0 con 0x7f5fcc15e190 2024-05-08T20:55:26.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 -- 172.21.15.135:0/2373991017 shutdown_connections 2024-05-08T20:55:26.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f44f0ee5700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f44d006ad90 0x7f44d006d250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009910 tx=0x7f44d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f9042ad2700 1 -- start start 2024-05-08T20:55:26.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f9042ad2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f903c14fbd0 0x7f903c0c2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f9042ad2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f903c0c43c0 0x7f903c0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f9042ad2700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0c37d0 con 0x7f903c06ea10 2024-05-08T20:55:26.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f9042ad2700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0c4d10 con 0x7f903c14fbd0 2024-05-08T20:55:26.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f9042ad2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c066e50 con 0x7f903c0c43c0 2024-05-08T20:55:26.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f904086e700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f903c06ea10 0x7f903c066740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.135:59682/0 (socket says 172.21.15.135:59682) 2024-05-08T20:55:26.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f904086e700 1 -- 172.21.15.135:0/3612645659 learned_addr learned my addr 172.21.15.135:0/3612645659 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:26.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f1b90ff9700 1 -- 172.21.15.135:0/189662625 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1b940cb210 con 0x7f1b941671b0 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f904106f700 1 --2- 172.21.15.135:0/3612645659 >> v2:172.21.15.183:3300/0 conn(0x7f903c0c43c0 0x7f903c0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.776+0000 7f903bfff700 1 --2- 172.21.15.135:0/3612645659 >> v2:172.21.15.135:3300/0 conn(0x7f903c14fbd0 0x7f903c0c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141586358 0 0) 0x7f9030001110 con 0x7f903c06ea10 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f902c0035b0 con 0x7f903c06ea10 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681190190 0 0) 0x7f902c0035b0 con 0x7f903c06ea10 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 >> v2:172.21.15.183:3300/0 conn(0x7f903c0c43c0 msgr2=0x7f903c0c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 --2- 172.21.15.135:0/3612645659 >> v2:172.21.15.183:3300/0 conn(0x7f903c0c43c0 0x7f903c0c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 >> v2:172.21.15.135:3300/0 conn(0x7f903c14fbd0 msgr2=0x7f903c0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 --2- 172.21.15.135:0/3612645659 >> v2:172.21.15.135:3300/0 conn(0x7f903c14fbd0 0x7f903c0c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0c2c40 con 0x7f903c06ea10 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f9030001800 con 0x7f903c06ea10 2024-05-08T20:55:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 >> v1:172.21.15.183:6789/0 conn(0x7f903c06ea10 legacy=0x7f903c066740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f902c003a00 0x7f902c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c004850 0x7f902c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f902c005210 0x7f902c014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c4d10 con 0x7f902c005210 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c066e50 con 0x7f902c003a00 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0059e0 con 0x7f902c004850 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f904086e700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f902c003a00 0x7f902c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.775+0000 7f2a40350700 1 -- 172.21.15.135:0/2373991017 wait complete. 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7f2a40350700 1 Processor -- start 2024-05-08T20:55:26.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7fb57b7fe700 1 -- 172.21.15.135:0/1868676410 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57000b870 con 0x7fb57c0cae00 2024-05-08T20:55:26.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7fb57b7fe700 1 -- 172.21.15.135:0/1868676410 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57000b9d0 con 0x7fb57c0cae00 2024-05-08T20:55:26.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.777+0000 7fb57b7fe700 1 -- 172.21.15.135:0/1868676410 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57000bd40 con 0x7fb57c0cae00 2024-05-08T20:55:26.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7fb582eb9700 1 -- 172.21.15.135:0/1868676410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cae00 msgr2=0x7fb57c0c30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1868676410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cae00 0x7fb57c0c30a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb57c06e3e0 tx=0x7fb570009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f904086e700 1 -- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c004850 msgr2=0x7f902c004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f904086e700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c004850 0x7f902c004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f904086e700 1 -- 172.21.15.135:0/3612645659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f902c005210 msgr2=0x7f902c014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f904086e700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f902c005210 0x7f902c014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f904086e700 1 -- 172.21.15.135:0/3612645659 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0c2c40 con 0x7f902c003a00 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f904086e700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f902c003a00 0x7f902c003e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f903000c370 tx=0x7f902c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fed82a584aa33d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903000ce70 con 0x7f902c003a00 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030005960 con 0x7f902c003a00 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f903b7fe700 1 -- 172.21.15.135:0/3612645659 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030005d30 con 0x7f902c003a00 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f904106f700 1 -- 172.21.15.135:0/3612645659 reap_dead start 2024-05-08T20:55:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7fb582eb9700 1 -- 172.21.15.135:0/1868676410 shutdown_connections 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1868676410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cae00 0x7fb57c0c30a0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb57c06e3e0 tx=0x7fb570009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1868676410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c0cb1e0 0x7fb57c153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1868676410 >> v2:172.21.15.183:3300/0 conn(0x7fb57c0c5e30 0x7fb57c0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7fb582eb9700 1 -- 172.21.15.135:0/1868676410 >> 172.21.15.135:0/1868676410 conn(0x7fb57c06a960 msgr2=0x7fb57c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.778+0000 7f2a40350700 1 -- start start 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a40350700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a380c2970 0x7f2a3813e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a40350700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a38157860 0x7f2a380ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a40350700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a38157c40 0x7f2a380cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a40350700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3813d600 con 0x7f2a38157860 2024-05-08T20:55:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a40350700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380cc0e0 con 0x7f2a38157c40 2024-05-08T20:55:26.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a40350700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a38146e20 con 0x7f2a380c2970 2024-05-08T20:55:26.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a3e8ed700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a38157c40 0x7f2a380cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a3e8ed700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a38157c40 0x7f2a380cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:46646/0 (socket says 172.21.15.135:46646) 2024-05-08T20:55:26.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a3e8ed700 1 -- 172.21.15.135:0/2049386111 learned_addr learned my addr 172.21.15.135:0/2049386111 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.779+0000 7f2a3d8eb700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a38157860 0x7f2a380ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f44e97fa700 1 -- 172.21.15.135:0/2225855866 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f44e0054280 con 0x7f44ec072770 2024-05-08T20:55:26.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a3e8ed700 1 -- 172.21.15.135:0/2049386111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a380c2970 msgr2=0x7f2a3813e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:55:26.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a3e8ed700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a380c2970 0x7f2a3813e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a3e8ed700 1 -- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a38157860 msgr2=0x7f2a380ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a3e8ed700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a38157860 0x7f2a380ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a3e8ed700 1 -- 172.21.15.135:0/2049386111 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34009550 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a3d8eb700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a38157860 0x7f2a380ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a3e8ed700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a38157c40 0x7f2a380cd4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000cb50 tx=0x7f2a3000cf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a2effd700 1 -- 172.21.15.135:0/2049386111 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30003c00 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a2effd700 1 -- 172.21.15.135:0/2049386111 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30003d60 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a2effd700 1 -- 172.21.15.135:0/2049386111 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3000ab70 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3813d320 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a381467d0 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.782+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3806d7c0 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.783+0000 7f2a2effd700 1 -- 172.21.15.135:0/2049386111 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a3000acd0 con 0x7f2a38157c40 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.783+0000 7f2a2effd700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f2a1c06ac90 0x7f2a1c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.783+0000 7f2a2effd700 1 -- 172.21.15.135:0/2049386111 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a30089730 con 0x7f2a38157c40 2024-05-08T20:55:26.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.785+0000 7f2a3e0ec700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f2a1c06ac90 0x7f2a1c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.786+0000 7f2a3e0ec700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f2a1c06ac90 0x7f2a1c06d150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009710 tx=0x7f2a28006c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f9042ad2700 1 -- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f902c003a00 msgr2=0x7f902c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.780+0000 7f9042ad2700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f902c003a00 0x7f902c003e20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f903000c370 tx=0x7f902c005880 comp rx=0 tx=0).stop 2024-05-08T20:55:26.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.787+0000 7f9042ad2700 1 -- 172.21.15.135:0/3612645659 shutdown_connections 2024-05-08T20:55:26.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.787+0000 7f9042ad2700 1 --2- 172.21.15.135:0/3612645659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f902c003a00 0x7f902c003e20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.787+0000 7f9042ad2700 1 -- 172.21.15.135:0/3612645659 >> 172.21.15.135:0/3612645659 conn(0x7f903c0cb200 msgr2=0x7f903c0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.787+0000 7f9042ad2700 1 -- 172.21.15.135:0/3612645659 shutdown_connections 2024-05-08T20:55:26.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.788+0000 7f2a2effd700 1 -- 172.21.15.135:0/2049386111 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2a30054590 con 0x7f2a38157c40 2024-05-08T20:55:26.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.787+0000 7f9042ad2700 1 -- 172.21.15.135:0/3612645659 wait complete. 2024-05-08T20:55:26.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.789+0000 7f9042ad2700 1 Processor -- start 2024-05-08T20:55:26.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.785+0000 7fb582eb9700 1 -- 172.21.15.135:0/1868676410 shutdown_connections 2024-05-08T20:55:26.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.789+0000 7f9042ad2700 1 -- start start 2024-05-08T20:55:26.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.790+0000 7f9042ad2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c003a00 0x7f903c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.790+0000 7f9042ad2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f903c1549d0 0x7f903c1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.790+0000 7f9042ad2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903c14a570 0x7f903c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.790+0000 7f9042ad2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c149fa0 con 0x7f903c14a570 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.790+0000 7f9042ad2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1eaa30 con 0x7f903c1549d0 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.790+0000 7f9042ad2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1ead10 con 0x7f902c003a00 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.791+0000 7f904106f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903c14a570 0x7f903c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.791+0000 7f904106f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903c14a570 0x7f903c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33228/0 (socket says 172.21.15.135:33228) 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.791+0000 7f904106f700 1 -- 172.21.15.135:0/4033762790 learned_addr learned my addr 172.21.15.135:0/4033762790 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.791+0000 7f904086e700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c003a00 0x7f903c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.791+0000 7f903bfff700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f903c1549d0 0x7f903c1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.792+0000 7f904106f700 1 -- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c003a00 msgr2=0x7f903c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.792+0000 7f904106f700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c003a00 0x7f903c155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.792+0000 7f904106f700 1 -- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f903c1549d0 msgr2=0x7f903c1536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.792+0000 7f904106f700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f903c1549d0 0x7f903c1536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.792+0000 7f904106f700 1 -- 172.21.15.135:0/4033762790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c1eaff0 con 0x7f903c14a570 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.792+0000 7f904106f700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903c14a570 0x7f903c152560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f903c070c50 tx=0x7f903400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.793+0000 7f90397fa700 1 -- 172.21.15.135:0/4033762790 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034010040 con 0x7f903c14a570 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.793+0000 7f90397fa700 1 -- 172.21.15.135:0/4033762790 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903400b8a0 con 0x7f903c14a570 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.793+0000 7f90397fa700 1 -- 172.21.15.135:0/4033762790 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400bc50 con 0x7f903c14a570 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.793+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c1eb2d0 con 0x7f903c14a570 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.793+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c14a280 con 0x7f903c14a570 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.794+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c067fa0 con 0x7f903c14a570 2024-05-08T20:55:26.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.791+0000 7fb582eb9700 1 -- 172.21.15.135:0/1868676410 wait complete. 2024-05-08T20:55:26.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.792+0000 7fb582eb9700 1 Processor -- start 2024-05-08T20:55:26.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.798+0000 7fb582eb9700 1 -- start start 2024-05-08T20:55:26.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.800+0000 7f90397fa700 1 -- 172.21.15.135:0/4033762790 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f903401e410 con 0x7f903c14a570 2024-05-08T20:55:26.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7f90397fa700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f902006ad60 0x7f902006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7f90397fa700 1 -- 172.21.15.135:0/4033762790 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90340896a0 con 0x7f903c14a570 2024-05-08T20:55:26.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.798+0000 7fb582eb9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cb1e0 0x7fb57c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.798+0000 7fb582eb9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb57c153f80 0x7fb57c14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.798+0000 7fb582eb9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c156990 0x7fb57c14b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.798+0000 7fb582eb9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c14c090 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.798+0000 7fb582eb9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c154b90 con 0x7fb57c153f80 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.798+0000 7fb582eb9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c154890 con 0x7fb57c156990 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.800+0000 7fb580c55700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cb1e0 0x7fb57c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.800+0000 7fb580c55700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cb1e0 0x7fb57c0c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33240/0 (socket says 172.21.15.135:33240) 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.800+0000 7fb580c55700 1 -- 172.21.15.135:0/1265924540 learned_addr learned my addr 172.21.15.135:0/1265924540 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7fb580c55700 1 -- 172.21.15.135:0/1265924540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c156990 msgr2=0x7fb57c14b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7fb580c55700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c156990 0x7fb57c14b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7fb580c55700 1 -- 172.21.15.135:0/1265924540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb57c153f80 msgr2=0x7fb57c14b440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7fb580c55700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb57c153f80 0x7fb57c14b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7fb580c55700 1 -- 172.21.15.135:0/1265924540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570009550 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.801+0000 7fb580c55700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cb1e0 0x7fb57c0c9c60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb570009c10 tx=0x7fb570004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.804+0000 7f904086e700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f902006ad60 0x7f902006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.805+0000 7f904086e700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f902006ad60 0x7f902006d220 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f903000c370 tx=0x7f903000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.810+0000 7f90397fa700 1 -- 172.21.15.135:0/4033762790 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9034054570 con 0x7f903c14a570 2024-05-08T20:55:26.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.807+0000 7fb5797fa700 1 -- 172.21.15.135:0/1265924540 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570004450 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.808+0000 7fb5797fa700 1 -- 172.21.15.135:0/1265924540 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5700045b0 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.808+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c14c2e0 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.808+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c1eb650 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.808+0000 7fb5797fa700 1 -- 172.21.15.135:0/1265924540 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700038e0 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.810+0000 7fb5797fa700 1 -- 172.21.15.135:0/1265924540 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb570003a40 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.810+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c0052f0 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.811+0000 7fb5797fa700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb56006ad10 0x7fb56006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.811+0000 7fb5797fa700 1 -- 172.21.15.135:0/1265924540 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb57008a9e0 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.815+0000 7fb57bfff700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb56006ad10 0x7fb56006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.818+0000 7fb57bfff700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb56006ad10 0x7fb56006d1d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb57c14ce70 tx=0x7fb568006c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.810+0000 7fc4b2bbb700 1 Processor -- start 2024-05-08T20:55:26.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.820+0000 7fb5797fa700 1 -- 172.21.15.135:0/1265924540 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb570055920 con 0x7fb57c0cb1e0 2024-05-08T20:55:26.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.819+0000 7fc4b2bbb700 1 -- start start 2024-05-08T20:55:26.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.820+0000 7fc4b2bbb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac1579b0 0x7fc4ac0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.820+0000 7fc4b2bbb700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fc4ac0c1830 0x7fc4ac0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.820+0000 7fc4b2bbb700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac0c54f0 con 0x7fc4ac15e2b0 2024-05-08T20:55:26.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.820+0000 7fc4b2bbb700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac157d90 con 0x7fc4ac0c1830 2024-05-08T20:55:26.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.820+0000 7fc4b2bbb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac15d600 con 0x7fc4ac1579b0 2024-05-08T20:55:26.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.821+0000 7fc4b1158700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc4ac15e2b0 0x7fc4ac0ca860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.135:59690/0 (socket says 172.21.15.135:59690) 2024-05-08T20:55:26.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.821+0000 7fc4b1158700 1 -- 172.21.15.135:0/621474125 learned_addr learned my addr 172.21.15.135:0/621474125 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:26.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4b0957700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac1579b0 0x7fc4ac0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4abfff700 1 --2- 172.21.15.135:0/621474125 >> v2:172.21.15.135:3300/0 conn(0x7fc4ac0c1830 0x7fc4ac0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846815867 0 0) 0x7fc4ac0c54f0 con 0x7fc4ac15e2b0 2024-05-08T20:55:26.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4940035b0 con 0x7fc4ac15e2b0 2024-05-08T20:55:26.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568379222 0 0) 0x7fc4940035b0 con 0x7fc4ac15e2b0 2024-05-08T20:55:26.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac1579b0 msgr2=0x7fc4ac0c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac1579b0 0x7fc4ac0c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 >> v2:172.21.15.135:3300/0 conn(0x7fc4ac0c1830 msgr2=0x7fc4ac0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 --2- 172.21.15.135:0/621474125 >> v2:172.21.15.135:3300/0 conn(0x7fc4ac0c1830 0x7fc4ac0c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0c77e0 con 0x7fc4ac15e2b0 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7fc4a40019f0 con 0x7fc4ac15e2b0 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 >> v1:172.21.15.183:6789/0 conn(0x7fc4ac15e2b0 legacy=0x7fc4ac0ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc494003a00 0x7fc494003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494004850 0x7fc494004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc494005210 0x7fc49400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac157d90 con 0x7fc494004850 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac15d600 con 0x7fc494003a00 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.822+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49400c060 con 0x7fc494005210 2024-05-08T20:55:26.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.823+0000 7fc4abfff700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494004850 0x7fc494004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.823+0000 7fc4abfff700 1 -- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc494005210 msgr2=0x7fc49400ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.823+0000 7fc4abfff700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc494005210 0x7fc49400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.823+0000 7fc4abfff700 1 -- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc494003a00 msgr2=0x7fc494003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:55:26.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.823+0000 7fc4abfff700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc494003a00 0x7fc494003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.823+0000 7fc4abfff700 1 -- 172.21.15.135:0/621474125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0c77e0 con 0x7fc494004850 2024-05-08T20:55:26.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.823+0000 7fc4abfff700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494004850 0x7fc494004cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009b30 tx=0x7fc494005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c20d844503190e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.824+0000 7fc4b0957700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac1579b0 0x7fc4ac0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:26.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.824+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000e6c0 con 0x7fc494004850 2024-05-08T20:55:26.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.824+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a000e820 con 0x7fc494004850 2024-05-08T20:55:26.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.824+0000 7fc4ab7fe700 1 -- 172.21.15.135:0/621474125 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000eb90 con 0x7fc494004850 2024-05-08T20:55:26.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.825+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/621474125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494004850 msgr2=0x7fc494004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:26.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.825+0000 7fc4b2bbb700 1 --2- 172.21.15.135:0/621474125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc494004850 0x7fc494004cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009b30 tx=0x7fc494005880 comp rx=0 tx=0).stop 2024-05-08T20:55:26.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.825+0000 7fc4b1158700 1 -- 172.21.15.135:0/621474125 reap_dead start 2024-05-08T20:55:26.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.827+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/621474125 shutdown_connections 2024-05-08T20:55:26.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.827+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/621474125 >> 172.21.15.135:0/621474125 conn(0x7fc4ac06a960 msgr2=0x7fc4ac06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:26.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.827+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/621474125 shutdown_connections 2024-05-08T20:55:26.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.827+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/621474125 wait complete. 2024-05-08T20:55:26.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.829+0000 7fc4b2bbb700 1 Processor -- start 2024-05-08T20:55:26.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.830+0000 7fc4b2bbb700 1 -- start start 2024-05-08T20:55:26.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.831+0000 7fc4b2bbb700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc494004850 0x7fc4ac15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.831+0000 7fc4b2bbb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4ac072270 0x7fc4ac136780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.831+0000 7fc4b2bbb700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac148e80 0x7fc4ac135040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.831+0000 7fc4b2bbb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac161640 con 0x7fc4ac072270 2024-05-08T20:55:26.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.831+0000 7fc4b2bbb700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac148700 con 0x7fc494004850 2024-05-08T20:55:26.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.831+0000 7fc4b2bbb700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac1373b0 con 0x7fc4ac148e80 2024-05-08T20:55:26.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4ac072270 0x7fc4ac136780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4ac072270 0x7fc4ac136780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33262/0 (socket says 172.21.15.135:33262) 2024-05-08T20:55:26.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 -- 172.21.15.135:0/3508198372 learned_addr learned my addr 172.21.15.135:0/3508198372 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:26.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 -- 172.21.15.135:0/3508198372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac148e80 msgr2=0x7fc4ac135040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:55:26.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac148e80 0x7fc4ac135040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 -- 172.21.15.135:0/3508198372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc494004850 msgr2=0x7fc4ac15a900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:55:26.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc494004850 0x7fc4ac15a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:26.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.832+0000 7fc4abfff700 1 -- 172.21.15.135:0/3508198372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac1498f0 con 0x7fc4ac072270 2024-05-08T20:55:26.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.833+0000 7fc4abfff700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4ac072270 0x7fc4ac136780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000e4b0 tx=0x7fc4a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.833+0000 7fc4a97fa700 1 -- 172.21.15.135:0/3508198372 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0021070 con 0x7fc4ac072270 2024-05-08T20:55:26.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.833+0000 7fc4a97fa700 1 -- 172.21.15.135:0/3508198372 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a00036a0 con 0x7fc4ac072270 2024-05-08T20:55:26.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.833+0000 7fc4a97fa700 1 -- 172.21.15.135:0/3508198372 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a000e6c0 con 0x7fc4ac072270 2024-05-08T20:55:26.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.834+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac1379c0 con 0x7fc4ac072270 2024-05-08T20:55:26.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.834+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac149610 con 0x7fc4ac072270 2024-05-08T20:55:26.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.837+0000 7fc4a97fa700 1 -- 172.21.15.135:0/3508198372 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc4a0003a50 con 0x7fc4ac072270 2024-05-08T20:55:26.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.837+0000 7fc4a97fa700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc49406c590 0x7fc49406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:26.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.837+0000 7fc4a97fa700 1 -- 172.21.15.135:0/3508198372 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4a008ad40 con 0x7fc4ac072270 2024-05-08T20:55:26.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.838+0000 7fc4b0957700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc49406c590 0x7fc49406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:26.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.839+0000 7fc4b0957700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc49406c590 0x7fc49406ea50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac06b720 tx=0x7fc49c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:26.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.844+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4900052f0 con 0x7fc4ac072270 2024-05-08T20:55:26.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:26.854+0000 7fc4a97fa700 1 -- 172.21.15.135:0/3508198372 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc4a0055dc0 con 0x7fc4ac072270 2024-05-08T20:55:27.189 INFO:teuthology.orchestra.run.smithi135.stdout:55834574858 2024-05-08T20:55:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.183+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effbc067fa0 con 0x7effbc06d610 2024-05-08T20:55:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.184+0000 7effa37fe700 1 -- 172.21.15.135:0/1959588121 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effb0058140 con 0x7effbc06d610 2024-05-08T20:55:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.187+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7effa806ad10 msgr2=0x7effa806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.187+0000 7effc17ed700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7effa806ad10 0x7effa806d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7effb400b370 tx=0x7effb4009000 comp rx=0 tx=0).stop 2024-05-08T20:55:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.187+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc06d610 msgr2=0x7effbc158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.187+0000 7effc17ed700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc06d610 0x7effbc158100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7effb000e8a0 tx=0x7effb000ebb0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.190+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 shutdown_connections 2024-05-08T20:55:27.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.190+0000 7effc17ed700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7effa806ad10 0x7effa806d1d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.190+0000 7effc17ed700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effbc06d610 0x7effbc158100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.190+0000 7effc17ed700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effbc157be0 0x7effbc1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.190+0000 7effc17ed700 1 --2- 172.21.15.135:0/1959588121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effbc0c5fa0 0x7effbc1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.190+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 >> 172.21.15.135:0/1959588121 conn(0x7effbc0cb200 msgr2=0x7effbc156360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.194+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 shutdown_connections 2024-05-08T20:55:27.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.194+0000 7effc17ed700 1 -- 172.21.15.135:0/1959588121 wait complete. 2024-05-08T20:55:27.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.194+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44ec070b70 con 0x7f44ec072770 2024-05-08T20:55:27.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.196+0000 7f44e97fa700 1 -- 172.21.15.135:0/2225855866 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44e00578a0 con 0x7f44ec072770 2024-05-08T20:55:27.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.196+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b940cb210 con 0x7f1b941671b0 2024-05-08T20:55:27.199 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:27.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.197+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5fcc0681a0 con 0x7f5fcc15e190 2024-05-08T20:55:27.199 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:27.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.196+0000 7f1b90ff9700 1 -- 172.21.15.135:0/189662625 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b940cb210 con 0x7f1b941671b0 2024-05-08T20:55:27.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.198+0000 7f5fc97fa700 1 -- 172.21.15.135:0/3802258294 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5fc4017020 con 0x7f5fcc15e190 2024-05-08T20:55:27.203 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:27.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1b8006ad10 msgr2=0x7f1b8006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1b8006ad10 0x7f1b8006d1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1b940cb8c0 tx=0x7f1b84007a40 comp rx=0 tx=0).stop 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b941671b0 msgr2=0x7f1b941f18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b941671b0 0x7f1b941f18c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b88016fd0 tx=0x7f1b88004750 comp rx=0 tx=0).stop 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 shutdown_connections 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1b8006ad10 0x7f1b8006d1d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9415ed70 0x7f1b9415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b940ca840 0x7f1b941fcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 --2- 172.21.15.135:0/189662625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b941671b0 0x7f1b941f18c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 >> 172.21.15.135:0/189662625 conn(0x7f1b9406a960 msgr2=0x7f1b94160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.201+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 shutdown_connections 2024-05-08T20:55:27.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f1b9a9d0700 1 -- 172.21.15.135:0/189662625 wait complete. 2024-05-08T20:55:27.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5fb806ad60 msgr2=0x7f5fb806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5fb806ad60 0x7f5fb806d220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009770 tx=0x7f5fc0006cd0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fcc15e190 msgr2=0x7f5fcc1f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fcc15e190 0x7f5fcc1f3c60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4014000 tx=0x7f5fc4004ad0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 shutdown_connections 2024-05-08T20:55:27.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5fb806ad60 0x7f5fb806d220 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009770 tx=0x7f5fc0006cd0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5fcc15e190 0x7f5fcc1f3c60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fcc0c1830 0x7f5fcc0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 --2- 172.21.15.135:0/3802258294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5fcc1579b0 0x7f5fcc1ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 >> 172.21.15.135:0/3802258294 conn(0x7f5fcc06a960 msgr2=0x7f5fcc071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f44d006ad90 msgr2=0x7f44d006d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f44f3149700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f44d006ad90 0x7f44d006d250 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44d8009910 tx=0x7f44d8008040 comp rx=0 tx=0).stop 2024-05-08T20:55:27.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44ec072770 msgr2=0x7f44ec1513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f44f3149700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44ec072770 0x7f44ec1513b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44e0001eb0 tx=0x7f44e000c8b0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2a38067fa0 con 0x7f2a38157c40 2024-05-08T20:55:27.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.202+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 shutdown_connections 2024-05-08T20:55:27.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.203+0000 7f5fd31be700 1 -- 172.21.15.135:0/3802258294 wait complete. 2024-05-08T20:55:27.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.204+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 shutdown_connections 2024-05-08T20:55:27.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.204+0000 7f44f3149700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f44d006ad90 0x7f44d006d250 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.204+0000 7f44f3149700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44ec072390 0x7f44ec150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.204+0000 7f44f3149700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44ec0b1c70 0x7f44ec0c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.204+0000 7f44f3149700 1 --2- 172.21.15.135:0/2225855866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44ec072770 0x7f44ec1513b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.204+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 >> 172.21.15.135:0/2225855866 conn(0x7f44ec06ec40 msgr2=0x7f44ec0c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.207+0000 7f2a2effd700 1 -- 172.21.15.135:0/2049386111 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a30057bb0 con 0x7f2a38157c40 2024-05-08T20:55:27.212 INFO:teuthology.orchestra.run.smithi135.stdout:55834574859 2024-05-08T20:55:27.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.213+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 shutdown_connections 2024-05-08T20:55:27.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.213+0000 7f44f3149700 1 -- 172.21.15.135:0/2225855866 wait complete. 2024-05-08T20:55:27.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-05-08T20:55:27.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.216+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f2a1c06ac90 msgr2=0x7f2a1c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.216+0000 7f2a40350700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f2a1c06ac90 0x7f2a1c06d150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009710 tx=0x7f2a28006c40 comp rx=0 tx=0).stop 2024-05-08T20:55:27.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.216+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a38157c40 msgr2=0x7f2a380cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.216+0000 7f2a40350700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a38157c40 0x7f2a380cd4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a3000cb50 tx=0x7f2a3000cf10 comp rx=0 tx=0).stop 2024-05-08T20:55:27.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.217+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 shutdown_connections 2024-05-08T20:55:27.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.217+0000 7f2a40350700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f2a1c06ac90 0x7f2a1c06d150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.217+0000 7f2a40350700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a38157c40 0x7f2a380cd4c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.217+0000 7f2a40350700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a380c2970 0x7f2a3813e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.217+0000 7f2a40350700 1 --2- 172.21.15.135:0/2049386111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a38157860 0x7f2a380ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.217+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 >> 172.21.15.135:0/2049386111 conn(0x7f2a3806a960 msgr2=0x7f2a3806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.218+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 shutdown_connections 2024-05-08T20:55:27.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.218+0000 7f2a40350700 1 -- 172.21.15.135:0/2049386111 wait complete. 2024-05-08T20:55:27.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.221+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb55c005870 con 0x7fb57c0cb1e0 2024-05-08T20:55:27.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.222+0000 7fb5797fa700 1 -- 172.21.15.135:0/1265924540 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb570058f40 con 0x7fb57c0cb1e0 2024-05-08T20:55:27.226 INFO:teuthology.orchestra.run.smithi135.stdout:55834574858 2024-05-08T20:55:27.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-05-08T20:55:27.229 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:27.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.228+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f903c149c50 con 0x7f903c14a570 2024-05-08T20:55:27.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.228+0000 7f90397fa700 1 -- 172.21.15.135:0/4033762790 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f903400bdb0 con 0x7f903c14a570 2024-05-08T20:55:27.230 INFO:teuthology.orchestra.run.smithi135.stdout:55834574858 2024-05-08T20:55:27.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-05-08T20:55:27.231 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:27.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.230+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb56006ad10 msgr2=0x7fb56006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.230+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb56006ad10 0x7fb56006d1d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb57c14ce70 tx=0x7fb568006c80 comp rx=0 tx=0).stop 2024-05-08T20:55:27.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.230+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cb1e0 msgr2=0x7fb57c0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.230+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cb1e0 0x7fb57c0c9c60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb570009c10 tx=0x7fb570004750 comp rx=0 tx=0).stop 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 shutdown_connections 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb56006ad10 0x7fb56006d1d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb57c156990 0x7fb57c14b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb57c0cb1e0 0x7fb57c0c9c60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 --2- 172.21.15.135:0/1265924540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb57c153f80 0x7fb57c14b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 >> 172.21.15.135:0/1265924540 conn(0x7fb57c06a960 msgr2=0x7fb57c0c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 shutdown_connections 2024-05-08T20:55:27.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.231+0000 7fb582eb9700 1 -- 172.21.15.135:0/1265924540 wait complete. 2024-05-08T20:55:27.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f902006ad60 msgr2=0x7f902006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f902006ad60 0x7f902006d220 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f903000c370 tx=0x7f903000a000 comp rx=0 tx=0).stop 2024-05-08T20:55:27.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903c14a570 msgr2=0x7f903c152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903c14a570 0x7f903c152560 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f903c070c50 tx=0x7f903400ee50 comp rx=0 tx=0).stop 2024-05-08T20:55:27.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 shutdown_connections 2024-05-08T20:55:27.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f902006ad60 0x7f902006d220 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f903c14a570 0x7f903c152560 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f902c003a00 0x7f903c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 --2- 172.21.15.135:0/4033762790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f903c1549d0 0x7f903c1536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 >> 172.21.15.135:0/4033762790 conn(0x7f903c0cb200 msgr2=0x7f903c0cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 shutdown_connections 2024-05-08T20:55:27.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.232+0000 7f9042ad2700 1 -- 172.21.15.135:0/4033762790 wait complete. 2024-05-08T20:55:27.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-05-08T20:55:27.238 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:27.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-05-08T20:55:27.241 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:27.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-05-08T20:55:27.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-05-08T20:55:27.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.259+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4900055a0 con 0x7fc4ac072270 2024-05-08T20:55:27.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.259+0000 7fc4a97fa700 1 -- 172.21.15.135:0/3508198372 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4a0017090 con 0x7fc4ac072270 2024-05-08T20:55:27.261 INFO:teuthology.orchestra.run.smithi135.stdout:55834574860 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc49406c590 msgr2=0x7fc49406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc49406c590 0x7fc49406ea50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac06b720 tx=0x7fc49c008040 comp rx=0 tx=0).stop 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4ac072270 msgr2=0x7fc4ac136780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4ac072270 0x7fc4ac136780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000e4b0 tx=0x7fc4a00047c0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 shutdown_connections 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc49406c590 0x7fc49406ea50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc494004850 0x7fc4ac15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4ac148e80 0x7fc4ac135040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 --2- 172.21.15.135:0/3508198372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4ac072270 0x7fc4ac136780 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 >> 172.21.15.135:0/3508198372 conn(0x7fc4ac06a960 msgr2=0x7fc4ac146480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:27.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 shutdown_connections 2024-05-08T20:55:27.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:27.262+0000 7fc4b2bbb700 1 -- 172.21.15.135:0/3508198372 wait complete. 2024-05-08T20:55:27.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2024-05-08T20:55:27.276 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:28.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T20:55:28.250 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T20:55:28.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T20:55:28.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.354+0000 7f098fd1d700 1 Processor -- start 2024-05-08T20:55:28.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.355+0000 7f098fd1d700 1 -- start start 2024-05-08T20:55:28.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.355+0000 7f098fd1d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f09880cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.355+0000 7f098fd1d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09880c6900 con 0x7f09880c6d90 2024-05-08T20:55:28.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.355+0000 7f098fd1d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098806ab00 con 0x7f09880b1bc0 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098fd1d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880ccab0 con 0x7f09880c26f0 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098e2ba700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f09880c6d90 0x7f0988161a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59876/0 (socket says 172.21.15.135:59876) 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098e2ba700 1 -- 172.21.15.135:0/85363136 learned_addr learned my addr 172.21.15.135:0/85363136 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098dab9700 1 --2- 172.21.15.135:0/85363136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f09880cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098cab7700 1 -- 172.21.15.135:0/85363136 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791883239 0 0) 0x7f09880c6900 con 0x7f09880c6d90 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098cab7700 1 -- 172.21.15.135:0/85363136 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09740035b0 con 0x7f09880c6d90 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098cab7700 1 -- 172.21.15.135:0/85363136 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566848953 0 0) 0x7f098806ab00 con 0x7f09880b1bc0 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098cab7700 1 -- 172.21.15.135:0/85363136 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09880c6900 con 0x7f09880b1bc0 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098dab9700 1 -- 172.21.15.135:0/85363136 >> v1:172.21.15.183:6789/0 conn(0x7f09880b1bc0 legacy=0x7f09880c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098dab9700 1 -- 172.21.15.135:0/85363136 >> v1:172.21.15.135:6789/0 conn(0x7f09880c6d90 legacy=0x7f0988161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098dab9700 1 -- 172.21.15.135:0/85363136 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098806ade0 con 0x7f09880c26f0 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.356+0000 7f098dab9700 1 --2- 172.21.15.135:0/85363136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f09880cc170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0984009870 tx=0x7f0984009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad82c5de133578c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098cab7700 1 -- 172.21.15.135:0/85363136 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011830 con 0x7f09880c26f0 2024-05-08T20:55:28.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098cab7700 1 -- 172.21.15.135:0/85363136 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984011990 con 0x7f09880c26f0 2024-05-08T20:55:28.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098cab7700 1 -- 172.21.15.135:0/85363136 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984011d20 con 0x7f09880c26f0 2024-05-08T20:55:28.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098fd1d700 1 -- 172.21.15.135:0/85363136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 msgr2=0x7f09880cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098fd1d700 1 --2- 172.21.15.135:0/85363136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f09880cc170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0984009870 tx=0x7f0984009b80 comp rx=0 tx=0).stop 2024-05-08T20:55:28.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098fd1d700 1 -- 172.21.15.135:0/85363136 shutdown_connections 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098fd1d700 1 --2- 172.21.15.135:0/85363136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f09880cc170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098fd1d700 1 -- 172.21.15.135:0/85363136 >> 172.21.15.135:0/85363136 conn(0x7f098806ec40 msgr2=0x7f098806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098fd1d700 1 -- 172.21.15.135:0/85363136 shutdown_connections 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.357+0000 7f098fd1d700 1 -- 172.21.15.135:0/85363136 wait complete. 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 Processor -- start 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 -- start start 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09880b1bc0 0x7f0988155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f0988145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09880c6d90 0x7f09880c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09881e3b20 con 0x7f09880c6d90 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09881557c0 con 0x7f09880b1bc0 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.359+0000 7f098fd1d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09881e2b10 con 0x7f09880c26f0 2024-05-08T20:55:28.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09880c6d90 0x7f09880c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09880c6d90 0x7f09880c4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33272/0 (socket says 172.21.15.135:33272) 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 -- 172.21.15.135:0/172680330 learned_addr learned my addr 172.21.15.135:0/172680330 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098dab9700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09880b1bc0 0x7f0988155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098d2b8700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f0988145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 -- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 msgr2=0x7f0988145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f0988145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 -- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09880b1bc0 msgr2=0x7f0988155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09880b1bc0 0x7f0988155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 -- 172.21.15.135:0/172680330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840094a0 con 0x7f09880c6d90 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098e2ba700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09880c6d90 0x7f09880c4080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f098000cba0 tx=0x7f098000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f097e7fc700 1 -- 172.21.15.135:0/172680330 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000a980 con 0x7f09880c6d90 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f097e7fc700 1 -- 172.21.15.135:0/172680330 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000aae0 con 0x7f09880c6d90 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09881e1a50 con 0x7f09880c6d90 2024-05-08T20:55:28.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09881e3040 con 0x7f09880c6d90 2024-05-08T20:55:28.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.360+0000 7f097e7fc700 1 -- 172.21.15.135:0/172680330 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000ae50 con 0x7f09880c6d90 2024-05-08T20:55:28.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.361+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09700052f0 con 0x7f09880c6d90 2024-05-08T20:55:28.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.362+0000 7f097e7fc700 1 -- 172.21.15.135:0/172680330 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f098001b3b0 con 0x7f09880c6d90 2024-05-08T20:55:28.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.362+0000 7f097e7fc700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f096c06ac90 0x7f096c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.363+0000 7f098dab9700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f096c06ac90 0x7f096c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.363+0000 7f097e7fc700 1 -- 172.21.15.135:0/172680330 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0980089090 con 0x7f09880c6d90 2024-05-08T20:55:28.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.363+0000 7f098dab9700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f096c06ac90 0x7f096c06d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09840097c0 tx=0x7f098401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.367+0000 7f097e7fc700 1 -- 172.21.15.135:0/172680330 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0980057af0 con 0x7f09880c6d90 2024-05-08T20:55:28.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.394+0000 7f1437458700 1 Processor -- start 2024-05-08T20:55:28.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.394+0000 7fd0268d5700 1 Processor -- start 2024-05-08T20:55:28.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.394+0000 7fd0268d5700 1 -- start start 2024-05-08T20:55:28.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.394+0000 7f1437458700 1 -- start start 2024-05-08T20:55:28.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd0268d5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd020072390 0x7fd0200b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1437458700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14300ca0e0 0x7f14300c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1437458700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1430159590 con 0x7f14300c9b50 2024-05-08T20:55:28.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1437458700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143006c350 con 0x7f14300ce380 2024-05-08T20:55:28.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1437458700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1430159850 con 0x7f14300ca0e0 2024-05-08T20:55:28.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd0268d5700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0200c1540 con 0x7fd020156050 2024-05-08T20:55:28.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd0268d5700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0200c6670 con 0x7fd020072770 2024-05-08T20:55:28.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd0268d5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0200c19d0 con 0x7fd020072390 2024-05-08T20:55:28.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f14359f5700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f14300c9b50 0x7f14300cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59882/0 (socket says 172.21.15.135:59882) 2024-05-08T20:55:28.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f14359f5700 1 -- 172.21.15.135:0/3544740125 learned_addr learned my addr 172.21.15.135:0/3544740125 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd024e72700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd020156050 0x7fd02014fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59890/0 (socket says 172.21.15.135:59890) 2024-05-08T20:55:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd024e72700 1 -- 172.21.15.135:0/4110248359 learned_addr learned my addr 172.21.15.135:0/4110248359 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711514570 0 0) 0x7fd0200c1540 con 0x7fd020156050 2024-05-08T20:55:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0080057c0 con 0x7fd020156050 2024-05-08T20:55:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537866655 0 0) 0x7f1430159590 con 0x7f14300c9b50 2024-05-08T20:55:28.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f141c0035b0 con 0x7f14300c9b50 2024-05-08T20:55:28.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115625382 0 0) 0x7fd0200c6670 con 0x7fd020072770 2024-05-08T20:55:28.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0200c1540 con 0x7fd020072770 2024-05-08T20:55:28.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266455886 0 0) 0x7f143006c350 con 0x7f14300ce380 2024-05-08T20:55:28.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1430159590 con 0x7f14300ce380 2024-05-08T20:55:28.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708363250 0 0) 0x7fd0080057c0 con 0x7fd020156050 2024-05-08T20:55:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 >> v2:172.21.15.183:3300/0 conn(0x7fd020072390 msgr2=0x7fd0200b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 --2- 172.21.15.135:0/4110248359 >> v2:172.21.15.183:3300/0 conn(0x7fd020072390 0x7fd0200b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 >> v1:172.21.15.183:6789/0 conn(0x7fd020072770 legacy=0x7fd0200cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200c6930 con 0x7fd020156050 2024-05-08T20:55:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7fd0180019f0 con 0x7fd020156050 2024-05-08T20:55:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1489212721 0 0) 0x7f141c0035b0 con 0x7f14300c9b50 2024-05-08T20:55:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14300ca0e0 msgr2=0x7f14300c9610 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:55:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 >> v1:172.21.15.135:6789/0 conn(0x7fd020156050 legacy=0x7fd02014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.395+0000 7f1427fff700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f14300ca0e0 0x7f14300c9610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 >> v1:172.21.15.183:6789/0 conn(0x7f14300ce380 legacy=0x7f143006baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01effd700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd008005da0 0x7fd0080061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430159b30 con 0x7f14300c9b50 2024-05-08T20:55:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01effd700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd008006a60 0x7fd008006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01effd700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008007490 0x7fd00800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f14280019f0 con 0x7f14300c9b50 2024-05-08T20:55:28.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200c19d0 con 0x7fd008005da0 2024-05-08T20:55:28.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00800e350 con 0x7fd008006a60 2024-05-08T20:55:28.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00800e510 con 0x7fd008007490 2024-05-08T20:55:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 >> v1:172.21.15.135:6789/0 conn(0x7f14300c9b50 legacy=0x7f14300cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c003bc0 0x7f141c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f141c004850 0x7f141c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141c005210 0x7f141c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430159850 con 0x7f141c003bc0 2024-05-08T20:55:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c00c140 con 0x7f141c005210 2024-05-08T20:55:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c00c300 con 0x7f141c004850 2024-05-08T20:55:28.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01f7fe700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd008006a60 0x7fd008006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14351f4700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c003bc0 0x7f141c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14359f5700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141c005210 0x7f141c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14349f3700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f141c004850 0x7f141c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd024e72700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008007490 0x7fd00800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01ffff700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd008005da0 0x7fd0080061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01f7fe700 1 -- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008007490 msgr2=0x7fd00800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01f7fe700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008007490 0x7fd00800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01f7fe700 1 -- 172.21.15.135:0/4110248359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd008005da0 msgr2=0x7fd0080061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01f7fe700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd008005da0 0x7fd0080061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01f7fe700 1 -- 172.21.15.135:0/4110248359 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200c6930 con 0x7fd008006a60 2024-05-08T20:55:28.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd024e72700 1 -- 172.21.15.135:0/4110248359 reap_dead start 2024-05-08T20:55:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14359f5700 1 -- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f141c004850 msgr2=0x7f141c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14359f5700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f141c004850 0x7f141c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14359f5700 1 -- 172.21.15.135:0/3544740125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c003bc0 msgr2=0x7f141c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14359f5700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c003bc0 0x7f141c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14359f5700 1 -- 172.21.15.135:0/3544740125 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430159b30 con 0x7f141c005210 2024-05-08T20:55:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14349f3700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f141c004850 0x7f141c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7fd01f7fe700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd008006a60 0x7fd008006ee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd020072b80 tx=0x7fd008007a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b0efc6bbd80fb19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.396+0000 7f14359f5700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141c005210 0x7f141c00ba10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f142800a930 tx=0x7f141c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e5600f6875b6fa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014001430 con 0x7fd008006a60 2024-05-08T20:55:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0140052f0 con 0x7fd008006a60 2024-05-08T20:55:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7fd01effd700 1 -- 172.21.15.135:0/4110248359 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014001d40 con 0x7fd008006a60 2024-05-08T20:55:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428012600 con 0x7f141c005210 2024-05-08T20:55:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1428012760 con 0x7f141c005210 2024-05-08T20:55:28.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7f1427fff700 1 -- 172.21.15.135:0/3544740125 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428012b10 con 0x7f141c005210 2024-05-08T20:55:28.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7fd0268d5700 1 -- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd008006a60 msgr2=0x7fd008006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7fd0268d5700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd008006a60 0x7fd008006ee0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd020072b80 tx=0x7fd008007a90 comp rx=0 tx=0).stop 2024-05-08T20:55:28.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7f1437458700 1 -- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141c005210 msgr2=0x7f141c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.397+0000 7f1437458700 1 --2- 172.21.15.135:0/3544740125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f141c005210 0x7f141c00ba10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f142800a930 tx=0x7f141c005880 comp rx=0 tx=0).stop 2024-05-08T20:55:28.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7fd0268d5700 1 -- 172.21.15.135:0/4110248359 shutdown_connections 2024-05-08T20:55:28.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7f14359f5700 1 -- 172.21.15.135:0/3544740125 reap_dead start 2024-05-08T20:55:28.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7fd0268d5700 1 --2- 172.21.15.135:0/4110248359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd008006a60 0x7fd008006ee0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7fd0268d5700 1 -- 172.21.15.135:0/4110248359 >> 172.21.15.135:0/4110248359 conn(0x7fd02006ec40 msgr2=0x7fd02006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:28.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7f1437458700 1 -- 172.21.15.135:0/3544740125 shutdown_connections 2024-05-08T20:55:28.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7f1437458700 1 -- 172.21.15.135:0/3544740125 >> 172.21.15.135:0/3544740125 conn(0x7f14300cec90 msgr2=0x7f14300cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:28.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7fd0268d5700 1 -- 172.21.15.135:0/4110248359 shutdown_connections 2024-05-08T20:55:28.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7f1437458700 1 -- 172.21.15.135:0/3544740125 shutdown_connections 2024-05-08T20:55:28.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7fd0268d5700 1 -- 172.21.15.135:0/4110248359 wait complete. 2024-05-08T20:55:28.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.398+0000 7f1437458700 1 -- 172.21.15.135:0/3544740125 wait complete. 2024-05-08T20:55:28.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.399+0000 7fd0268d5700 1 Processor -- start 2024-05-08T20:55:28.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.399+0000 7f1437458700 1 Processor -- start 2024-05-08T20:55:28.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.399+0000 7f1437458700 1 -- start start 2024-05-08T20:55:28.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.399+0000 7fd0268d5700 1 -- start start 2024-05-08T20:55:28.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f1437458700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c005210 0x7f14301f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f1437458700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1430152ae0 0x7f14301f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f1437458700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14301f0fb0 0x7f14301f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f1437458700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300b0b70 con 0x7f141c005210 2024-05-08T20:55:28.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f1437458700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143014fe90 con 0x7f14301f0fb0 2024-05-08T20:55:28.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f1437458700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300b1230 con 0x7f1430152ae0 2024-05-08T20:55:28.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c005210 0x7f14301f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd0268d5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008006a60 0x7fd02006b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd0268d5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02014a110 0x7fd0201f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd0268d5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0200c5ba0 0x7fd02014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c005210 0x7f14301f25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33284/0 (socket says 172.21.15.135:33284) 2024-05-08T20:55:28.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 -- 172.21.15.135:0/3174366319 learned_addr learned my addr 172.21.15.135:0/3174366319 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:28.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd0268d5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0201510f0 con 0x7fd02014a110 2024-05-08T20:55:28.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd0268d5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02014ae90 con 0x7fd0200c5ba0 2024-05-08T20:55:28.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd0268d5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02014a8d0 con 0x7fd008006a60 2024-05-08T20:55:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14349f3700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1430152ae0 0x7f14301f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14359f5700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14301f0fb0 0x7f14301f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008006a60 0x7fd02006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd024e72700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0200c5ba0 0x7fd02014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008006a60 0x7fd02006b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50494/0 (socket says 172.21.15.135:50494) 2024-05-08T20:55:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01ffff700 1 -- 172.21.15.135:0/1152206019 learned_addr learned my addr 172.21.15.135:0/1152206019 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:28.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 -- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1430152ae0 msgr2=0x7f14301f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1430152ae0 0x7f14301f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 -- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14301f0fb0 msgr2=0x7f14301f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14301f0fb0 0x7f14301f1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7f14351f4700 1 -- 172.21.15.135:0/3174366319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14301f1970 con 0x7f141c005210 2024-05-08T20:55:28.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01f7fe700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02014a110 0x7fd0201f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01ffff700 1 -- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0200c5ba0 msgr2=0x7fd02014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01ffff700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0200c5ba0 0x7fd02014c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01ffff700 1 -- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02014a110 msgr2=0x7fd0201f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.400+0000 7fd01ffff700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02014a110 0x7fd0201f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd01ffff700 1 -- 172.21.15.135:0/1152206019 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02014abb0 con 0x7fd008006a60 2024-05-08T20:55:28.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd024e72700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0200c5ba0 0x7fd02014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:55:28.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7f14351f4700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c005210 0x7f14301f25d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f142c00f7f0 tx=0x7f142c00fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd01ffff700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008006a60 0x7fd02006b440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd01000d800 tx=0x7fd01000db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7f1425ffb700 1 -- 172.21.15.135:0/3174366319 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0052e0 con 0x7f141c005210 2024-05-08T20:55:28.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7f1425ffb700 1 -- 172.21.15.135:0/3174366319 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c005460 con 0x7f141c005210 2024-05-08T20:55:28.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14301f3100 con 0x7f141c005210 2024-05-08T20:55:28.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7f1425ffb700 1 -- 172.21.15.135:0/3174366319 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0038c0 con 0x7f141c005210 2024-05-08T20:55:28.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd01cff9700 1 -- 172.21.15.135:0/1152206019 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010017070 con 0x7fd008006a60 2024-05-08T20:55:28.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd01cff9700 1 -- 172.21.15.135:0/1152206019 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010004020 con 0x7fd008006a60 2024-05-08T20:55:28.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd01cff9700 1 -- 172.21.15.135:0/1152206019 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0100041b0 con 0x7fd008006a60 2024-05-08T20:55:28.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0201f2480 con 0x7fd008006a60 2024-05-08T20:55:28.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0200c6150 con 0x7fd008006a60 2024-05-08T20:55:28.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.401+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14301f04d0 con 0x7f141c005210 2024-05-08T20:55:28.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.402+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0201f2ad0 con 0x7fd008006a60 2024-05-08T20:55:28.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14301571f0 con 0x7f141c005210 2024-05-08T20:55:28.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7f1425ffb700 1 -- 172.21.15.135:0/3174366319 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f142c003a20 con 0x7f141c005210 2024-05-08T20:55:28.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7fd01cff9700 1 -- 172.21.15.135:0/1152206019 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd010004310 con 0x7fd008006a60 2024-05-08T20:55:28.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7f1425ffb700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f141406ac90 0x7f141406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7fd01cff9700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd00c06ac90 0x7fd00c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7f14349f3700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f141406ac90 0x7f141406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7fd01f7fe700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd00c06ac90 0x7fd00c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.403+0000 7fd01cff9700 1 -- 172.21.15.135:0/1152206019 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd010088f40 con 0x7fd008006a60 2024-05-08T20:55:28.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.404+0000 7f14349f3700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f141406ac90 0x7f141406d150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f14300ae540 tx=0x7f1420008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.404+0000 7fd01f7fe700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd00c06ac90 0x7fd00c06d150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd014000c00 tx=0x7fd01400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.408+0000 7fd01cff9700 1 -- 172.21.15.135:0/1152206019 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd010053e30 con 0x7fd008006a60 2024-05-08T20:55:28.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.408+0000 7f1425ffb700 1 -- 172.21.15.135:0/3174366319 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f142c01a310 con 0x7f141c005210 2024-05-08T20:55:28.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.408+0000 7f1425ffb700 1 -- 172.21.15.135:0/3174366319 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f142c053a80 con 0x7f141c005210 2024-05-08T20:55:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.594+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09700055a0 con 0x7f09880c6d90 2024-05-08T20:55:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.595+0000 7f097e7fc700 1 -- 172.21.15.135:0/172680330 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0980057680 con 0x7f09880c6d90 2024-05-08T20:55:28.597 INFO:teuthology.orchestra.run.smithi135.stdout:55834574860 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f096c06ac90 msgr2=0x7f096c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f096c06ac90 0x7f096c06d150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09840097c0 tx=0x7f098401c040 comp rx=0 tx=0).stop 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09880c6d90 msgr2=0x7f09880c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09880c6d90 0x7f09880c4080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f098000cba0 tx=0x7f098000ceb0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 shutdown_connections 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f096c06ac90 0x7f096c06d150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09880b1bc0 0x7f0988155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09880c6d90 0x7f09880c4080 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 --2- 172.21.15.135:0/172680330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09880c26f0 0x7f0988145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 >> 172.21.15.135:0/172680330 conn(0x7f098806ec40 msgr2=0x7f09880c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:28.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 shutdown_connections 2024-05-08T20:55:28.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.597+0000 7f098fd1d700 1 -- 172.21.15.135:0/172680330 wait complete. 2024-05-08T20:55:28.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.2 2024-05-08T20:55:28.611 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:28.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.617+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f14300671d0 con 0x7f141c005210 2024-05-08T20:55:28.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.618+0000 7f1425ffb700 1 -- 172.21.15.135:0/3174366319 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f142c0570a0 con 0x7f141c005210 2024-05-08T20:55:28.620 INFO:teuthology.orchestra.run.smithi135.stdout:55834574860 2024-05-08T20:55:28.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f141406ac90 msgr2=0x7f141406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f141406ac90 0x7f141406d150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f14300ae540 tx=0x7f1420008040 comp rx=0 tx=0).stop 2024-05-08T20:55:28.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c005210 msgr2=0x7f14301f25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c005210 0x7f14301f25d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f142c00f7f0 tx=0x7f142c00fb00 comp rx=0 tx=0).stop 2024-05-08T20:55:28.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 shutdown_connections 2024-05-08T20:55:28.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f141406ac90 0x7f141406d150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14301f0fb0 0x7f14301f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f141c005210 0x7f14301f25d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 --2- 172.21.15.135:0/3174366319 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1430152ae0 0x7f14301f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 >> 172.21.15.135:0/3174366319 conn(0x7f14300cec90 msgr2=0x7f14300c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 shutdown_connections 2024-05-08T20:55:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.620+0000 7f1437458700 1 -- 172.21.15.135:0/3174366319 wait complete. 2024-05-08T20:55:28.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.5 2024-05-08T20:55:28.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.632+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd020067fa0 con 0x7fd008006a60 2024-05-08T20:55:28.635 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:28.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.633+0000 7fd01cff9700 1 -- 172.21.15.135:0/1152206019 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd010057450 con 0x7fd008006a60 2024-05-08T20:55:28.635 INFO:teuthology.orchestra.run.smithi135.stdout:55834574860 2024-05-08T20:55:28.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd00c06ac90 msgr2=0x7fd00c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd00c06ac90 0x7fd00c06d150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd014000c00 tx=0x7fd01400a000 comp rx=0 tx=0).stop 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008006a60 msgr2=0x7fd02006b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008006a60 0x7fd02006b440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd01000d800 tx=0x7fd01000db10 comp rx=0 tx=0).stop 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 shutdown_connections 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd00c06ac90 0x7fd00c06d150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0200c5ba0 0x7fd02014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd008006a60 0x7fd02006b440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 --2- 172.21.15.135:0/1152206019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd02014a110 0x7fd0201f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.635+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 >> 172.21.15.135:0/1152206019 conn(0x7fd02006ec40 msgr2=0x7fd0201564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.636+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 shutdown_connections 2024-05-08T20:55:28.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.636+0000 7fd0268d5700 1 -- 172.21.15.135:0/1152206019 wait complete. 2024-05-08T20:55:28.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.6 2024-05-08T20:55:28.649 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:28.649 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T20:55:28.650 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:55:28.733 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:28.736 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:28.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.812+0000 7f028733b700 1 Processor -- start 2024-05-08T20:55:28.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.812+0000 7f028733b700 1 -- start start 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f028733b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02800c7dc0 0x7f02800c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f028733b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02800ca080 0x7f02800c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f028733b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02800c96b0 con 0x7f0280151400 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f028733b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0280157ab0 con 0x7f02800ca080 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f028733b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0280157d70 con 0x7f02800c7dc0 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f02858d8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f02800ca080 0x7f02800c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f02850d7700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0280151400 0x7f0280157220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59894/0 (socket says 172.21.15.135:59894) 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f02850d7700 1 -- 172.21.15.135:0/1630060135 learned_addr learned my addr 172.21.15.135:0/1630060135 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.813+0000 7f02848d6700 1 --2- 172.21.15.135:0/1630060135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02800c7dc0 0x7f02800c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f0277fff700 1 -- 172.21.15.135:0/1630060135 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708491888 0 0) 0x7f02800c96b0 con 0x7f0280151400 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f0277fff700 1 -- 172.21.15.135:0/1630060135 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c0035b0 con 0x7f0280151400 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f02858d8700 1 -- 172.21.15.135:0/1630060135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02800c7dc0 msgr2=0x7f02800c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f02858d8700 1 --2- 172.21.15.135:0/1630060135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02800c7dc0 0x7f02800c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f02858d8700 1 -- 172.21.15.135:0/1630060135 >> v1:172.21.15.135:6789/0 conn(0x7f0280151400 legacy=0x7f0280157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f02858d8700 1 -- 172.21.15.135:0/1630060135 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0280158050 con 0x7f02800ca080 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f02858d8700 1 --2- 172.21.15.135:0/1630060135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02800c8560 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0278009d90 tx=0x7f027800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f428741ec7213a8b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f0277fff700 1 -- 172.21.15.135:0/1630060135 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800e070 con 0x7f02800ca080 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f0277fff700 1 -- 172.21.15.135:0/1630060135 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027800bb20 con 0x7f02800ca080 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f0277fff700 1 -- 172.21.15.135:0/1630060135 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800be90 con 0x7f02800ca080 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f028733b700 1 -- 172.21.15.135:0/1630060135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 msgr2=0x7f02800c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.814+0000 7f028733b700 1 --2- 172.21.15.135:0/1630060135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02800c8560 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0278009d90 tx=0x7f027800b330 comp rx=0 tx=0).stop 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.815+0000 7f028733b700 1 -- 172.21.15.135:0/1630060135 shutdown_connections 2024-05-08T20:55:28.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.815+0000 7f028733b700 1 --2- 172.21.15.135:0/1630060135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02800c8560 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.815+0000 7f028733b700 1 --2- 172.21.15.135:0/1630060135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02800c7dc0 0x7f02800c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.815+0000 7f028733b700 1 -- 172.21.15.135:0/1630060135 >> 172.21.15.135:0/1630060135 conn(0x7f028006a960 msgr2=0x7f028006ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:28.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.815+0000 7f028733b700 1 -- 172.21.15.135:0/1630060135 shutdown_connections 2024-05-08T20:55:28.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.815+0000 7f028733b700 1 -- 172.21.15.135:0/1630060135 wait complete. 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 Processor -- start 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 -- start start 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02800c7dc0 0x7f02801ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02801eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0280151400 0x7f0280149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801ee9e0 con 0x7f02800ca080 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801eecc0 con 0x7f02800c7dc0 2024-05-08T20:55:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.816+0000 7f028733b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02801eefa0 con 0x7f0280151400 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02801eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02801eace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33308/0 (socket says 172.21.15.135:33308) 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 -- 172.21.15.135:0/2656734481 learned_addr learned my addr 172.21.15.135:0/2656734481 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02850d7700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02800c7dc0 0x7f02801ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02858d8700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0280151400 0x7f0280149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 -- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0280151400 msgr2=0x7f0280149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0280151400 0x7f0280149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 -- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02800c7dc0 msgr2=0x7f02801ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02800c7dc0 0x7f02801ea7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 -- 172.21.15.135:0/2656734481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278009a70 con 0x7f02800ca080 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02858d8700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0280151400 0x7f0280149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f02848d6700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02801eace0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e9b0 tx=0x7f027c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f0275ffb700 1 -- 172.21.15.135:0/2656734481 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c009710 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f0275ffb700 1 -- 172.21.15.135:0/2656734481 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c00c850 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02801ef280 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f0275ffb700 1 -- 172.21.15.135:0/2656734481 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00cbc0 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.817+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02801ef840 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.818+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02801efa60 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.819+0000 7f0275ffb700 1 -- 172.21.15.135:0/2656734481 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f027c00cd20 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.819+0000 7f0275ffb700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f026406ac90 0x7f026406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.819+0000 7f0275ffb700 1 -- 172.21.15.135:0/2656734481 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f027c089810 con 0x7f02800ca080 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.819+0000 7f02850d7700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f026406ac90 0x7f026406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:28.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.820+0000 7f02850d7700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f026406ac90 0x7f026406d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0270000f60 tx=0x7f0270009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:28.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:28.824+0000 7f0275ffb700 1 -- 172.21.15.135:0/2656734481 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f027c054670 con 0x7f02800ca080 2024-05-08T20:55:29.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.014+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02801572d0 con 0x7f026406ac90 2024-05-08T20:55:29.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.023+0000 7f0275ffb700 1 -- 172.21.15.135:0/2656734481 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345230 (secure 0 0 0) 0x7f02801572d0 con 0x7f026406ac90 2024-05-08T20:55:29.029 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f026406ac90 msgr2=0x7f026406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f026406ac90 0x7f026406d150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0270000f60 tx=0x7f0270009040 comp rx=0 tx=0).stop 2024-05-08T20:55:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 msgr2=0x7f02801eace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02801eace0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e9b0 tx=0x7f027c00ed70 comp rx=0 tx=0).stop 2024-05-08T20:55:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 shutdown_connections 2024-05-08T20:55:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f026406ac90 0x7f026406d150 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02800c7dc0 0x7f02801ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0280151400 0x7f0280149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 --2- 172.21.15.135:0/2656734481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02800ca080 0x7f02801eace0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 >> 172.21.15.135:0/2656734481 conn(0x7f028006a960 msgr2=0x7f0280155270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:29.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 shutdown_connections 2024-05-08T20:55:29.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.026+0000 7f028733b700 1 -- 172.21.15.135:0/2656734481 wait complete. 2024-05-08T20:55:29.033 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T20:55:29.040 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-08T20:55:28.461871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2025532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210658+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T20:55:04.210658+0000","last_peered":"2024-05-08T20:55:04.210658+0000","last_clean":"2024-05-08T20:55:04.210658+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T20:55:04.210658+0000","last_undegraded":"2024-05-08T20:55:04.210658+0000","last_fullsized":"2024-05-08T20:55:04.210658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106818+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T20:55:04.106818+0000","last_peered":"2024-05-08T20:55:04.106818+0000","last_clean":"2024-05-08T20:55:04.106818+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T20:55:04.106818+0000","last_undegraded":"2024-05-08T20:55:04.106818+0000","last_fullsized":"2024-05-08T20:55:04.106818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100019+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T20:55:04.100019+0000","last_peered":"2024-05-08T20:55:04.100019+0000","last_clean":"2024-05-08T20:55:04.100019+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T20:55:04.100019+0000","last_undegraded":"2024-05-08T20:55:04.100019+0000","last_fullsized":"2024-05-08T20:55:04.100019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101967+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T20:55:04.101967+0000","last_peered":"2024-05-08T20:55:04.101967+0000","last_clean":"2024-05-08T20:55:04.101967+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T20:55:04.101967+0000","last_undegraded":"2024-05-08T20:55:04.101967+0000","last_fullsized":"2024-05-08T20:55:04.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209670+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T20:55:04.209670+0000","last_peered":"2024-05-08T20:55:04.209670+0000","last_clean":"2024-05-08T20:55:04.209670+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T20:55:04.209670+0000","last_undegraded":"2024-05-08T20:55:04.209670+0000","last_fullsized":"2024-05-08T20:55:04.209670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102240+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T20:55:04.102240+0000","last_peered":"2024-05-08T20:55:04.102240+0000","last_clean":"2024-05-08T20:55:04.102240+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T20:55:04.102240+0000","last_undegraded":"2024-05-08T20:55:04.102240+0000","last_fullsized":"2024-05-08T20:55:04.102240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209219+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T20:55:04.209219+0000","last_peered":"2024-05-08T20:55:04.209219+0000","last_clean":"2024-05-08T20:55:04.209219+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T20:55:04.209219+0000","last_undegraded":"2024-05-08T20:55:04.209219+0000","last_fullsized":"2024-05-08T20:55:04.209219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091254+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T20:55:04.091254+0000","last_peered":"2024-05-08T20:55:04.091254+0000","last_clean":"2024-05-08T20:55:04.091254+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T20:55:04.091254+0000","last_undegraded":"2024-05-08T20:55:04.091254+0000","last_fullsized":"2024-05-08T20:55:04.091254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210538+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T20:55:04.210538+0000","last_peered":"2024-05-08T20:55:04.210538+0000","last_clean":"2024-05-08T20:55:04.210538+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T20:55:04.210538+0000","last_undegraded":"2024-05-08T20:55:04.210538+0000","last_fullsized":"2024-05-08T20:55:04.210538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091771+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T20:55:04.091771+0000","last_peered":"2024-05-08T20:55:04.091771+0000","last_clean":"2024-05-08T20:55:04.091771+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T20:55:04.091771+0000","last_undegraded":"2024-05-08T20:55:04.091771+0000","last_fullsized":"2024-05-08T20:55:04.091771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095917+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T20:55:04.095917+0000","last_peered":"2024-05-08T20:55:04.095917+0000","last_clean":"2024-05-08T20:55:04.095917+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T20:55:04.095917+0000","last_undegraded":"2024-05-08T20:55:04.095917+0000","last_fullsized":"2024-05-08T20:55:04.095917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090851+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T20:55:04.090851+0000","last_peered":"2024-05-08T20:55:04.090851+0000","last_clean":"2024-05-08T20:55:04.090851+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T20:55:04.090851+0000","last_undegraded":"2024-05-08T20:55:04.090851+0000","last_fullsized":"2024-05-08T20:55:04.090851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100626+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T20:55:04.100626+0000","last_peered":"2024-05-08T20:55:04.100626+0000","last_clean":"2024-05-08T20:55:04.100626+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T20:55:04.100626+0000","last_undegraded":"2024-05-08T20:55:04.100626+0000","last_fullsized":"2024-05-08T20:55:04.100626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105894+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T20:55:04.105894+0000","last_peered":"2024-05-08T20:55:04.105894+0000","last_clean":"2024-05-08T20:55:04.105894+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T20:55:04.105894+0000","last_undegraded":"2024-05-08T20:55:04.105894+0000","last_fullsized":"2024-05-08T20:55:04.105894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101412+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T20:55:04.101412+0000","last_peered":"2024-05-08T20:55:04.101412+0000","last_clean":"2024-05-08T20:55:04.101412+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T20:55:04.101412+0000","last_undegraded":"2024-05-08T20:55:04.101412+0000","last_fullsized":"2024-05-08T20:55:04.101412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102105+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T20:55:04.102105+0000","last_peered":"2024-05-08T20:55:04.102105+0000","last_clean":"2024-05-08T20:55:04.102105+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T20:55:04.102105+0000","last_undegraded":"2024-05-08T20:55:04.102105+0000","last_fullsized":"2024-05-08T20:55:04.102105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097726+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T20:55:04.097726+0000","last_peered":"2024-05-08T20:55:04.097726+0000","last_clean":"2024-05-08T20:55:04.097726+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T20:55:04.097726+0000","last_undegraded":"2024-05-08T20:55:04.097726+0000","last_fullsized":"2024-05-08T20:55:04.097726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210168+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T20:55:04.210168+0000","last_peered":"2024-05-08T20:55:04.210168+0000","last_clean":"2024-05-08T20:55:04.210168+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T20:55:04.210168+0000","last_undegraded":"2024-05-08T20:55:04.210168+0000","last_fullsized":"2024-05-08T20:55:04.210168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512517+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T20:55:04.512517+0000","last_peered":"2024-05-08T20:55:04.512517+0000","last_clean":"2024-05-08T20:55:04.512517+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T20:55:04.512517+0000","last_undegraded":"2024-05-08T20:55:04.512517+0000","last_fullsized":"2024-05-08T20:55:04.512517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:53.835534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100281+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T20:55:04.100281+0000","last_peered":"2024-05-08T20:55:04.100281+0000","last_clean":"2024-05-08T20:55:04.100281+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T20:55:04.100281+0000","last_undegraded":"2024-05-08T20:55:04.100281+0000","last_fullsized":"2024-05-08T20:55:04.100281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091690+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T20:55:04.091690+0000","last_peered":"2024-05-08T20:55:04.091690+0000","last_clean":"2024-05-08T20:55:04.091690+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T20:55:04.091690+0000","last_undegraded":"2024-05-08T20:55:04.091690+0000","last_fullsized":"2024-05-08T20:55:04.091690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519037+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T20:55:04.519037+0000","last_peered":"2024-05-08T20:55:04.519037+0000","last_clean":"2024-05-08T20:55:04.519037+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T20:55:04.519037+0000","last_undegraded":"2024-05-08T20:55:04.519037+0000","last_fullsized":"2024-05-08T20:55:04.519037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091796+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T20:55:04.091796+0000","last_peered":"2024-05-08T20:55:04.091796+0000","last_clean":"2024-05-08T20:55:04.091796+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T20:55:04.091796+0000","last_undegraded":"2024-05-08T20:55:04.091796+0000","last_fullsized":"2024-05-08T20:55:04.091796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100188+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T20:55:04.100188+0000","last_peered":"2024-05-08T20:55:04.100188+0000","last_clean":"2024-05-08T20:55:04.100188+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T20:55:04.100188+0000","last_undegraded":"2024-05-08T20:55:04.100188+0000","last_fullsized":"2024-05-08T20:55:04.100188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519193+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T20:55:04.519193+0000","last_peered":"2024-05-08T20:55:04.519193+0000","last_clean":"2024-05-08T20:55:04.519193+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T20:55:04.519193+0000","last_undegraded":"2024-05-08T20:55:04.519193+0000","last_fullsized":"2024-05-08T20:55:04.519193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:49.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209957+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T20:55:04.209957+0000","last_peered":"2024-05-08T20:55:04.209957+0000","last_clean":"2024-05-08T20:55:04.209957+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T20:55:04.209957+0000","last_undegraded":"2024-05-08T20:55:04.209957+0000","last_fullsized":"2024-05-08T20:55:04.209957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101756+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T20:55:04.101756+0000","last_peered":"2024-05-08T20:55:04.101756+0000","last_clean":"2024-05-08T20:55:04.101756+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T20:55:04.101756+0000","last_undegraded":"2024-05-08T20:55:04.101756+0000","last_fullsized":"2024-05-08T20:55:04.101756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519088+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T20:55:04.519088+0000","last_peered":"2024-05-08T20:55:04.519088+0000","last_clean":"2024-05-08T20:55:04.519088+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T20:55:04.519088+0000","last_undegraded":"2024-05-08T20:55:04.519088+0000","last_fullsized":"2024-05-08T20:55:04.519088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209700+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T20:55:04.209700+0000","last_peered":"2024-05-08T20:55:04.209700+0000","last_clean":"2024-05-08T20:55:04.209700+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T20:55:04.209700+0000","last_undegraded":"2024-05-08T20:55:04.209700+0000","last_fullsized":"2024-05-08T20:55:04.209700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102182+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T20:55:04.102182+0000","last_peered":"2024-05-08T20:55:04.102182+0000","last_clean":"2024-05-08T20:55:04.102182+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T20:55:04.102182+0000","last_undegraded":"2024-05-08T20:55:04.102182+0000","last_fullsized":"2024-05-08T20:55:04.102182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512895+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T20:55:04.512895+0000","last_peered":"2024-05-08T20:55:04.512895+0000","last_clean":"2024-05-08T20:55:04.512895+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T20:55:04.512895+0000","last_undegraded":"2024-05-08T20:55:04.512895+0000","last_fullsized":"2024-05-08T20:55:04.512895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:15.767597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091524+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T20:55:04.091524+0000","last_peered":"2024-05-08T20:55:04.091524+0000","last_clean":"2024-05-08T20:55:04.091524+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T20:55:04.091524+0000","last_undegraded":"2024-05-08T20:55:04.091524+0000","last_fullsized":"2024-05-08T20:55:04.091524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.094714+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T20:55:04.094714+0000","last_peered":"2024-05-08T20:55:04.094714+0000","last_clean":"2024-05-08T20:55:04.094714+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T20:55:04.094714+0000","last_undegraded":"2024-05-08T20:55:04.094714+0000","last_fullsized":"2024-05-08T20:55:04.094714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:00.135628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872171+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T20:55:04.872171+0000","last_peered":"2024-05-08T20:55:04.872171+0000","last_clean":"2024-05-08T20:55:04.872171+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T20:55:04.872171+0000","last_undegraded":"2024-05-08T20:55:04.872171+0000","last_fullsized":"2024-05-08T20:55:04.872171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:52.925278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092648+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T20:55:04.092648+0000","last_peered":"2024-05-08T20:55:04.092648+0000","last_clean":"2024-05-08T20:55:04.092648+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T20:55:04.092648+0000","last_undegraded":"2024-05-08T20:55:04.092648+0000","last_fullsized":"2024-05-08T20:55:04.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100316+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T20:55:04.100316+0000","last_peered":"2024-05-08T20:55:04.100316+0000","last_clean":"2024-05-08T20:55:04.100316+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T20:55:04.100316+0000","last_undegraded":"2024-05-08T20:55:04.100316+0000","last_fullsized":"2024-05-08T20:55:04.100316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655299+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T20:55:04.655299+0000","last_peered":"2024-05-08T20:55:04.655299+0000","last_clean":"2024-05-08T20:55:04.655299+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T20:55:04.655299+0000","last_undegraded":"2024-05-08T20:55:04.655299+0000","last_fullsized":"2024-05-08T20:55:04.655299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090657+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T20:55:04.090657+0000","last_peered":"2024-05-08T20:55:04.090657+0000","last_clean":"2024-05-08T20:55:04.090657+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T20:55:04.090657+0000","last_undegraded":"2024-05-08T20:55:04.090657+0000","last_fullsized":"2024-05-08T20:55:04.090657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090599+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T20:55:04.090599+0000","last_peered":"2024-05-08T20:55:04.090599+0000","last_clean":"2024-05-08T20:55:04.090599+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T20:55:04.090599+0000","last_undegraded":"2024-05-08T20:55:04.090599+0000","last_fullsized":"2024-05-08T20:55:04.090599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.874020+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T20:55:04.874020+0000","last_peered":"2024-05-08T20:55:04.874020+0000","last_clean":"2024-05-08T20:55:04.874020+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T20:55:04.874020+0000","last_undegraded":"2024-05-08T20:55:04.874020+0000","last_fullsized":"2024-05-08T20:55:04.874020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101470+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T20:55:04.101470+0000","last_peered":"2024-05-08T20:55:04.101470+0000","last_clean":"2024-05-08T20:55:04.101470+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T20:55:04.101470+0000","last_undegraded":"2024-05-08T20:55:04.101470+0000","last_fullsized":"2024-05-08T20:55:04.101470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105915+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T20:55:04.105915+0000","last_peered":"2024-05-08T20:55:04.105915+0000","last_clean":"2024-05-08T20:55:04.105915+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T20:55:04.105915+0000","last_undegraded":"2024-05-08T20:55:04.105915+0000","last_fullsized":"2024-05-08T20:55:04.105915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512493+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T20:55:04.512493+0000","last_peered":"2024-05-08T20:55:04.512493+0000","last_clean":"2024-05-08T20:55:04.512493+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T20:55:04.512493+0000","last_undegraded":"2024-05-08T20:55:04.512493+0000","last_fullsized":"2024-05-08T20:55:04.512493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:25.005036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093315+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T20:55:04.093315+0000","last_peered":"2024-05-08T20:55:04.093315+0000","last_clean":"2024-05-08T20:55:04.093315+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T20:55:04.093315+0000","last_undegraded":"2024-05-08T20:55:04.093315+0000","last_fullsized":"2024-05-08T20:55:04.093315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101936+0000","last_change":"2024-05-08T20:55:00.101507+0000","last_active":"2024-05-08T20:55:04.101936+0000","last_peered":"2024-05-08T20:55:04.101936+0000","last_clean":"2024-05-08T20:55:04.101936+0000","last_became_active":"2024-05-08T20:55:00.101218+0000","last_became_peered":"2024-05-08T20:55:00.101218+0000","last_unstale":"2024-05-08T20:55:04.101936+0000","last_undegraded":"2024-05-08T20:55:04.101936+0000","last_fullsized":"2024-05-08T20:55:04.101936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512444+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T20:55:04.512444+0000","last_peered":"2024-05-08T20:55:04.512444+0000","last_clean":"2024-05-08T20:55:04.512444+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T20:55:04.512444+0000","last_undegraded":"2024-05-08T20:55:04.512444+0000","last_fullsized":"2024-05-08T20:55:04.512444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101935+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T20:55:04.101935+0000","last_peered":"2024-05-08T20:55:04.101935+0000","last_clean":"2024-05-08T20:55:04.101935+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T20:55:04.101935+0000","last_undegraded":"2024-05-08T20:55:04.101935+0000","last_fullsized":"2024-05-08T20:55:04.101935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100361+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T20:55:04.100361+0000","last_peered":"2024-05-08T20:55:04.100361+0000","last_clean":"2024-05-08T20:55:04.100361+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T20:55:04.100361+0000","last_undegraded":"2024-05-08T20:55:04.100361+0000","last_fullsized":"2024-05-08T20:55:04.100361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519609+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T20:55:04.519609+0000","last_peered":"2024-05-08T20:55:04.519609+0000","last_clean":"2024-05-08T20:55:04.519609+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T20:55:04.519609+0000","last_undegraded":"2024-05-08T20:55:04.519609+0000","last_fullsized":"2024-05-08T20:55:04.519609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106365+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T20:55:04.106365+0000","last_peered":"2024-05-08T20:55:04.106365+0000","last_clean":"2024-05-08T20:55:04.106365+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T20:55:04.106365+0000","last_undegraded":"2024-05-08T20:55:04.106365+0000","last_fullsized":"2024-05-08T20:55:04.106365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095830+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T20:55:04.095830+0000","last_peered":"2024-05-08T20:55:04.095830+0000","last_clean":"2024-05-08T20:55:04.095830+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T20:55:04.095830+0000","last_undegraded":"2024-05-08T20:55:04.095830+0000","last_fullsized":"2024-05-08T20:55:04.095830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872220+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T20:55:04.872220+0000","last_peered":"2024-05-08T20:55:04.872220+0000","last_clean":"2024-05-08T20:55:04.872220+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T20:55:04.872220+0000","last_undegraded":"2024-05-08T20:55:04.872220+0000","last_fullsized":"2024-05-08T20:55:04.872220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.651925+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T20:55:09.651925+0000","last_peered":"2024-05-08T20:55:09.651925+0000","last_clean":"2024-05-08T20:55:09.651925+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T20:55:09.651925+0000","last_undegraded":"2024-05-08T20:55:09.651925+0000","last_fullsized":"2024-05-08T20:55:09.651925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210218+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T20:55:04.210218+0000","last_peered":"2024-05-08T20:55:04.210218+0000","last_clean":"2024-05-08T20:55:04.210218+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T20:55:04.210218+0000","last_undegraded":"2024-05-08T20:55:04.210218+0000","last_fullsized":"2024-05-08T20:55:04.210218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.517096+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T20:55:04.517096+0000","last_peered":"2024-05-08T20:55:04.517096+0000","last_clean":"2024-05-08T20:55:04.517096+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T20:55:04.517096+0000","last_undegraded":"2024-05-08T20:55:04.517096+0000","last_fullsized":"2024-05-08T20:55:04.517096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100573+0000","last_change":"2024-05-08T20:54:59.629962+0000","last_active":"2024-05-08T20:55:04.100573+0000","last_peered":"2024-05-08T20:55:04.100573+0000","last_clean":"2024-05-08T20:55:04.100573+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T20:55:04.100573+0000","last_undegraded":"2024-05-08T20:55:04.100573+0000","last_fullsized":"2024-05-08T20:55:04.100573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100713+0000","last_change":"2024-05-08T20:55:00.102710+0000","last_active":"2024-05-08T20:55:04.100713+0000","last_peered":"2024-05-08T20:55:04.100713+0000","last_clean":"2024-05-08T20:55:04.100713+0000","last_became_active":"2024-05-08T20:55:00.102463+0000","last_became_peered":"2024-05-08T20:55:00.102463+0000","last_unstale":"2024-05-08T20:55:04.100713+0000","last_undegraded":"2024-05-08T20:55:04.100713+0000","last_fullsized":"2024-05-08T20:55:04.100713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512860+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T20:55:04.512860+0000","last_peered":"2024-05-08T20:55:04.512860+0000","last_clean":"2024-05-08T20:55:04.512860+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T20:55:04.512860+0000","last_undegraded":"2024-05-08T20:55:04.512860+0000","last_fullsized":"2024-05-08T20:55:04.512860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.959849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101724+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T20:55:04.101724+0000","last_peered":"2024-05-08T20:55:04.101724+0000","last_clean":"2024-05-08T20:55:04.101724+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T20:55:04.101724+0000","last_undegraded":"2024-05-08T20:55:04.101724+0000","last_fullsized":"2024-05-08T20:55:04.101724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209759+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T20:55:04.209759+0000","last_peered":"2024-05-08T20:55:04.209759+0000","last_clean":"2024-05-08T20:55:04.209759+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T20:55:04.209759+0000","last_undegraded":"2024-05-08T20:55:04.209759+0000","last_fullsized":"2024-05-08T20:55:04.209759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512867+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T20:55:04.512867+0000","last_peered":"2024-05-08T20:55:04.512867+0000","last_clean":"2024-05-08T20:55:04.512867+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T20:55:04.512867+0000","last_undegraded":"2024-05-08T20:55:04.512867+0000","last_fullsized":"2024-05-08T20:55:04.512867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:34.555272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091308+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T20:55:04.091308+0000","last_peered":"2024-05-08T20:55:04.091308+0000","last_clean":"2024-05-08T20:55:04.091308+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T20:55:04.091308+0000","last_undegraded":"2024-05-08T20:55:04.091308+0000","last_fullsized":"2024-05-08T20:55:04.091308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097710+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T20:55:04.097710+0000","last_peered":"2024-05-08T20:55:04.097710+0000","last_clean":"2024-05-08T20:55:04.097710+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T20:55:04.097710+0000","last_undegraded":"2024-05-08T20:55:04.097710+0000","last_fullsized":"2024-05-08T20:55:04.097710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209633+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T20:55:04.209633+0000","last_peered":"2024-05-08T20:55:04.209633+0000","last_clean":"2024-05-08T20:55:04.209633+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T20:55:04.209633+0000","last_undegraded":"2024-05-08T20:55:04.209633+0000","last_fullsized":"2024-05-08T20:55:04.209633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518929+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T20:55:04.518929+0000","last_peered":"2024-05-08T20:55:04.518929+0000","last_clean":"2024-05-08T20:55:04.518929+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T20:55:04.518929+0000","last_undegraded":"2024-05-08T20:55:04.518929+0000","last_fullsized":"2024-05-08T20:55:04.518929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095787+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T20:55:04.095787+0000","last_peered":"2024-05-08T20:55:04.095787+0000","last_clean":"2024-05-08T20:55:04.095787+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T20:55:04.095787+0000","last_undegraded":"2024-05-08T20:55:04.095787+0000","last_fullsized":"2024-05-08T20:55:04.095787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:17.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210177+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T20:55:04.210177+0000","last_peered":"2024-05-08T20:55:04.210177+0000","last_clean":"2024-05-08T20:55:04.210177+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T20:55:04.210177+0000","last_undegraded":"2024-05-08T20:55:04.210177+0000","last_fullsized":"2024-05-08T20:55:04.210177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871830+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T20:55:04.871830+0000","last_peered":"2024-05-08T20:55:04.871830+0000","last_clean":"2024-05-08T20:55:04.871830+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T20:55:04.871830+0000","last_undegraded":"2024-05-08T20:55:04.871830+0000","last_fullsized":"2024-05-08T20:55:04.871830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106256+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T20:55:04.106256+0000","last_peered":"2024-05-08T20:55:04.106256+0000","last_clean":"2024-05-08T20:55:04.106256+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T20:55:04.106256+0000","last_undegraded":"2024-05-08T20:55:04.106256+0000","last_fullsized":"2024-05-08T20:55:04.106256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102154+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T20:55:04.102154+0000","last_peered":"2024-05-08T20:55:04.102154+0000","last_clean":"2024-05-08T20:55:04.102154+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T20:55:04.102154+0000","last_undegraded":"2024-05-08T20:55:04.102154+0000","last_fullsized":"2024-05-08T20:55:04.102154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871697+0000","last_change":"2024-05-08T20:55:04.117093+0000","last_active":"2024-05-08T20:55:04.871697+0000","last_peered":"2024-05-08T20:55:04.871697+0000","last_clean":"2024-05-08T20:55:04.871697+0000","last_became_active":"2024-05-08T20:55:04.115995+0000","last_became_peered":"2024-05-08T20:55:04.115995+0000","last_unstale":"2024-05-08T20:55:04.871697+0000","last_undegraded":"2024-05-08T20:55:04.871697+0000","last_fullsized":"2024-05-08T20:55:04.871697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101637+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T20:55:04.101637+0000","last_peered":"2024-05-08T20:55:04.101637+0000","last_clean":"2024-05-08T20:55:04.101637+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T20:55:04.101637+0000","last_undegraded":"2024-05-08T20:55:04.101637+0000","last_fullsized":"2024-05-08T20:55:04.101637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095588+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T20:55:04.095588+0000","last_peered":"2024-05-08T20:55:04.095588+0000","last_clean":"2024-05-08T20:55:04.095588+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T20:55:04.095588+0000","last_undegraded":"2024-05-08T20:55:04.095588+0000","last_fullsized":"2024-05-08T20:55:04.095588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:30.883278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872006+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T20:55:04.872006+0000","last_peered":"2024-05-08T20:55:04.872006+0000","last_clean":"2024-05-08T20:55:04.872006+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T20:55:04.872006+0000","last_undegraded":"2024-05-08T20:55:04.872006+0000","last_fullsized":"2024-05-08T20:55:04.872006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105577+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T20:55:04.105577+0000","last_peered":"2024-05-08T20:55:04.105577+0000","last_clean":"2024-05-08T20:55:04.105577+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T20:55:04.105577+0000","last_undegraded":"2024-05-08T20:55:04.105577+0000","last_fullsized":"2024-05-08T20:55:04.105577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097867+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T20:55:04.097867+0000","last_peered":"2024-05-08T20:55:04.097867+0000","last_clean":"2024-05-08T20:55:04.097867+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T20:55:04.097867+0000","last_undegraded":"2024-05-08T20:55:04.097867+0000","last_fullsized":"2024-05-08T20:55:04.097867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655085+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T20:55:04.655085+0000","last_peered":"2024-05-08T20:55:04.655085+0000","last_clean":"2024-05-08T20:55:04.655085+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T20:55:04.655085+0000","last_undegraded":"2024-05-08T20:55:04.655085+0000","last_fullsized":"2024-05-08T20:55:04.655085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090921+0000","last_change":"2024-05-08T20:55:00.091803+0000","last_active":"2024-05-08T20:55:04.090921+0000","last_peered":"2024-05-08T20:55:04.090921+0000","last_clean":"2024-05-08T20:55:04.090921+0000","last_became_active":"2024-05-08T20:55:00.091556+0000","last_became_peered":"2024-05-08T20:55:00.091556+0000","last_unstale":"2024-05-08T20:55:04.090921+0000","last_undegraded":"2024-05-08T20:55:04.090921+0000","last_fullsized":"2024-05-08T20:55:04.090921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101787+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T20:55:04.101787+0000","last_peered":"2024-05-08T20:55:04.101787+0000","last_clean":"2024-05-08T20:55:04.101787+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T20:55:04.101787+0000","last_undegraded":"2024-05-08T20:55:04.101787+0000","last_fullsized":"2024-05-08T20:55:04.101787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209118+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T20:55:04.209118+0000","last_peered":"2024-05-08T20:55:04.209118+0000","last_clean":"2024-05-08T20:55:04.209118+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T20:55:04.209118+0000","last_undegraded":"2024-05-08T20:55:04.209118+0000","last_fullsized":"2024-05-08T20:55:04.209118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101104+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T20:55:04.101104+0000","last_peered":"2024-05-08T20:55:04.101104+0000","last_clean":"2024-05-08T20:55:04.101104+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T20:55:04.101104+0000","last_undegraded":"2024-05-08T20:55:04.101104+0000","last_fullsized":"2024-05-08T20:55:04.101104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:16.831824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209208+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T20:55:04.209208+0000","last_peered":"2024-05-08T20:55:04.209208+0000","last_clean":"2024-05-08T20:55:04.209208+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T20:55:04.209208+0000","last_undegraded":"2024-05-08T20:55:04.209208+0000","last_fullsized":"2024-05-08T20:55:04.209208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873248+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T20:55:04.873248+0000","last_peered":"2024-05-08T20:55:04.873248+0000","last_clean":"2024-05-08T20:55:04.873248+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T20:55:04.873248+0000","last_undegraded":"2024-05-08T20:55:04.873248+0000","last_fullsized":"2024-05-08T20:55:04.873248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209773+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T20:55:04.209773+0000","last_peered":"2024-05-08T20:55:04.209773+0000","last_clean":"2024-05-08T20:55:04.209773+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T20:55:04.209773+0000","last_undegraded":"2024-05-08T20:55:04.209773+0000","last_fullsized":"2024-05-08T20:55:04.209773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106292+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T20:55:04.106292+0000","last_peered":"2024-05-08T20:55:04.106292+0000","last_clean":"2024-05-08T20:55:04.106292+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T20:55:04.106292+0000","last_undegraded":"2024-05-08T20:55:04.106292+0000","last_fullsized":"2024-05-08T20:55:04.106292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512323+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T20:55:04.512323+0000","last_peered":"2024-05-08T20:55:04.512323+0000","last_clean":"2024-05-08T20:55:04.512323+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T20:55:04.512323+0000","last_undegraded":"2024-05-08T20:55:04.512323+0000","last_fullsized":"2024-05-08T20:55:04.512323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:18.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106745+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T20:55:04.106745+0000","last_peered":"2024-05-08T20:55:04.106745+0000","last_clean":"2024-05-08T20:55:04.106745+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T20:55:04.106745+0000","last_undegraded":"2024-05-08T20:55:04.106745+0000","last_fullsized":"2024-05-08T20:55:04.106745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091711+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T20:55:04.091711+0000","last_peered":"2024-05-08T20:55:04.091711+0000","last_clean":"2024-05-08T20:55:04.091711+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T20:55:04.091711+0000","last_undegraded":"2024-05-08T20:55:04.091711+0000","last_fullsized":"2024-05-08T20:55:04.091711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518932+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T20:55:04.518932+0000","last_peered":"2024-05-08T20:55:04.518932+0000","last_clean":"2024-05-08T20:55:04.518932+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T20:55:04.518932+0000","last_undegraded":"2024-05-08T20:55:04.518932+0000","last_fullsized":"2024-05-08T20:55:04.518932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:59.610624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093217+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T20:55:04.093217+0000","last_peered":"2024-05-08T20:55:04.093217+0000","last_clean":"2024-05-08T20:55:04.093217+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T20:55:04.093217+0000","last_undegraded":"2024-05-08T20:55:04.093217+0000","last_fullsized":"2024-05-08T20:55:04.093217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101416+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T20:55:04.101416+0000","last_peered":"2024-05-08T20:55:04.101416+0000","last_clean":"2024-05-08T20:55:04.101416+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T20:55:04.101416+0000","last_undegraded":"2024-05-08T20:55:04.101416+0000","last_fullsized":"2024-05-08T20:55:04.101416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519324+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T20:55:04.519324+0000","last_peered":"2024-05-08T20:55:04.519324+0000","last_clean":"2024-05-08T20:55:04.519324+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T20:55:04.519324+0000","last_undegraded":"2024-05-08T20:55:04.519324+0000","last_fullsized":"2024-05-08T20:55:04.519324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209104+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T20:55:04.209104+0000","last_peered":"2024-05-08T20:55:04.209104+0000","last_clean":"2024-05-08T20:55:04.209104+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T20:55:04.209104+0000","last_undegraded":"2024-05-08T20:55:04.209104+0000","last_fullsized":"2024-05-08T20:55:04.209104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095004+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T20:55:04.095004+0000","last_peered":"2024-05-08T20:55:04.095004+0000","last_clean":"2024-05-08T20:55:04.095004+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T20:55:04.095004+0000","last_undegraded":"2024-05-08T20:55:04.095004+0000","last_fullsized":"2024-05-08T20:55:04.095004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.899173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872102+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T20:55:04.872102+0000","last_peered":"2024-05-08T20:55:04.872102+0000","last_clean":"2024-05-08T20:55:04.872102+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T20:55:04.872102+0000","last_undegraded":"2024-05-08T20:55:04.872102+0000","last_fullsized":"2024-05-08T20:55:04.872102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105823+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T20:55:04.105823+0000","last_peered":"2024-05-08T20:55:04.105823+0000","last_clean":"2024-05-08T20:55:04.105823+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T20:55:04.105823+0000","last_undegraded":"2024-05-08T20:55:04.105823+0000","last_fullsized":"2024-05-08T20:55:04.105823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090691+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T20:55:04.090691+0000","last_peered":"2024-05-08T20:55:04.090691+0000","last_clean":"2024-05-08T20:55:04.090691+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T20:55:04.090691+0000","last_undegraded":"2024-05-08T20:55:04.090691+0000","last_fullsized":"2024-05-08T20:55:04.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519380+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T20:55:04.519380+0000","last_peered":"2024-05-08T20:55:04.519380+0000","last_clean":"2024-05-08T20:55:04.519380+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T20:55:04.519380+0000","last_undegraded":"2024-05-08T20:55:04.519380+0000","last_fullsized":"2024-05-08T20:55:04.519380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:27.059976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106930+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T20:55:04.106930+0000","last_peered":"2024-05-08T20:55:04.106930+0000","last_clean":"2024-05-08T20:55:04.106930+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T20:55:04.106930+0000","last_undegraded":"2024-05-08T20:55:04.106930+0000","last_fullsized":"2024-05-08T20:55:04.106930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091617+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T20:55:04.091617+0000","last_peered":"2024-05-08T20:55:04.091617+0000","last_clean":"2024-05-08T20:55:04.091617+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T20:55:04.091617+0000","last_undegraded":"2024-05-08T20:55:04.091617+0000","last_fullsized":"2024-05-08T20:55:04.091617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519561+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T20:55:04.519561+0000","last_peered":"2024-05-08T20:55:04.519561+0000","last_clean":"2024-05-08T20:55:04.519561+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T20:55:04.519561+0000","last_undegraded":"2024-05-08T20:55:04.519561+0000","last_fullsized":"2024-05-08T20:55:04.519561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209808+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T20:55:04.209808+0000","last_peered":"2024-05-08T20:55:04.209808+0000","last_clean":"2024-05-08T20:55:04.209808+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T20:55:04.209808+0000","last_undegraded":"2024-05-08T20:55:04.209808+0000","last_fullsized":"2024-05-08T20:55:04.209808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092750+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T20:55:04.092750+0000","last_peered":"2024-05-08T20:55:04.092750+0000","last_clean":"2024-05-08T20:55:04.092750+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T20:55:04.092750+0000","last_undegraded":"2024-05-08T20:55:04.092750+0000","last_fullsized":"2024-05-08T20:55:04.092750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.654813+0000","last_change":"2024-05-08T20:55:04.211367+0000","last_active":"2024-05-08T20:55:04.654813+0000","last_peered":"2024-05-08T20:55:04.654813+0000","last_clean":"2024-05-08T20:55:04.654813+0000","last_became_active":"2024-05-08T20:55:04.210862+0000","last_became_peered":"2024-05-08T20:55:04.210862+0000","last_unstale":"2024-05-08T20:55:04.654813+0000","last_undegraded":"2024-05-08T20:55:04.654813+0000","last_fullsized":"2024-05-08T20:55:04.654813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097858+0000","last_change":"2024-05-08T20:54:59.625358+0000","last_active":"2024-05-08T20:55:04.097858+0000","last_peered":"2024-05-08T20:55:04.097858+0000","last_clean":"2024-05-08T20:55:04.097858+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T20:55:04.097858+0000","last_undegraded":"2024-05-08T20:55:04.097858+0000","last_fullsized":"2024-05-08T20:55:04.097858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210050+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T20:55:04.210050+0000","last_peered":"2024-05-08T20:55:04.210050+0000","last_clean":"2024-05-08T20:55:04.210050+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T20:55:04.210050+0000","last_undegraded":"2024-05-08T20:55:04.210050+0000","last_fullsized":"2024-05-08T20:55:04.210050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873140+0000","last_change":"2024-05-08T20:55:04.116701+0000","last_active":"2024-05-08T20:55:04.873140+0000","last_peered":"2024-05-08T20:55:04.873140+0000","last_clean":"2024-05-08T20:55:04.873140+0000","last_became_active":"2024-05-08T20:55:04.116308+0000","last_became_peered":"2024-05-08T20:55:04.116308+0000","last_unstale":"2024-05-08T20:55:04.873140+0000","last_undegraded":"2024-05-08T20:55:04.873140+0000","last_fullsized":"2024-05-08T20:55:04.873140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106286+0000","last_change":"2024-05-08T20:54:59.618192+0000","last_active":"2024-05-08T20:55:04.106286+0000","last_peered":"2024-05-08T20:55:04.106286+0000","last_clean":"2024-05-08T20:55:04.106286+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T20:55:04.106286+0000","last_undegraded":"2024-05-08T20:55:04.106286+0000","last_fullsized":"2024-05-08T20:55:04.106286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101864+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T20:55:04.101864+0000","last_peered":"2024-05-08T20:55:04.101864+0000","last_clean":"2024-05-08T20:55:04.101864+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T20:55:04.101864+0000","last_undegraded":"2024-05-08T20:55:04.101864+0000","last_fullsized":"2024-05-08T20:55:04.101864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.516609+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T20:55:04.516609+0000","last_peered":"2024-05-08T20:55:04.516609+0000","last_clean":"2024-05-08T20:55:04.516609+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T20:55:04.516609+0000","last_undegraded":"2024-05-08T20:55:04.516609+0000","last_fullsized":"2024-05-08T20:55:04.516609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097649+0000","last_change":"2024-05-08T20:54:59.623921+0000","last_active":"2024-05-08T20:55:04.097649+0000","last_peered":"2024-05-08T20:55:04.097649+0000","last_clean":"2024-05-08T20:55:04.097649+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T20:55:04.097649+0000","last_undegraded":"2024-05-08T20:55:04.097649+0000","last_fullsized":"2024-05-08T20:55:04.097649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210761+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T20:55:04.210761+0000","last_peered":"2024-05-08T20:55:04.210761+0000","last_clean":"2024-05-08T20:55:04.210761+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T20:55:04.210761+0000","last_undegraded":"2024-05-08T20:55:04.210761+0000","last_fullsized":"2024-05-08T20:55:04.210761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092114+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T20:55:04.092114+0000","last_peered":"2024-05-08T20:55:04.092114+0000","last_clean":"2024-05-08T20:55:04.092114+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T20:55:04.092114+0000","last_undegraded":"2024-05-08T20:55:04.092114+0000","last_fullsized":"2024-05-08T20:55:04.092114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097934+0000","last_change":"2024-05-08T20:55:00.088933+0000","last_active":"2024-05-08T20:55:04.097934+0000","last_peered":"2024-05-08T20:55:04.097934+0000","last_clean":"2024-05-08T20:55:04.097934+0000","last_became_active":"2024-05-08T20:55:00.088651+0000","last_became_peered":"2024-05-08T20:55:00.088651+0000","last_unstale":"2024-05-08T20:55:04.097934+0000","last_undegraded":"2024-05-08T20:55:04.097934+0000","last_fullsized":"2024-05-08T20:55:04.097934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102032+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T20:55:04.102032+0000","last_peered":"2024-05-08T20:55:04.102032+0000","last_clean":"2024-05-08T20:55:04.102032+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T20:55:04.102032+0000","last_undegraded":"2024-05-08T20:55:04.102032+0000","last_fullsized":"2024-05-08T20:55:04.102032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100404+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T20:55:04.100404+0000","last_peered":"2024-05-08T20:55:04.100404+0000","last_clean":"2024-05-08T20:55:04.100404+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T20:55:04.100404+0000","last_undegraded":"2024-05-08T20:55:04.100404+0000","last_fullsized":"2024-05-08T20:55:04.100404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091752+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T20:55:04.091752+0000","last_peered":"2024-05-08T20:55:04.091752+0000","last_clean":"2024-05-08T20:55:04.091752+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T20:55:04.091752+0000","last_undegraded":"2024-05-08T20:55:04.091752+0000","last_fullsized":"2024-05-08T20:55:04.091752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106193+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T20:55:04.106193+0000","last_peered":"2024-05-08T20:55:04.106193+0000","last_clean":"2024-05-08T20:55:04.106193+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T20:55:04.106193+0000","last_undegraded":"2024-05-08T20:55:04.106193+0000","last_fullsized":"2024-05-08T20:55:04.106193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091956+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T20:55:04.091956+0000","last_peered":"2024-05-08T20:55:04.091956+0000","last_clean":"2024-05-08T20:55:04.091956+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T20:55:04.091956+0000","last_undegraded":"2024-05-08T20:55:04.091956+0000","last_fullsized":"2024-05-08T20:55:04.091956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091800+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T20:55:04.091800+0000","last_peered":"2024-05-08T20:55:04.091800+0000","last_clean":"2024-05-08T20:55:04.091800+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T20:55:04.091800+0000","last_undegraded":"2024-05-08T20:55:04.091800+0000","last_fullsized":"2024-05-08T20:55:04.091800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101516+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T20:55:04.101516+0000","last_peered":"2024-05-08T20:55:04.101516+0000","last_clean":"2024-05-08T20:55:04.101516+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T20:55:04.101516+0000","last_undegraded":"2024-05-08T20:55:04.101516+0000","last_fullsized":"2024-05-08T20:55:04.101516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090738+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T20:55:04.090738+0000","last_peered":"2024-05-08T20:55:04.090738+0000","last_clean":"2024-05-08T20:55:04.090738+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T20:55:04.090738+0000","last_undegraded":"2024-05-08T20:55:04.090738+0000","last_fullsized":"2024-05-08T20:55:04.090738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102133+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T20:55:04.102133+0000","last_peered":"2024-05-08T20:55:04.102133+0000","last_clean":"2024-05-08T20:55:04.102133+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T20:55:04.102133+0000","last_undegraded":"2024-05-08T20:55:04.102133+0000","last_fullsized":"2024-05-08T20:55:04.102133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100484+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T20:55:04.100484+0000","last_peered":"2024-05-08T20:55:04.100484+0000","last_clean":"2024-05-08T20:55:04.100484+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T20:55:04.100484+0000","last_undegraded":"2024-05-08T20:55:04.100484+0000","last_fullsized":"2024-05-08T20:55:04.100484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091573+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T20:55:04.091573+0000","last_peered":"2024-05-08T20:55:04.091573+0000","last_clean":"2024-05-08T20:55:04.091573+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T20:55:04.091573+0000","last_undegraded":"2024-05-08T20:55:04.091573+0000","last_fullsized":"2024-05-08T20:55:04.091573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:55:29.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:55:29.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.200+0000 7fd278e48700 1 Processor -- start 2024-05-08T20:55:29.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.200+0000 7fd278e48700 1 -- start start 2024-05-08T20:55:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd278e48700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c3960 0x7fd2740c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd278e48700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2740c6590 0x7fd2740c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd278e48700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740c34d0 con 0x7fd2741500a0 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd278e48700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2740c5800 con 0x7fd2740c6590 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd278e48700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740c5da0 con 0x7fd2740c3960 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd272d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2740c6590 0x7fd2740c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd272d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd2740c6590 0x7fd2740c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33322/0 (socket says 172.21.15.135:33322) 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd272d9d700 1 -- 172.21.15.135:0/2370250419 learned_addr learned my addr 172.21.15.135:0/2370250419 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.201+0000 7fd271d9b700 1 --2- 172.21.15.135:0/2370250419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c3960 0x7fd2740c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd272d9d700 1 -- 172.21.15.135:0/2370250419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c3960 msgr2=0x7fd2740c51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd272d9d700 1 --2- 172.21.15.135:0/2370250419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c3960 0x7fd2740c51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd272d9d700 1 -- 172.21.15.135:0/2370250419 >> v1:172.21.15.183:6789/0 conn(0x7fd2741500a0 legacy=0x7fd274155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd272d9d700 1 -- 172.21.15.135:0/2370250419 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740c5ac0 con 0x7fd2740c6590 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd272d9d700 1 --2- 172.21.15.135:0/2370250419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2740c6590 0x7fd2740c6a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009e50 tx=0x7fd26c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0456640f7989be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd27159a700 1 -- 172.21.15.135:0/2370250419 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00e070 con 0x7fd2740c6590 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd27159a700 1 -- 172.21.15.135:0/2370250419 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00b910 con 0x7fd2740c6590 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd27159a700 1 -- 172.21.15.135:0/2370250419 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00bcc0 con 0x7fd2740c6590 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.202+0000 7fd278e48700 1 -- 172.21.15.135:0/2370250419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2740c6590 msgr2=0x7fd2740c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.203+0000 7fd278e48700 1 --2- 172.21.15.135:0/2370250419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2740c6590 0x7fd2740c6a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009e50 tx=0x7fd26c00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.203+0000 7fd278e48700 1 -- 172.21.15.135:0/2370250419 shutdown_connections 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.203+0000 7fd278e48700 1 --2- 172.21.15.135:0/2370250419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2740c6590 0x7fd2740c6a20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.203+0000 7fd278e48700 1 --2- 172.21.15.135:0/2370250419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c3960 0x7fd2740c51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.203+0000 7fd278e48700 1 -- 172.21.15.135:0/2370250419 >> 172.21.15.135:0/2370250419 conn(0x7fd27406daf0 msgr2=0x7fd27406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.203+0000 7fd278e48700 1 -- 172.21.15.135:0/2370250419 shutdown_connections 2024-05-08T20:55:29.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.203+0000 7fd278e48700 1 -- 172.21.15.135:0/2370250419 wait complete. 2024-05-08T20:55:29.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.204+0000 7fd278e48700 1 Processor -- start 2024-05-08T20:55:29.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.204+0000 7fd278e48700 1 -- start start 2024-05-08T20:55:29.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2740c3960 0x7fd2741f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c6590 0x7fd27414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2741500a0 0x7fd27414f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2741446f0 con 0x7fd2741500a0 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27414ec40 con 0x7fd2740c3960 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27414daf0 con 0x7fd2740c6590 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2741500a0 0x7fd27414f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2741500a0 0x7fd27414f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33332/0 (socket says 172.21.15.135:33332) 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 -- 172.21.15.135:0/1093039588 learned_addr learned my addr 172.21.15.135:0/1093039588 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd271d9b700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c6590 0x7fd27414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd27259c700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2740c3960 0x7fd2741f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 -- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c6590 msgr2=0x7fd27414df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c6590 0x7fd27414df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 -- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2740c3960 msgr2=0x7fd2741f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2740c3960 0x7fd2741f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 -- 172.21.15.135:0/1093039588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c009b30 con 0x7fd2741500a0 2024-05-08T20:55:29.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd27259c700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2740c3960 0x7fd2741f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:29.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd272d9d700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2741500a0 0x7fd27414f170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00b680 tx=0x7fd26c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd262ffd700 1 -- 172.21.15.135:0/1093039588 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0048e0 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd262ffd700 1 -- 172.21.15.135:0/1093039588 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c0092e0 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd262ffd700 1 -- 172.21.15.135:0/1093039588 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c01c660 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27414e4c0 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.205+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27414d4a0 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.206+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd274067fa0 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.207+0000 7fd262ffd700 1 -- 172.21.15.135:0/1093039588 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd26c01c7c0 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.207+0000 7fd262ffd700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd25406ac90 0x7fd25406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.207+0000 7fd262ffd700 1 -- 172.21.15.135:0/1093039588 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd26c08b230 con 0x7fd2741500a0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.207+0000 7fd27259c700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd25406ac90 0x7fd25406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.208+0000 7fd27259c700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd25406ac90 0x7fd25406d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd268000f60 tx=0x7fd268009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.212+0000 7fd262ffd700 1 -- 172.21.15.135:0/1093039588 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd26c0561b0 con 0x7fd2741500a0 2024-05-08T20:55:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.403+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2740c3160 con 0x7fd25406ac90 2024-05-08T20:55:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.412+0000 7fd262ffd700 1 -- 172.21.15.135:0/1093039588 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345230 (secure 0 0 0) 0x7fd268001450 con 0x7fd25406ac90 2024-05-08T20:55:29.418 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:29.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.415+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd25406ac90 msgr2=0x7fd25406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.415+0000 7fd278e48700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd25406ac90 0x7fd25406d150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd268000f60 tx=0x7fd268009040 comp rx=0 tx=0).stop 2024-05-08T20:55:29.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.415+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2741500a0 msgr2=0x7fd27414f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.415+0000 7fd278e48700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2741500a0 0x7fd27414f170 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00b680 tx=0x7fd26c004ad0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.415+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 shutdown_connections 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.415+0000 7fd278e48700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd25406ac90 0x7fd25406d150 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.416+0000 7fd278e48700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2740c3960 0x7fd2741f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.416+0000 7fd278e48700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2741500a0 0x7fd27414f170 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.416+0000 7fd278e48700 1 --2- 172.21.15.135:0/1093039588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2740c6590 0x7fd27414df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.416+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 >> 172.21.15.135:0/1093039588 conn(0x7fd27406daf0 msgr2=0x7fd2740c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.416+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 shutdown_connections 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.416+0000 7fd278e48700 1 -- 172.21.15.135:0/1093039588 wait complete. 2024-05-08T20:55:29.422 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T20:55:29.430 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-08T20:55:28.461871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2025532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210658+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T20:55:04.210658+0000","last_peered":"2024-05-08T20:55:04.210658+0000","last_clean":"2024-05-08T20:55:04.210658+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T20:55:04.210658+0000","last_undegraded":"2024-05-08T20:55:04.210658+0000","last_fullsized":"2024-05-08T20:55:04.210658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106818+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T20:55:04.106818+0000","last_peered":"2024-05-08T20:55:04.106818+0000","last_clean":"2024-05-08T20:55:04.106818+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T20:55:04.106818+0000","last_undegraded":"2024-05-08T20:55:04.106818+0000","last_fullsized":"2024-05-08T20:55:04.106818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100019+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T20:55:04.100019+0000","last_peered":"2024-05-08T20:55:04.100019+0000","last_clean":"2024-05-08T20:55:04.100019+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T20:55:04.100019+0000","last_undegraded":"2024-05-08T20:55:04.100019+0000","last_fullsized":"2024-05-08T20:55:04.100019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101967+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T20:55:04.101967+0000","last_peered":"2024-05-08T20:55:04.101967+0000","last_clean":"2024-05-08T20:55:04.101967+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T20:55:04.101967+0000","last_undegraded":"2024-05-08T20:55:04.101967+0000","last_fullsized":"2024-05-08T20:55:04.101967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209670+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T20:55:04.209670+0000","last_peered":"2024-05-08T20:55:04.209670+0000","last_clean":"2024-05-08T20:55:04.209670+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T20:55:04.209670+0000","last_undegraded":"2024-05-08T20:55:04.209670+0000","last_fullsized":"2024-05-08T20:55:04.209670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102240+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T20:55:04.102240+0000","last_peered":"2024-05-08T20:55:04.102240+0000","last_clean":"2024-05-08T20:55:04.102240+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T20:55:04.102240+0000","last_undegraded":"2024-05-08T20:55:04.102240+0000","last_fullsized":"2024-05-08T20:55:04.102240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209219+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T20:55:04.209219+0000","last_peered":"2024-05-08T20:55:04.209219+0000","last_clean":"2024-05-08T20:55:04.209219+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T20:55:04.209219+0000","last_undegraded":"2024-05-08T20:55:04.209219+0000","last_fullsized":"2024-05-08T20:55:04.209219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091254+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T20:55:04.091254+0000","last_peered":"2024-05-08T20:55:04.091254+0000","last_clean":"2024-05-08T20:55:04.091254+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T20:55:04.091254+0000","last_undegraded":"2024-05-08T20:55:04.091254+0000","last_fullsized":"2024-05-08T20:55:04.091254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210538+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T20:55:04.210538+0000","last_peered":"2024-05-08T20:55:04.210538+0000","last_clean":"2024-05-08T20:55:04.210538+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T20:55:04.210538+0000","last_undegraded":"2024-05-08T20:55:04.210538+0000","last_fullsized":"2024-05-08T20:55:04.210538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091771+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T20:55:04.091771+0000","last_peered":"2024-05-08T20:55:04.091771+0000","last_clean":"2024-05-08T20:55:04.091771+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T20:55:04.091771+0000","last_undegraded":"2024-05-08T20:55:04.091771+0000","last_fullsized":"2024-05-08T20:55:04.091771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095917+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T20:55:04.095917+0000","last_peered":"2024-05-08T20:55:04.095917+0000","last_clean":"2024-05-08T20:55:04.095917+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T20:55:04.095917+0000","last_undegraded":"2024-05-08T20:55:04.095917+0000","last_fullsized":"2024-05-08T20:55:04.095917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090851+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T20:55:04.090851+0000","last_peered":"2024-05-08T20:55:04.090851+0000","last_clean":"2024-05-08T20:55:04.090851+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T20:55:04.090851+0000","last_undegraded":"2024-05-08T20:55:04.090851+0000","last_fullsized":"2024-05-08T20:55:04.090851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100626+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T20:55:04.100626+0000","last_peered":"2024-05-08T20:55:04.100626+0000","last_clean":"2024-05-08T20:55:04.100626+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T20:55:04.100626+0000","last_undegraded":"2024-05-08T20:55:04.100626+0000","last_fullsized":"2024-05-08T20:55:04.100626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105894+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T20:55:04.105894+0000","last_peered":"2024-05-08T20:55:04.105894+0000","last_clean":"2024-05-08T20:55:04.105894+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T20:55:04.105894+0000","last_undegraded":"2024-05-08T20:55:04.105894+0000","last_fullsized":"2024-05-08T20:55:04.105894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101412+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T20:55:04.101412+0000","last_peered":"2024-05-08T20:55:04.101412+0000","last_clean":"2024-05-08T20:55:04.101412+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T20:55:04.101412+0000","last_undegraded":"2024-05-08T20:55:04.101412+0000","last_fullsized":"2024-05-08T20:55:04.101412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102105+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T20:55:04.102105+0000","last_peered":"2024-05-08T20:55:04.102105+0000","last_clean":"2024-05-08T20:55:04.102105+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T20:55:04.102105+0000","last_undegraded":"2024-05-08T20:55:04.102105+0000","last_fullsized":"2024-05-08T20:55:04.102105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097726+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T20:55:04.097726+0000","last_peered":"2024-05-08T20:55:04.097726+0000","last_clean":"2024-05-08T20:55:04.097726+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T20:55:04.097726+0000","last_undegraded":"2024-05-08T20:55:04.097726+0000","last_fullsized":"2024-05-08T20:55:04.097726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210168+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T20:55:04.210168+0000","last_peered":"2024-05-08T20:55:04.210168+0000","last_clean":"2024-05-08T20:55:04.210168+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T20:55:04.210168+0000","last_undegraded":"2024-05-08T20:55:04.210168+0000","last_fullsized":"2024-05-08T20:55:04.210168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512517+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T20:55:04.512517+0000","last_peered":"2024-05-08T20:55:04.512517+0000","last_clean":"2024-05-08T20:55:04.512517+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T20:55:04.512517+0000","last_undegraded":"2024-05-08T20:55:04.512517+0000","last_fullsized":"2024-05-08T20:55:04.512517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:53.835534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100281+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T20:55:04.100281+0000","last_peered":"2024-05-08T20:55:04.100281+0000","last_clean":"2024-05-08T20:55:04.100281+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T20:55:04.100281+0000","last_undegraded":"2024-05-08T20:55:04.100281+0000","last_fullsized":"2024-05-08T20:55:04.100281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091690+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T20:55:04.091690+0000","last_peered":"2024-05-08T20:55:04.091690+0000","last_clean":"2024-05-08T20:55:04.091690+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T20:55:04.091690+0000","last_undegraded":"2024-05-08T20:55:04.091690+0000","last_fullsized":"2024-05-08T20:55:04.091690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519037+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T20:55:04.519037+0000","last_peered":"2024-05-08T20:55:04.519037+0000","last_clean":"2024-05-08T20:55:04.519037+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T20:55:04.519037+0000","last_undegraded":"2024-05-08T20:55:04.519037+0000","last_fullsized":"2024-05-08T20:55:04.519037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091796+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T20:55:04.091796+0000","last_peered":"2024-05-08T20:55:04.091796+0000","last_clean":"2024-05-08T20:55:04.091796+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T20:55:04.091796+0000","last_undegraded":"2024-05-08T20:55:04.091796+0000","last_fullsized":"2024-05-08T20:55:04.091796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100188+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T20:55:04.100188+0000","last_peered":"2024-05-08T20:55:04.100188+0000","last_clean":"2024-05-08T20:55:04.100188+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T20:55:04.100188+0000","last_undegraded":"2024-05-08T20:55:04.100188+0000","last_fullsized":"2024-05-08T20:55:04.100188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519193+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T20:55:04.519193+0000","last_peered":"2024-05-08T20:55:04.519193+0000","last_clean":"2024-05-08T20:55:04.519193+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T20:55:04.519193+0000","last_undegraded":"2024-05-08T20:55:04.519193+0000","last_fullsized":"2024-05-08T20:55:04.519193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:49.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209957+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T20:55:04.209957+0000","last_peered":"2024-05-08T20:55:04.209957+0000","last_clean":"2024-05-08T20:55:04.209957+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T20:55:04.209957+0000","last_undegraded":"2024-05-08T20:55:04.209957+0000","last_fullsized":"2024-05-08T20:55:04.209957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101756+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T20:55:04.101756+0000","last_peered":"2024-05-08T20:55:04.101756+0000","last_clean":"2024-05-08T20:55:04.101756+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T20:55:04.101756+0000","last_undegraded":"2024-05-08T20:55:04.101756+0000","last_fullsized":"2024-05-08T20:55:04.101756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519088+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T20:55:04.519088+0000","last_peered":"2024-05-08T20:55:04.519088+0000","last_clean":"2024-05-08T20:55:04.519088+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T20:55:04.519088+0000","last_undegraded":"2024-05-08T20:55:04.519088+0000","last_fullsized":"2024-05-08T20:55:04.519088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209700+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T20:55:04.209700+0000","last_peered":"2024-05-08T20:55:04.209700+0000","last_clean":"2024-05-08T20:55:04.209700+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T20:55:04.209700+0000","last_undegraded":"2024-05-08T20:55:04.209700+0000","last_fullsized":"2024-05-08T20:55:04.209700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102182+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T20:55:04.102182+0000","last_peered":"2024-05-08T20:55:04.102182+0000","last_clean":"2024-05-08T20:55:04.102182+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T20:55:04.102182+0000","last_undegraded":"2024-05-08T20:55:04.102182+0000","last_fullsized":"2024-05-08T20:55:04.102182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512895+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T20:55:04.512895+0000","last_peered":"2024-05-08T20:55:04.512895+0000","last_clean":"2024-05-08T20:55:04.512895+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T20:55:04.512895+0000","last_undegraded":"2024-05-08T20:55:04.512895+0000","last_fullsized":"2024-05-08T20:55:04.512895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:15.767597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091524+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T20:55:04.091524+0000","last_peered":"2024-05-08T20:55:04.091524+0000","last_clean":"2024-05-08T20:55:04.091524+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T20:55:04.091524+0000","last_undegraded":"2024-05-08T20:55:04.091524+0000","last_fullsized":"2024-05-08T20:55:04.091524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.094714+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T20:55:04.094714+0000","last_peered":"2024-05-08T20:55:04.094714+0000","last_clean":"2024-05-08T20:55:04.094714+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T20:55:04.094714+0000","last_undegraded":"2024-05-08T20:55:04.094714+0000","last_fullsized":"2024-05-08T20:55:04.094714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:00.135628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872171+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T20:55:04.872171+0000","last_peered":"2024-05-08T20:55:04.872171+0000","last_clean":"2024-05-08T20:55:04.872171+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T20:55:04.872171+0000","last_undegraded":"2024-05-08T20:55:04.872171+0000","last_fullsized":"2024-05-08T20:55:04.872171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:52.925278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092648+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T20:55:04.092648+0000","last_peered":"2024-05-08T20:55:04.092648+0000","last_clean":"2024-05-08T20:55:04.092648+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T20:55:04.092648+0000","last_undegraded":"2024-05-08T20:55:04.092648+0000","last_fullsized":"2024-05-08T20:55:04.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100316+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T20:55:04.100316+0000","last_peered":"2024-05-08T20:55:04.100316+0000","last_clean":"2024-05-08T20:55:04.100316+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T20:55:04.100316+0000","last_undegraded":"2024-05-08T20:55:04.100316+0000","last_fullsized":"2024-05-08T20:55:04.100316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655299+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T20:55:04.655299+0000","last_peered":"2024-05-08T20:55:04.655299+0000","last_clean":"2024-05-08T20:55:04.655299+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T20:55:04.655299+0000","last_undegraded":"2024-05-08T20:55:04.655299+0000","last_fullsized":"2024-05-08T20:55:04.655299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090657+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T20:55:04.090657+0000","last_peered":"2024-05-08T20:55:04.090657+0000","last_clean":"2024-05-08T20:55:04.090657+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T20:55:04.090657+0000","last_undegraded":"2024-05-08T20:55:04.090657+0000","last_fullsized":"2024-05-08T20:55:04.090657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090599+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T20:55:04.090599+0000","last_peered":"2024-05-08T20:55:04.090599+0000","last_clean":"2024-05-08T20:55:04.090599+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T20:55:04.090599+0000","last_undegraded":"2024-05-08T20:55:04.090599+0000","last_fullsized":"2024-05-08T20:55:04.090599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.874020+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T20:55:04.874020+0000","last_peered":"2024-05-08T20:55:04.874020+0000","last_clean":"2024-05-08T20:55:04.874020+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T20:55:04.874020+0000","last_undegraded":"2024-05-08T20:55:04.874020+0000","last_fullsized":"2024-05-08T20:55:04.874020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101470+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T20:55:04.101470+0000","last_peered":"2024-05-08T20:55:04.101470+0000","last_clean":"2024-05-08T20:55:04.101470+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T20:55:04.101470+0000","last_undegraded":"2024-05-08T20:55:04.101470+0000","last_fullsized":"2024-05-08T20:55:04.101470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105915+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T20:55:04.105915+0000","last_peered":"2024-05-08T20:55:04.105915+0000","last_clean":"2024-05-08T20:55:04.105915+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T20:55:04.105915+0000","last_undegraded":"2024-05-08T20:55:04.105915+0000","last_fullsized":"2024-05-08T20:55:04.105915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512493+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T20:55:04.512493+0000","last_peered":"2024-05-08T20:55:04.512493+0000","last_clean":"2024-05-08T20:55:04.512493+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T20:55:04.512493+0000","last_undegraded":"2024-05-08T20:55:04.512493+0000","last_fullsized":"2024-05-08T20:55:04.512493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:25.005036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093315+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T20:55:04.093315+0000","last_peered":"2024-05-08T20:55:04.093315+0000","last_clean":"2024-05-08T20:55:04.093315+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T20:55:04.093315+0000","last_undegraded":"2024-05-08T20:55:04.093315+0000","last_fullsized":"2024-05-08T20:55:04.093315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101936+0000","last_change":"2024-05-08T20:55:00.101507+0000","last_active":"2024-05-08T20:55:04.101936+0000","last_peered":"2024-05-08T20:55:04.101936+0000","last_clean":"2024-05-08T20:55:04.101936+0000","last_became_active":"2024-05-08T20:55:00.101218+0000","last_became_peered":"2024-05-08T20:55:00.101218+0000","last_unstale":"2024-05-08T20:55:04.101936+0000","last_undegraded":"2024-05-08T20:55:04.101936+0000","last_fullsized":"2024-05-08T20:55:04.101936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512444+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T20:55:04.512444+0000","last_peered":"2024-05-08T20:55:04.512444+0000","last_clean":"2024-05-08T20:55:04.512444+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T20:55:04.512444+0000","last_undegraded":"2024-05-08T20:55:04.512444+0000","last_fullsized":"2024-05-08T20:55:04.512444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101935+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T20:55:04.101935+0000","last_peered":"2024-05-08T20:55:04.101935+0000","last_clean":"2024-05-08T20:55:04.101935+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T20:55:04.101935+0000","last_undegraded":"2024-05-08T20:55:04.101935+0000","last_fullsized":"2024-05-08T20:55:04.101935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100361+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T20:55:04.100361+0000","last_peered":"2024-05-08T20:55:04.100361+0000","last_clean":"2024-05-08T20:55:04.100361+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T20:55:04.100361+0000","last_undegraded":"2024-05-08T20:55:04.100361+0000","last_fullsized":"2024-05-08T20:55:04.100361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519609+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T20:55:04.519609+0000","last_peered":"2024-05-08T20:55:04.519609+0000","last_clean":"2024-05-08T20:55:04.519609+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T20:55:04.519609+0000","last_undegraded":"2024-05-08T20:55:04.519609+0000","last_fullsized":"2024-05-08T20:55:04.519609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106365+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T20:55:04.106365+0000","last_peered":"2024-05-08T20:55:04.106365+0000","last_clean":"2024-05-08T20:55:04.106365+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T20:55:04.106365+0000","last_undegraded":"2024-05-08T20:55:04.106365+0000","last_fullsized":"2024-05-08T20:55:04.106365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095830+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T20:55:04.095830+0000","last_peered":"2024-05-08T20:55:04.095830+0000","last_clean":"2024-05-08T20:55:04.095830+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T20:55:04.095830+0000","last_undegraded":"2024-05-08T20:55:04.095830+0000","last_fullsized":"2024-05-08T20:55:04.095830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872220+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T20:55:04.872220+0000","last_peered":"2024-05-08T20:55:04.872220+0000","last_clean":"2024-05-08T20:55:04.872220+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T20:55:04.872220+0000","last_undegraded":"2024-05-08T20:55:04.872220+0000","last_fullsized":"2024-05-08T20:55:04.872220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:09.651925+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T20:55:09.651925+0000","last_peered":"2024-05-08T20:55:09.651925+0000","last_clean":"2024-05-08T20:55:09.651925+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T20:55:09.651925+0000","last_undegraded":"2024-05-08T20:55:09.651925+0000","last_fullsized":"2024-05-08T20:55:09.651925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210218+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T20:55:04.210218+0000","last_peered":"2024-05-08T20:55:04.210218+0000","last_clean":"2024-05-08T20:55:04.210218+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T20:55:04.210218+0000","last_undegraded":"2024-05-08T20:55:04.210218+0000","last_fullsized":"2024-05-08T20:55:04.210218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.517096+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T20:55:04.517096+0000","last_peered":"2024-05-08T20:55:04.517096+0000","last_clean":"2024-05-08T20:55:04.517096+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T20:55:04.517096+0000","last_undegraded":"2024-05-08T20:55:04.517096+0000","last_fullsized":"2024-05-08T20:55:04.517096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100573+0000","last_change":"2024-05-08T20:54:59.629962+0000","last_active":"2024-05-08T20:55:04.100573+0000","last_peered":"2024-05-08T20:55:04.100573+0000","last_clean":"2024-05-08T20:55:04.100573+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T20:55:04.100573+0000","last_undegraded":"2024-05-08T20:55:04.100573+0000","last_fullsized":"2024-05-08T20:55:04.100573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100713+0000","last_change":"2024-05-08T20:55:00.102710+0000","last_active":"2024-05-08T20:55:04.100713+0000","last_peered":"2024-05-08T20:55:04.100713+0000","last_clean":"2024-05-08T20:55:04.100713+0000","last_became_active":"2024-05-08T20:55:00.102463+0000","last_became_peered":"2024-05-08T20:55:00.102463+0000","last_unstale":"2024-05-08T20:55:04.100713+0000","last_undegraded":"2024-05-08T20:55:04.100713+0000","last_fullsized":"2024-05-08T20:55:04.100713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512860+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T20:55:04.512860+0000","last_peered":"2024-05-08T20:55:04.512860+0000","last_clean":"2024-05-08T20:55:04.512860+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T20:55:04.512860+0000","last_undegraded":"2024-05-08T20:55:04.512860+0000","last_fullsized":"2024-05-08T20:55:04.512860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.959849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101724+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T20:55:04.101724+0000","last_peered":"2024-05-08T20:55:04.101724+0000","last_clean":"2024-05-08T20:55:04.101724+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T20:55:04.101724+0000","last_undegraded":"2024-05-08T20:55:04.101724+0000","last_fullsized":"2024-05-08T20:55:04.101724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209759+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T20:55:04.209759+0000","last_peered":"2024-05-08T20:55:04.209759+0000","last_clean":"2024-05-08T20:55:04.209759+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T20:55:04.209759+0000","last_undegraded":"2024-05-08T20:55:04.209759+0000","last_fullsized":"2024-05-08T20:55:04.209759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512867+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T20:55:04.512867+0000","last_peered":"2024-05-08T20:55:04.512867+0000","last_clean":"2024-05-08T20:55:04.512867+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T20:55:04.512867+0000","last_undegraded":"2024-05-08T20:55:04.512867+0000","last_fullsized":"2024-05-08T20:55:04.512867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:34.555272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091308+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T20:55:04.091308+0000","last_peered":"2024-05-08T20:55:04.091308+0000","last_clean":"2024-05-08T20:55:04.091308+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T20:55:04.091308+0000","last_undegraded":"2024-05-08T20:55:04.091308+0000","last_fullsized":"2024-05-08T20:55:04.091308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092009+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T20:55:04.092009+0000","last_peered":"2024-05-08T20:55:04.092009+0000","last_clean":"2024-05-08T20:55:04.092009+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T20:55:04.092009+0000","last_undegraded":"2024-05-08T20:55:04.092009+0000","last_fullsized":"2024-05-08T20:55:04.092009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097710+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T20:55:04.097710+0000","last_peered":"2024-05-08T20:55:04.097710+0000","last_clean":"2024-05-08T20:55:04.097710+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T20:55:04.097710+0000","last_undegraded":"2024-05-08T20:55:04.097710+0000","last_fullsized":"2024-05-08T20:55:04.097710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209633+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T20:55:04.209633+0000","last_peered":"2024-05-08T20:55:04.209633+0000","last_clean":"2024-05-08T20:55:04.209633+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T20:55:04.209633+0000","last_undegraded":"2024-05-08T20:55:04.209633+0000","last_fullsized":"2024-05-08T20:55:04.209633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518929+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T20:55:04.518929+0000","last_peered":"2024-05-08T20:55:04.518929+0000","last_clean":"2024-05-08T20:55:04.518929+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T20:55:04.518929+0000","last_undegraded":"2024-05-08T20:55:04.518929+0000","last_fullsized":"2024-05-08T20:55:04.518929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095787+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T20:55:04.095787+0000","last_peered":"2024-05-08T20:55:04.095787+0000","last_clean":"2024-05-08T20:55:04.095787+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T20:55:04.095787+0000","last_undegraded":"2024-05-08T20:55:04.095787+0000","last_fullsized":"2024-05-08T20:55:04.095787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:17.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210177+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T20:55:04.210177+0000","last_peered":"2024-05-08T20:55:04.210177+0000","last_clean":"2024-05-08T20:55:04.210177+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T20:55:04.210177+0000","last_undegraded":"2024-05-08T20:55:04.210177+0000","last_fullsized":"2024-05-08T20:55:04.210177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871830+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T20:55:04.871830+0000","last_peered":"2024-05-08T20:55:04.871830+0000","last_clean":"2024-05-08T20:55:04.871830+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T20:55:04.871830+0000","last_undegraded":"2024-05-08T20:55:04.871830+0000","last_fullsized":"2024-05-08T20:55:04.871830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106256+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T20:55:04.106256+0000","last_peered":"2024-05-08T20:55:04.106256+0000","last_clean":"2024-05-08T20:55:04.106256+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T20:55:04.106256+0000","last_undegraded":"2024-05-08T20:55:04.106256+0000","last_fullsized":"2024-05-08T20:55:04.106256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102154+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T20:55:04.102154+0000","last_peered":"2024-05-08T20:55:04.102154+0000","last_clean":"2024-05-08T20:55:04.102154+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T20:55:04.102154+0000","last_undegraded":"2024-05-08T20:55:04.102154+0000","last_fullsized":"2024-05-08T20:55:04.102154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.871697+0000","last_change":"2024-05-08T20:55:04.117093+0000","last_active":"2024-05-08T20:55:04.871697+0000","last_peered":"2024-05-08T20:55:04.871697+0000","last_clean":"2024-05-08T20:55:04.871697+0000","last_became_active":"2024-05-08T20:55:04.115995+0000","last_became_peered":"2024-05-08T20:55:04.115995+0000","last_unstale":"2024-05-08T20:55:04.871697+0000","last_undegraded":"2024-05-08T20:55:04.871697+0000","last_fullsized":"2024-05-08T20:55:04.871697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101637+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T20:55:04.101637+0000","last_peered":"2024-05-08T20:55:04.101637+0000","last_clean":"2024-05-08T20:55:04.101637+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T20:55:04.101637+0000","last_undegraded":"2024-05-08T20:55:04.101637+0000","last_fullsized":"2024-05-08T20:55:04.101637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095588+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T20:55:04.095588+0000","last_peered":"2024-05-08T20:55:04.095588+0000","last_clean":"2024-05-08T20:55:04.095588+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T20:55:04.095588+0000","last_undegraded":"2024-05-08T20:55:04.095588+0000","last_fullsized":"2024-05-08T20:55:04.095588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:30.883278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872006+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T20:55:04.872006+0000","last_peered":"2024-05-08T20:55:04.872006+0000","last_clean":"2024-05-08T20:55:04.872006+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T20:55:04.872006+0000","last_undegraded":"2024-05-08T20:55:04.872006+0000","last_fullsized":"2024-05-08T20:55:04.872006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105577+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T20:55:04.105577+0000","last_peered":"2024-05-08T20:55:04.105577+0000","last_clean":"2024-05-08T20:55:04.105577+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T20:55:04.105577+0000","last_undegraded":"2024-05-08T20:55:04.105577+0000","last_fullsized":"2024-05-08T20:55:04.105577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097867+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T20:55:04.097867+0000","last_peered":"2024-05-08T20:55:04.097867+0000","last_clean":"2024-05-08T20:55:04.097867+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T20:55:04.097867+0000","last_undegraded":"2024-05-08T20:55:04.097867+0000","last_fullsized":"2024-05-08T20:55:04.097867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.655085+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T20:55:04.655085+0000","last_peered":"2024-05-08T20:55:04.655085+0000","last_clean":"2024-05-08T20:55:04.655085+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T20:55:04.655085+0000","last_undegraded":"2024-05-08T20:55:04.655085+0000","last_fullsized":"2024-05-08T20:55:04.655085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090921+0000","last_change":"2024-05-08T20:55:00.091803+0000","last_active":"2024-05-08T20:55:04.090921+0000","last_peered":"2024-05-08T20:55:04.090921+0000","last_clean":"2024-05-08T20:55:04.090921+0000","last_became_active":"2024-05-08T20:55:00.091556+0000","last_became_peered":"2024-05-08T20:55:00.091556+0000","last_unstale":"2024-05-08T20:55:04.090921+0000","last_undegraded":"2024-05-08T20:55:04.090921+0000","last_fullsized":"2024-05-08T20:55:04.090921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101787+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T20:55:04.101787+0000","last_peered":"2024-05-08T20:55:04.101787+0000","last_clean":"2024-05-08T20:55:04.101787+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T20:55:04.101787+0000","last_undegraded":"2024-05-08T20:55:04.101787+0000","last_fullsized":"2024-05-08T20:55:04.101787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209118+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T20:55:04.209118+0000","last_peered":"2024-05-08T20:55:04.209118+0000","last_clean":"2024-05-08T20:55:04.209118+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T20:55:04.209118+0000","last_undegraded":"2024-05-08T20:55:04.209118+0000","last_fullsized":"2024-05-08T20:55:04.209118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873904+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T20:55:04.873904+0000","last_peered":"2024-05-08T20:55:04.873904+0000","last_clean":"2024-05-08T20:55:04.873904+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T20:55:04.873904+0000","last_undegraded":"2024-05-08T20:55:04.873904+0000","last_fullsized":"2024-05-08T20:55:04.873904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101104+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T20:55:04.101104+0000","last_peered":"2024-05-08T20:55:04.101104+0000","last_clean":"2024-05-08T20:55:04.101104+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T20:55:04.101104+0000","last_undegraded":"2024-05-08T20:55:04.101104+0000","last_fullsized":"2024-05-08T20:55:04.101104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:16.831824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209208+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T20:55:04.209208+0000","last_peered":"2024-05-08T20:55:04.209208+0000","last_clean":"2024-05-08T20:55:04.209208+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T20:55:04.209208+0000","last_undegraded":"2024-05-08T20:55:04.209208+0000","last_fullsized":"2024-05-08T20:55:04.209208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873248+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T20:55:04.873248+0000","last_peered":"2024-05-08T20:55:04.873248+0000","last_clean":"2024-05-08T20:55:04.873248+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T20:55:04.873248+0000","last_undegraded":"2024-05-08T20:55:04.873248+0000","last_fullsized":"2024-05-08T20:55:04.873248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209773+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T20:55:04.209773+0000","last_peered":"2024-05-08T20:55:04.209773+0000","last_clean":"2024-05-08T20:55:04.209773+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T20:55:04.209773+0000","last_undegraded":"2024-05-08T20:55:04.209773+0000","last_fullsized":"2024-05-08T20:55:04.209773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106292+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T20:55:04.106292+0000","last_peered":"2024-05-08T20:55:04.106292+0000","last_clean":"2024-05-08T20:55:04.106292+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T20:55:04.106292+0000","last_undegraded":"2024-05-08T20:55:04.106292+0000","last_fullsized":"2024-05-08T20:55:04.106292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.512323+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T20:55:04.512323+0000","last_peered":"2024-05-08T20:55:04.512323+0000","last_clean":"2024-05-08T20:55:04.512323+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T20:55:04.512323+0000","last_undegraded":"2024-05-08T20:55:04.512323+0000","last_fullsized":"2024-05-08T20:55:04.512323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:18.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106745+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T20:55:04.106745+0000","last_peered":"2024-05-08T20:55:04.106745+0000","last_clean":"2024-05-08T20:55:04.106745+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T20:55:04.106745+0000","last_undegraded":"2024-05-08T20:55:04.106745+0000","last_fullsized":"2024-05-08T20:55:04.106745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091711+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T20:55:04.091711+0000","last_peered":"2024-05-08T20:55:04.091711+0000","last_clean":"2024-05-08T20:55:04.091711+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T20:55:04.091711+0000","last_undegraded":"2024-05-08T20:55:04.091711+0000","last_fullsized":"2024-05-08T20:55:04.091711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.518932+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T20:55:04.518932+0000","last_peered":"2024-05-08T20:55:04.518932+0000","last_clean":"2024-05-08T20:55:04.518932+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T20:55:04.518932+0000","last_undegraded":"2024-05-08T20:55:04.518932+0000","last_fullsized":"2024-05-08T20:55:04.518932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:59.610624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.093217+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T20:55:04.093217+0000","last_peered":"2024-05-08T20:55:04.093217+0000","last_clean":"2024-05-08T20:55:04.093217+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T20:55:04.093217+0000","last_undegraded":"2024-05-08T20:55:04.093217+0000","last_fullsized":"2024-05-08T20:55:04.093217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101416+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T20:55:04.101416+0000","last_peered":"2024-05-08T20:55:04.101416+0000","last_clean":"2024-05-08T20:55:04.101416+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T20:55:04.101416+0000","last_undegraded":"2024-05-08T20:55:04.101416+0000","last_fullsized":"2024-05-08T20:55:04.101416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519324+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T20:55:04.519324+0000","last_peered":"2024-05-08T20:55:04.519324+0000","last_clean":"2024-05-08T20:55:04.519324+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T20:55:04.519324+0000","last_undegraded":"2024-05-08T20:55:04.519324+0000","last_fullsized":"2024-05-08T20:55:04.519324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209104+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T20:55:04.209104+0000","last_peered":"2024-05-08T20:55:04.209104+0000","last_clean":"2024-05-08T20:55:04.209104+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T20:55:04.209104+0000","last_undegraded":"2024-05-08T20:55:04.209104+0000","last_fullsized":"2024-05-08T20:55:04.209104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.095004+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T20:55:04.095004+0000","last_peered":"2024-05-08T20:55:04.095004+0000","last_clean":"2024-05-08T20:55:04.095004+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T20:55:04.095004+0000","last_undegraded":"2024-05-08T20:55:04.095004+0000","last_fullsized":"2024-05-08T20:55:04.095004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.899173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.872102+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T20:55:04.872102+0000","last_peered":"2024-05-08T20:55:04.872102+0000","last_clean":"2024-05-08T20:55:04.872102+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T20:55:04.872102+0000","last_undegraded":"2024-05-08T20:55:04.872102+0000","last_fullsized":"2024-05-08T20:55:04.872102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.105823+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T20:55:04.105823+0000","last_peered":"2024-05-08T20:55:04.105823+0000","last_clean":"2024-05-08T20:55:04.105823+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T20:55:04.105823+0000","last_undegraded":"2024-05-08T20:55:04.105823+0000","last_fullsized":"2024-05-08T20:55:04.105823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090691+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T20:55:04.090691+0000","last_peered":"2024-05-08T20:55:04.090691+0000","last_clean":"2024-05-08T20:55:04.090691+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T20:55:04.090691+0000","last_undegraded":"2024-05-08T20:55:04.090691+0000","last_fullsized":"2024-05-08T20:55:04.090691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519380+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T20:55:04.519380+0000","last_peered":"2024-05-08T20:55:04.519380+0000","last_clean":"2024-05-08T20:55:04.519380+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T20:55:04.519380+0000","last_undegraded":"2024-05-08T20:55:04.519380+0000","last_fullsized":"2024-05-08T20:55:04.519380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:27.059976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106930+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T20:55:04.106930+0000","last_peered":"2024-05-08T20:55:04.106930+0000","last_clean":"2024-05-08T20:55:04.106930+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T20:55:04.106930+0000","last_undegraded":"2024-05-08T20:55:04.106930+0000","last_fullsized":"2024-05-08T20:55:04.106930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091617+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T20:55:04.091617+0000","last_peered":"2024-05-08T20:55:04.091617+0000","last_clean":"2024-05-08T20:55:04.091617+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T20:55:04.091617+0000","last_undegraded":"2024-05-08T20:55:04.091617+0000","last_fullsized":"2024-05-08T20:55:04.091617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.519561+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T20:55:04.519561+0000","last_peered":"2024-05-08T20:55:04.519561+0000","last_clean":"2024-05-08T20:55:04.519561+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T20:55:04.519561+0000","last_undegraded":"2024-05-08T20:55:04.519561+0000","last_fullsized":"2024-05-08T20:55:04.519561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.209808+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T20:55:04.209808+0000","last_peered":"2024-05-08T20:55:04.209808+0000","last_clean":"2024-05-08T20:55:04.209808+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T20:55:04.209808+0000","last_undegraded":"2024-05-08T20:55:04.209808+0000","last_fullsized":"2024-05-08T20:55:04.209808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092750+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T20:55:04.092750+0000","last_peered":"2024-05-08T20:55:04.092750+0000","last_clean":"2024-05-08T20:55:04.092750+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T20:55:04.092750+0000","last_undegraded":"2024-05-08T20:55:04.092750+0000","last_fullsized":"2024-05-08T20:55:04.092750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.654813+0000","last_change":"2024-05-08T20:55:04.211367+0000","last_active":"2024-05-08T20:55:04.654813+0000","last_peered":"2024-05-08T20:55:04.654813+0000","last_clean":"2024-05-08T20:55:04.654813+0000","last_became_active":"2024-05-08T20:55:04.210862+0000","last_became_peered":"2024-05-08T20:55:04.210862+0000","last_unstale":"2024-05-08T20:55:04.654813+0000","last_undegraded":"2024-05-08T20:55:04.654813+0000","last_fullsized":"2024-05-08T20:55:04.654813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097858+0000","last_change":"2024-05-08T20:54:59.625358+0000","last_active":"2024-05-08T20:55:04.097858+0000","last_peered":"2024-05-08T20:55:04.097858+0000","last_clean":"2024-05-08T20:55:04.097858+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T20:55:04.097858+0000","last_undegraded":"2024-05-08T20:55:04.097858+0000","last_fullsized":"2024-05-08T20:55:04.097858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210050+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T20:55:04.210050+0000","last_peered":"2024-05-08T20:55:04.210050+0000","last_clean":"2024-05-08T20:55:04.210050+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T20:55:04.210050+0000","last_undegraded":"2024-05-08T20:55:04.210050+0000","last_fullsized":"2024-05-08T20:55:04.210050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.873140+0000","last_change":"2024-05-08T20:55:04.116701+0000","last_active":"2024-05-08T20:55:04.873140+0000","last_peered":"2024-05-08T20:55:04.873140+0000","last_clean":"2024-05-08T20:55:04.873140+0000","last_became_active":"2024-05-08T20:55:04.116308+0000","last_became_peered":"2024-05-08T20:55:04.116308+0000","last_unstale":"2024-05-08T20:55:04.873140+0000","last_undegraded":"2024-05-08T20:55:04.873140+0000","last_fullsized":"2024-05-08T20:55:04.873140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106286+0000","last_change":"2024-05-08T20:54:59.618192+0000","last_active":"2024-05-08T20:55:04.106286+0000","last_peered":"2024-05-08T20:55:04.106286+0000","last_clean":"2024-05-08T20:55:04.106286+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T20:55:04.106286+0000","last_undegraded":"2024-05-08T20:55:04.106286+0000","last_fullsized":"2024-05-08T20:55:04.106286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101864+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T20:55:04.101864+0000","last_peered":"2024-05-08T20:55:04.101864+0000","last_clean":"2024-05-08T20:55:04.101864+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T20:55:04.101864+0000","last_undegraded":"2024-05-08T20:55:04.101864+0000","last_fullsized":"2024-05-08T20:55:04.101864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.516609+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T20:55:04.516609+0000","last_peered":"2024-05-08T20:55:04.516609+0000","last_clean":"2024-05-08T20:55:04.516609+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T20:55:04.516609+0000","last_undegraded":"2024-05-08T20:55:04.516609+0000","last_fullsized":"2024-05-08T20:55:04.516609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097649+0000","last_change":"2024-05-08T20:54:59.623921+0000","last_active":"2024-05-08T20:55:04.097649+0000","last_peered":"2024-05-08T20:55:04.097649+0000","last_clean":"2024-05-08T20:55:04.097649+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T20:55:04.097649+0000","last_undegraded":"2024-05-08T20:55:04.097649+0000","last_fullsized":"2024-05-08T20:55:04.097649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.210761+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T20:55:04.210761+0000","last_peered":"2024-05-08T20:55:04.210761+0000","last_clean":"2024-05-08T20:55:04.210761+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T20:55:04.210761+0000","last_undegraded":"2024-05-08T20:55:04.210761+0000","last_fullsized":"2024-05-08T20:55:04.210761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.092114+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T20:55:04.092114+0000","last_peered":"2024-05-08T20:55:04.092114+0000","last_clean":"2024-05-08T20:55:04.092114+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T20:55:04.092114+0000","last_undegraded":"2024-05-08T20:55:04.092114+0000","last_fullsized":"2024-05-08T20:55:04.092114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.097934+0000","last_change":"2024-05-08T20:55:00.088933+0000","last_active":"2024-05-08T20:55:04.097934+0000","last_peered":"2024-05-08T20:55:04.097934+0000","last_clean":"2024-05-08T20:55:04.097934+0000","last_became_active":"2024-05-08T20:55:00.088651+0000","last_became_peered":"2024-05-08T20:55:00.088651+0000","last_unstale":"2024-05-08T20:55:04.097934+0000","last_undegraded":"2024-05-08T20:55:04.097934+0000","last_fullsized":"2024-05-08T20:55:04.097934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102032+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T20:55:04.102032+0000","last_peered":"2024-05-08T20:55:04.102032+0000","last_clean":"2024-05-08T20:55:04.102032+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T20:55:04.102032+0000","last_undegraded":"2024-05-08T20:55:04.102032+0000","last_fullsized":"2024-05-08T20:55:04.102032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100404+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T20:55:04.100404+0000","last_peered":"2024-05-08T20:55:04.100404+0000","last_clean":"2024-05-08T20:55:04.100404+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T20:55:04.100404+0000","last_undegraded":"2024-05-08T20:55:04.100404+0000","last_fullsized":"2024-05-08T20:55:04.100404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091752+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T20:55:04.091752+0000","last_peered":"2024-05-08T20:55:04.091752+0000","last_clean":"2024-05-08T20:55:04.091752+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T20:55:04.091752+0000","last_undegraded":"2024-05-08T20:55:04.091752+0000","last_fullsized":"2024-05-08T20:55:04.091752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.106193+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T20:55:04.106193+0000","last_peered":"2024-05-08T20:55:04.106193+0000","last_clean":"2024-05-08T20:55:04.106193+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T20:55:04.106193+0000","last_undegraded":"2024-05-08T20:55:04.106193+0000","last_fullsized":"2024-05-08T20:55:04.106193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091956+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T20:55:04.091956+0000","last_peered":"2024-05-08T20:55:04.091956+0000","last_clean":"2024-05-08T20:55:04.091956+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T20:55:04.091956+0000","last_undegraded":"2024-05-08T20:55:04.091956+0000","last_fullsized":"2024-05-08T20:55:04.091956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091800+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T20:55:04.091800+0000","last_peered":"2024-05-08T20:55:04.091800+0000","last_clean":"2024-05-08T20:55:04.091800+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T20:55:04.091800+0000","last_undegraded":"2024-05-08T20:55:04.091800+0000","last_fullsized":"2024-05-08T20:55:04.091800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.101516+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T20:55:04.101516+0000","last_peered":"2024-05-08T20:55:04.101516+0000","last_clean":"2024-05-08T20:55:04.101516+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T20:55:04.101516+0000","last_undegraded":"2024-05-08T20:55:04.101516+0000","last_fullsized":"2024-05-08T20:55:04.101516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.090738+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T20:55:04.090738+0000","last_peered":"2024-05-08T20:55:04.090738+0000","last_clean":"2024-05-08T20:55:04.090738+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T20:55:04.090738+0000","last_undegraded":"2024-05-08T20:55:04.090738+0000","last_fullsized":"2024-05-08T20:55:04.090738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.102133+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T20:55:04.102133+0000","last_peered":"2024-05-08T20:55:04.102133+0000","last_clean":"2024-05-08T20:55:04.102133+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T20:55:04.102133+0000","last_undegraded":"2024-05-08T20:55:04.102133+0000","last_fullsized":"2024-05-08T20:55:04.102133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.100484+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T20:55:04.100484+0000","last_peered":"2024-05-08T20:55:04.100484+0000","last_clean":"2024-05-08T20:55:04.100484+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T20:55:04.100484+0000","last_undegraded":"2024-05-08T20:55:04.100484+0000","last_fullsized":"2024-05-08T20:55:04.100484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-08T20:55:04.091573+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T20:55:04.091573+0000","last_peered":"2024-05-08T20:55:04.091573+0000","last_clean":"2024-05-08T20:55:04.091573+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T20:55:04.091573+0000","last_undegraded":"2024-05-08T20:55:04.091573+0000","last_fullsized":"2024-05-08T20:55:04.091573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":695401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":104577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":104541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:55:29.436 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T20:55:29.436 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T20:55:29.436 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T20:55:29.436 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T20:55:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.590+0000 7f5bf9412700 1 Processor -- start 2024-05-08T20:55:29.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.590+0000 7f5bf9412700 1 -- start start 2024-05-08T20:55:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf9412700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf4153720 0x7f5bf41593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf9412700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5bf41598e0 0x7f5bf4163d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf9412700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf406ad30 con 0x7f5bf415d3a0 2024-05-08T20:55:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf9412700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf406b080 con 0x7f5bf41598e0 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf9412700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4153b00 con 0x7f5bf4153720 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5bf41598e0 0x7f5bf4163d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5bf41598e0 0x7f5bf4163d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33342/0 (socket says 172.21.15.135:33342) 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 -- 172.21.15.135:0/1275002645 learned_addr learned my addr 172.21.15.135:0/1275002645 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf2ffd700 1 --2- 172.21.15.135:0/1275002645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf4153720 0x7f5bf41593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 -- 172.21.15.135:0/1275002645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf4153720 msgr2=0x7f5bf41593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 --2- 172.21.15.135:0/1275002645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf4153720 0x7f5bf41593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 -- 172.21.15.135:0/1275002645 >> v1:172.21.15.183:6789/0 conn(0x7f5bf415d3a0 legacy=0x7f5bf406fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 -- 172.21.15.135:0/1275002645 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf415d890 con 0x7f5bf41598e0 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf37fe700 1 --2- 172.21.15.135:0/1275002645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf41598e0 0x7f5bf4163d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009e50 tx=0x7f5bec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71830109d9682792 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf1ffb700 1 -- 172.21.15.135:0/1275002645 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00e070 con 0x7f5bf41598e0 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf1ffb700 1 -- 172.21.15.135:0/1275002645 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec00b910 con 0x7f5bf41598e0 2024-05-08T20:55:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.591+0000 7f5bf1ffb700 1 -- 172.21.15.135:0/1275002645 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00bcc0 con 0x7f5bf41598e0 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 -- 172.21.15.135:0/1275002645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf41598e0 msgr2=0x7f5bf4163d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1275002645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf41598e0 0x7f5bf4163d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009e50 tx=0x7f5bec00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 -- 172.21.15.135:0/1275002645 shutdown_connections 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1275002645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf41598e0 0x7f5bf4163d20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1275002645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf4153720 0x7f5bf41593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 -- 172.21.15.135:0/1275002645 >> 172.21.15.135:0/1275002645 conn(0x7f5bf40725e0 msgr2=0x7f5bf406daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 -- 172.21.15.135:0/1275002645 shutdown_connections 2024-05-08T20:55:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.592+0000 7f5bf9412700 1 -- 172.21.15.135:0/1275002645 wait complete. 2024-05-08T20:55:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.593+0000 7f5bf9412700 1 Processor -- start 2024-05-08T20:55:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.593+0000 7f5bf9412700 1 -- start start 2024-05-08T20:55:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf9412700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf4153720 0x7f5bf41efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf9412700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf41598e0 0x7f5bf41e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf9412700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf415d3a0 0x7f5bf414f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf9412700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf41f0170 con 0x7f5bf4153720 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf9412700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4153d90 con 0x7f5bf415d3a0 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf9412700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf415a700 con 0x7f5bf41598e0 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf4153720 0x7f5bf41efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf4153720 0x7f5bf41efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33358/0 (socket says 172.21.15.135:33358) 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 -- 172.21.15.135:0/1758126289 learned_addr learned my addr 172.21.15.135:0/1758126289 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf37fe700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf415d3a0 0x7f5bf414f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf27fc700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf41598e0 0x7f5bf41e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 -- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf41598e0 msgr2=0x7f5bf41e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf41598e0 0x7f5bf41e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 -- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf415d3a0 msgr2=0x7f5bf414f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf415d3a0 0x7f5bf414f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.594+0000 7f5bf2ffd700 1 -- 172.21.15.135:0/1758126289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009b30 con 0x7f5bf4153720 2024-05-08T20:55:29.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.595+0000 7f5bf2ffd700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf4153720 0x7f5bf41efc30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5be400e870 tx=0x7f5be400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.595+0000 7f5bdb7fe700 1 -- 172.21.15.135:0/1758126289 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4009590 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.595+0000 7f5bdb7fe700 1 -- 172.21.15.135:0/1758126289 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be4013680 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.595+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf4150c70 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.595+0000 7f5bdb7fe700 1 -- 172.21.15.135:0/1758126289 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be40139f0 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.595+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf4151230 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.596+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf40c34c0 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.596+0000 7f5bdb7fe700 1 -- 172.21.15.135:0/1758126289 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5be4013b50 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.596+0000 7f5bdb7fe700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5be006ac90 0x7f5be006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.597+0000 7f5bdb7fe700 1 -- 172.21.15.135:0/1758126289 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5be4089470 con 0x7f5bf4153720 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.597+0000 7f5bf27fc700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5be006ac90 0x7f5be006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.597+0000 7f5bf27fc700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5be006ac90 0x7f5be006d150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4151860 tx=0x7f5be8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.601+0000 7f5bdb7fe700 1 -- 172.21.15.135:0/1758126289 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5be4054360 con 0x7f5bf4153720 2024-05-08T20:55:29.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.847+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5bf4067890 con 0x7f5bf4153720 2024-05-08T20:55:29.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.847+0000 7f5bdb7fe700 1 -- 172.21.15.135:0/1758126289 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5be4057980 con 0x7f5bf4153720 2024-05-08T20:55:29.849 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:29.849 INFO:teuthology.orchestra.run.smithi135.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T20:55:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5be006ac90 msgr2=0x7f5be006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5be006ac90 0x7f5be006d150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4151860 tx=0x7f5be8009040 comp rx=0 tx=0).stop 2024-05-08T20:55:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf4153720 msgr2=0x7f5bf41efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf4153720 0x7f5bf41efc30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5be400e870 tx=0x7f5be400eb80 comp rx=0 tx=0).stop 2024-05-08T20:55:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 shutdown_connections 2024-05-08T20:55:29.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5be006ac90 0x7f5be006d150 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5bf415d3a0 0x7f5bf414f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bf4153720 0x7f5bf41efc30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 --2- 172.21.15.135:0/1758126289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5bf41598e0 0x7f5bf41e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 >> 172.21.15.135:0/1758126289 conn(0x7f5bf40725e0 msgr2=0x7f5bf40c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 shutdown_connections 2024-05-08T20:55:29.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.849+0000 7f5bf9412700 1 -- 172.21.15.135:0/1758126289 wait complete. 2024-05-08T20:55:29.863 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T20:55:29.864 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.982+0000 7fae1441f700 1 Processor -- start 2024-05-08T20:55:29.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.982+0000 7fae1441f700 1 -- start start 2024-05-08T20:55:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae1441f700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae0c13ceb0 0x7fae0c157920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae1441f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae0c15a800 0x7fae0c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae1441f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae1441f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c157210 con 0x7fae0c15a800 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae1441f700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c06ace0 con 0x7fae0c13ceb0 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae1441f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c15acb0 con 0x7fae0c0c4940 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae119ba700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae0c15a800 0x7fae0c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae119ba700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fae0c15a800 0x7fae0c157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33372/0 (socket says 172.21.15.135:33372) 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.983+0000 7fae119ba700 1 -- 172.21.15.135:0/3340279878 learned_addr learned my addr 172.21.15.135:0/3340279878 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae121bb700 1 --2- 172.21.15.135:0/3340279878 >> v2:172.21.15.183:3300/0 conn(0x7fae0c13ceb0 0x7fae0c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae129bc700 1 --2- 172.21.15.135:0/3340279878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae119ba700 1 -- 172.21.15.135:0/3340279878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 msgr2=0x7fae0c0c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae119ba700 1 --2- 172.21.15.135:0/3340279878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae119ba700 1 -- 172.21.15.135:0/3340279878 >> v2:172.21.15.183:3300/0 conn(0x7fae0c13ceb0 msgr2=0x7fae0c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae119ba700 1 --2- 172.21.15.135:0/3340279878 >> v2:172.21.15.183:3300/0 conn(0x7fae0c13ceb0 0x7fae0c157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae119ba700 1 -- 172.21.15.135:0/3340279878 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c15af90 con 0x7fae0c15a800 2024-05-08T20:55:29.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae119ba700 1 --2- 172.21.15.135:0/3340279878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c15a800 0x7fae0c157e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06e310 tx=0x7fae00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c1c4e153c3050c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae111b9700 1 -- 172.21.15.135:0/3340279878 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011830 con 0x7fae0c15a800 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae111b9700 1 -- 172.21.15.135:0/3340279878 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00011990 con 0x7fae0c15a800 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.984+0000 7fae111b9700 1 -- 172.21.15.135:0/3340279878 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011d20 con 0x7fae0c15a800 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 -- 172.21.15.135:0/3340279878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c15a800 msgr2=0x7fae0c157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 --2- 172.21.15.135:0/3340279878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c15a800 0x7fae0c157e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06e310 tx=0x7fae00009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 -- 172.21.15.135:0/3340279878 shutdown_connections 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 --2- 172.21.15.135:0/3340279878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 --2- 172.21.15.135:0/3340279878 >> v2:172.21.15.183:3300/0 conn(0x7fae0c13ceb0 0x7fae0c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 --2- 172.21.15.135:0/3340279878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c15a800 0x7fae0c157e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 -- 172.21.15.135:0/3340279878 >> 172.21.15.135:0/3340279878 conn(0x7fae0c06d620 msgr2=0x7fae0c06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 -- 172.21.15.135:0/3340279878 shutdown_connections 2024-05-08T20:55:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.985+0000 7fae1441f700 1 -- 172.21.15.135:0/3340279878 wait complete. 2024-05-08T20:55:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.986+0000 7fae1441f700 1 Processor -- start 2024-05-08T20:55:29.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.986+0000 7fae1441f700 1 -- start start 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.986+0000 7fae1441f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae1441f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c13ceb0 0x7fae0c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae1441f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0c15a800 0x7fae0c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae1441f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c1f2ec0 con 0x7fae0c13ceb0 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae1441f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c1549e0 con 0x7fae0c15a800 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae1441f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c152e10 con 0x7fae0c0c4940 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c13ceb0 0x7fae0c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c13ceb0 0x7fae0c1544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33380/0 (socket says 172.21.15.135:33380) 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 -- 172.21.15.135:0/2943153007 learned_addr learned my addr 172.21.15.135:0/2943153007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae121bb700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae129bc700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0c15a800 0x7fae0c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 -- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 msgr2=0x7fae0c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 -- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0c15a800 msgr2=0x7fae0c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0c15a800 0x7fae0c0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 -- 172.21.15.135:0/2943153007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009550 con 0x7fae0c13ceb0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae119ba700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c13ceb0 0x7fae0c1544a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae00009c10 tx=0x7fae00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fadfeffd700 1 -- 172.21.15.135:0/2943153007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00004450 con 0x7fae0c13ceb0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fadfeffd700 1 -- 172.21.15.135:0/2943153007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0001e070 con 0x7fae0c13ceb0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c1f2be0 con 0x7fae0c13ceb0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fadfeffd700 1 -- 172.21.15.135:0/2943153007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000038e0 con 0x7fae0c13ceb0 2024-05-08T20:55:29.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.987+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c153ca0 con 0x7fae0c13ceb0 2024-05-08T20:55:29.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.988+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c153820 con 0x7fae0c13ceb0 2024-05-08T20:55:29.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.989+0000 7fadfeffd700 1 -- 172.21.15.135:0/2943153007 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae00003a40 con 0x7fae0c13ceb0 2024-05-08T20:55:29.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.989+0000 7fadfeffd700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fadf006ac90 0x7fadf006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:29.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.989+0000 7fadfeffd700 1 -- 172.21.15.135:0/2943153007 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae0008a310 con 0x7fae0c13ceb0 2024-05-08T20:55:29.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.989+0000 7fae121bb700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fadf006ac90 0x7fadf006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:29.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.989+0000 7fae121bb700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fadf006ac90 0x7fadf006d150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae08009be0 tx=0x7fae08009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:29.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:29.993+0000 7fadfeffd700 1 -- 172.21.15.135:0/2943153007 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fae0c153820 con 0x7fae0c13ceb0 2024-05-08T20:55:30.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.190+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae0c153820 con 0x7fae0c13ceb0 2024-05-08T20:55:30.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.191+0000 7fadfeffd700 1 -- 172.21.15.135:0/2943153007 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fae0c153820 con 0x7fae0c13ceb0 2024-05-08T20:55:30.193 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:30.193 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fadf006ac90 msgr2=0x7fadf006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fadf006ac90 0x7fadf006d150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae08009be0 tx=0x7fae08009210 comp rx=0 tx=0).stop 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c13ceb0 msgr2=0x7fae0c1544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c13ceb0 0x7fae0c1544a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae00009c10 tx=0x7fae00004750 comp rx=0 tx=0).stop 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 shutdown_connections 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fadf006ac90 0x7fadf006d150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae0c15a800 0x7fae0c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae0c0c4940 0x7fae0c0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 --2- 172.21.15.135:0/2943153007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae0c13ceb0 0x7fae0c1544a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 >> 172.21.15.135:0/2943153007 conn(0x7fae0c06d620 msgr2=0x7fae0c13b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 shutdown_connections 2024-05-08T20:55:30.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.194+0000 7fae1441f700 1 -- 172.21.15.135:0/2943153007 wait complete. 2024-05-08T20:55:30.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:54:57.947571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:54:58.988583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T20:55:02.098509+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T20:55:30.208 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:55:30.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.330+0000 7f339a4ed700 1 Processor -- start 2024-05-08T20:55:30.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.330+0000 7f339a4ed700 1 -- start start 2024-05-08T20:55:30.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f339a4ed700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f33941535a0 0x7f339406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f339a4ed700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f33940c47c0 0x7f339406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f339a4ed700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339415c990 con 0x7f33940cbf50 2024-05-08T20:55:30.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f339a4ed700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339415cbc0 con 0x7f33940c47c0 2024-05-08T20:55:30.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f339a4ed700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339415ce60 con 0x7f33941535a0 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f3398a8a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f33940c47c0 0x7f339406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f33937fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f33940cbf50 0x7f33940c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59902/0 (socket says 172.21.15.135:59902) 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f33937fe700 1 -- 172.21.15.135:0/1527424102 learned_addr learned my addr 172.21.15.135:0/1527424102 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.331+0000 7f3393fff700 1 --2- 172.21.15.135:0/1527424102 >> v2:172.21.15.183:3300/0 conn(0x7f33941535a0 0x7f339406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3398a8a700 1 -- 172.21.15.135:0/1527424102 >> v2:172.21.15.183:3300/0 conn(0x7f33941535a0 msgr2=0x7f339406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3398a8a700 1 --2- 172.21.15.135:0/1527424102 >> v2:172.21.15.183:3300/0 conn(0x7f33941535a0 0x7f339406a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3398a8a700 1 -- 172.21.15.135:0/1527424102 >> v1:172.21.15.135:6789/0 conn(0x7f33940cbf50 legacy=0x7f33940c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3398a8a700 1 -- 172.21.15.135:0/1527424102 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339415d140 con 0x7f33940c47c0 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3392ffd700 1 -- 172.21.15.135:0/1527424102 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775050294 0 0) 0x7f339415c990 con 0x7f33940cbf50 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3398a8a700 1 --2- 172.21.15.135:0/1527424102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940c47c0 0x7f339406aea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e1d7da9ad10a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3392ffd700 1 -- 172.21.15.135:0/1527424102 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00e070 con 0x7f33940c47c0 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3392ffd700 1 -- 172.21.15.135:0/1527424102 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00bb90 con 0x7f33940c47c0 2024-05-08T20:55:30.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f3392ffd700 1 -- 172.21.15.135:0/1527424102 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c012430 con 0x7f33940c47c0 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 -- 172.21.15.135:0/1527424102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940c47c0 msgr2=0x7f339406aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 --2- 172.21.15.135:0/1527424102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940c47c0 0x7f339406aea0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 -- 172.21.15.135:0/1527424102 shutdown_connections 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 --2- 172.21.15.135:0/1527424102 >> v2:172.21.15.183:3300/0 conn(0x7f33941535a0 0x7f339406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 --2- 172.21.15.135:0/1527424102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940c47c0 0x7f339406aea0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 -- 172.21.15.135:0/1527424102 >> 172.21.15.135:0/1527424102 conn(0x7f339406daf0 msgr2=0x7f339406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 -- 172.21.15.135:0/1527424102 shutdown_connections 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.332+0000 7f339a4ed700 1 -- 172.21.15.135:0/1527424102 wait complete. 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.334+0000 7f339a4ed700 1 Processor -- start 2024-05-08T20:55:30.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.334+0000 7f339a4ed700 1 -- start start 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.334+0000 7f339a4ed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33940c47c0 0x7f339415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.334+0000 7f339a4ed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940cbf50 0x7f339414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f339a4ed700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33941535a0 0x7f33940c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f339a4ed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941549e0 con 0x7f33940cbf50 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f339a4ed700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940ca300 con 0x7f33941535a0 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f339a4ed700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3394154fe0 con 0x7f33940c47c0 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940cbf50 0x7f339414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940cbf50 0x7f339414c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33398/0 (socket says 172.21.15.135:33398) 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 -- 172.21.15.135:0/2499920246 learned_addr learned my addr 172.21.15.135:0/2499920246 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:30.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f3393fff700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33940c47c0 0x7f339415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f3398a8a700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33941535a0 0x7f33940c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 -- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33940c47c0 msgr2=0x7f339415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33940c47c0 0x7f339415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 -- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33941535a0 msgr2=0x7f33940c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33941535a0 0x7f33940c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 -- 172.21.15.135:0/2499920246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c009a70 con 0x7f33940cbf50 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f3398a8a700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33941535a0 0x7f33940c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f3393fff700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33940c47c0 0x7f339415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f33937fe700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940cbf50 0x7f339414c430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f33840011e0 tx=0x7f338400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f3390ff9700 1 -- 172.21.15.135:0/2499920246 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384004c80 con 0x7f33940cbf50 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f3390ff9700 1 -- 172.21.15.135:0/2499920246 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3384004e00 con 0x7f33940cbf50 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339415b050 con 0x7f33940cbf50 2024-05-08T20:55:30.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f3390ff9700 1 -- 172.21.15.135:0/2499920246 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384007310 con 0x7f33940cbf50 2024-05-08T20:55:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.335+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33940ca7f0 con 0x7f33940cbf50 2024-05-08T20:55:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.336+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33940c33c0 con 0x7f33940cbf50 2024-05-08T20:55:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.337+0000 7f3390ff9700 1 -- 172.21.15.135:0/2499920246 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3384007470 con 0x7f33940cbf50 2024-05-08T20:55:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.337+0000 7f3390ff9700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f337406ac90 0x7f337406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.337+0000 7f3390ff9700 1 -- 172.21.15.135:0/2499920246 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3384089a70 con 0x7f33940cbf50 2024-05-08T20:55:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.337+0000 7f3393fff700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f337406ac90 0x7f337406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.338+0000 7f3393fff700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f337406ac90 0x7f337406d150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f337c0099f0 tx=0x7f337c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:30.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.341+0000 7f3390ff9700 1 -- 172.21.15.135:0/2499920246 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3384054940 con 0x7f33940cbf50 2024-05-08T20:55:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.535+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33940c7290 con 0x7f33940cbf50 2024-05-08T20:55:30.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.536+0000 7f3390ff9700 1 -- 172.21.15.135:0/2499920246 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3384057f60 con 0x7f33940cbf50 2024-05-08T20:55:30.538 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f337406ac90 msgr2=0x7f337406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f337406ac90 0x7f337406d150 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f337c0099f0 tx=0x7f337c008040 comp rx=0 tx=0).stop 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940cbf50 msgr2=0x7f339414c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940cbf50 0x7f339414c430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f33840011e0 tx=0x7f338400cae0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 shutdown_connections 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f337406ac90 0x7f337406d150 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33941535a0 0x7f33940c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f33940c47c0 0x7f339415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 --2- 172.21.15.135:0/2499920246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33940cbf50 0x7f339414c430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 >> 172.21.15.135:0/2499920246 conn(0x7f339406daf0 msgr2=0x7f3394073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 shutdown_connections 2024-05-08T20:55:30.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.538+0000 7f339a4ed700 1 -- 172.21.15.135:0/2499920246 wait complete. 2024-05-08T20:55:30.552 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:55:30.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.674+0000 7f4696ccc700 1 Processor -- start 2024-05-08T20:55:30.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.674+0000 7f4696ccc700 1 -- start start 2024-05-08T20:55:30.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4696ccc700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f46901535a0 0x7f469006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4696ccc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46900c47c0 0x7f469006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4696ccc700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469015c990 con 0x7f46900cbf50 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4696ccc700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469015cbc0 con 0x7f46901535a0 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4696ccc700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469015ce60 con 0x7f46900c47c0 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4695269700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46900c47c0 0x7f469006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4694a68700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f46901535a0 0x7f469006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4695269700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46900c47c0 0x7f469006aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50608/0 (socket says 172.21.15.135:50608) 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4695269700 1 -- 172.21.15.135:0/2051263690 learned_addr learned my addr 172.21.15.135:0/2051263690 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4695269700 1 -- 172.21.15.135:0/2051263690 >> v2:172.21.15.183:3300/0 conn(0x7f46901535a0 msgr2=0x7f469006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4695269700 1 --2- 172.21.15.135:0/2051263690 >> v2:172.21.15.183:3300/0 conn(0x7f46901535a0 0x7f469006a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4695269700 1 -- 172.21.15.135:0/2051263690 >> v1:172.21.15.183:6789/0 conn(0x7f46900cbf50 legacy=0x7f46900c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.675+0000 7f4695269700 1 -- 172.21.15.135:0/2051263690 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469015d140 con 0x7f46900c47c0 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4695269700 1 --2- 172.21.15.135:0/2051263690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46900c47c0 0x7f469006aea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4688009e80 tx=0x7f468800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56aac840f1d88549 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:30.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f468f7fe700 1 -- 172.21.15.135:0/2051263690 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800e070 con 0x7f46900c47c0 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f468f7fe700 1 -- 172.21.15.135:0/2051263690 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468800b8d0 con 0x7f46900c47c0 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f468f7fe700 1 -- 172.21.15.135:0/2051263690 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800bc80 con 0x7f46900c47c0 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 -- 172.21.15.135:0/2051263690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46900c47c0 msgr2=0x7f469006aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 --2- 172.21.15.135:0/2051263690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46900c47c0 0x7f469006aea0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4688009e80 tx=0x7f468800b330 comp rx=0 tx=0).stop 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 -- 172.21.15.135:0/2051263690 shutdown_connections 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 --2- 172.21.15.135:0/2051263690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46900c47c0 0x7f469006aea0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 --2- 172.21.15.135:0/2051263690 >> v2:172.21.15.183:3300/0 conn(0x7f46901535a0 0x7f469006a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 -- 172.21.15.135:0/2051263690 >> 172.21.15.135:0/2051263690 conn(0x7f469006daf0 msgr2=0x7f469006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 -- 172.21.15.135:0/2051263690 shutdown_connections 2024-05-08T20:55:30.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.676+0000 7f4696ccc700 1 -- 172.21.15.135:0/2051263690 wait complete. 2024-05-08T20:55:30.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.677+0000 7f4696ccc700 1 Processor -- start 2024-05-08T20:55:30.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f4696ccc700 1 -- start start 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f4696ccc700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46900c47c0 0x7f4690153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f4696ccc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46900cbf50 0x7f469015aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f4696ccc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46901535a0 0x7f46900cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f4696ccc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469014e450 con 0x7f46900cbf50 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f4696ccc700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4690155250 con 0x7f46900c47c0 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f4696ccc700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469014db60 con 0x7f46901535a0 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.678+0000 7f468ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46900cbf50 0x7f469015aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46900cbf50 0x7f469015aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33410/0 (socket says 172.21.15.135:33410) 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 -- 172.21.15.135:0/716580357 learned_addr learned my addr 172.21.15.135:0/716580357 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f4695269700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46901535a0 0x7f46900cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f4694a68700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46900c47c0 0x7f4690153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 -- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46901535a0 msgr2=0x7f46900cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46901535a0 0x7f46900cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 -- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46900c47c0 msgr2=0x7f4690153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46900c47c0 0x7f4690153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 -- 172.21.15.135:0/716580357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4688009b30 con 0x7f46900cbf50 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468ffff700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46900cbf50 0x7f469015aed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f467c00c510 tx=0x7f467c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468d7fa700 1 -- 172.21.15.135:0/716580357 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0052d0 con 0x7f46900cbf50 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468d7fa700 1 -- 172.21.15.135:0/716580357 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c005430 con 0x7f46900cbf50 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f468d7fa700 1 -- 172.21.15.135:0/716580357 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0038c0 con 0x7f46900cbf50 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469014ea10 con 0x7f46900cbf50 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.679+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469014d050 con 0x7f46900cbf50 2024-05-08T20:55:30.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.680+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46900c33c0 con 0x7f46900cbf50 2024-05-08T20:55:30.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.681+0000 7f468d7fa700 1 -- 172.21.15.135:0/716580357 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f467c003a20 con 0x7f46900cbf50 2024-05-08T20:55:30.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.682+0000 7f468d7fa700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f467406acc0 0x7f467406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:30.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.682+0000 7f468d7fa700 1 -- 172.21.15.135:0/716580357 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f467c089100 con 0x7f46900cbf50 2024-05-08T20:55:30.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.682+0000 7f4694a68700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f467406acc0 0x7f467406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:30.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.682+0000 7f4694a68700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f467406acc0 0x7f467406d180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4684009b40 tx=0x7f4684009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:30.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.686+0000 7f468d7fa700 1 -- 172.21.15.135:0/716580357 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f467c053f40 con 0x7f46900cbf50 2024-05-08T20:55:30.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.880+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f469014eba0 con 0x7f46900cbf50 2024-05-08T20:55:30.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.881+0000 7f468d7fa700 1 -- 172.21.15.135:0/716580357 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f467c0170a0 con 0x7f46900cbf50 2024-05-08T20:55:30.883 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:30.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f467406acc0 msgr2=0x7f467406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f467406acc0 0x7f467406d180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4684009b40 tx=0x7f4684009210 comp rx=0 tx=0).stop 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46900cbf50 msgr2=0x7f469015aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46900cbf50 0x7f469015aed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f467c00c510 tx=0x7f467c00c820 comp rx=0 tx=0).stop 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 shutdown_connections 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f467406acc0 0x7f467406d180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46900c47c0 0x7f4690153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46901535a0 0x7f46900cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 --2- 172.21.15.135:0/716580357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f46900cbf50 0x7f469015aed0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 >> 172.21.15.135:0/716580357 conn(0x7f469006daf0 msgr2=0x7f4690150cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 shutdown_connections 2024-05-08T20:55:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:30.883+0000 7f4696ccc700 1 -- 172.21.15.135:0/716580357 wait complete. 2024-05-08T20:55:30.897 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:55:31.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.018+0000 7f5558726700 1 Processor -- start 2024-05-08T20:55:31.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.019+0000 7f5558726700 1 -- start start 2024-05-08T20:55:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5558726700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5550151400 0x7f555015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5558726700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f55500c1f70 0x7f55500c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5558726700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555015b620 con 0x7f55500c9e80 2024-05-08T20:55:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5558726700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55500c1b20 con 0x7f55500c1f70 2024-05-08T20:55:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5558726700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55500cd8e0 con 0x7f5550151400 2024-05-08T20:55:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f55500c1f70 0x7f55500c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f55500c1f70 0x7f55500c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33424/0 (socket says 172.21.15.135:33424) 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 -- 172.21.15.135:0/3184364615 learned_addr learned my addr 172.21.15.135:0/3184364615 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f55564c2700 1 --2- 172.21.15.135:0/3184364615 >> v2:172.21.15.183:3300/0 conn(0x7f5550151400 0x7f555015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 -- 172.21.15.135:0/3184364615 >> v2:172.21.15.183:3300/0 conn(0x7f5550151400 msgr2=0x7f555015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 --2- 172.21.15.135:0/3184364615 >> v2:172.21.15.183:3300/0 conn(0x7f5550151400 0x7f555015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 -- 172.21.15.135:0/3184364615 >> v1:172.21.15.183:6789/0 conn(0x7f55500c9e80 legacy=0x7f5550070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 -- 172.21.15.135:0/3184364615 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500c2900 con 0x7f55500c1f70 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.020+0000 7f5556cc3700 1 --2- 172.21.15.135:0/3184364615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55500c23c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f55500c1c60 tx=0x7f554800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefeac40e7c5ce7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f55554c0700 1 -- 172.21.15.135:0/3184364615 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800e070 con 0x7f55500c1f70 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f55554c0700 1 -- 172.21.15.135:0/3184364615 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548003a20 con 0x7f55500c1f70 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f55554c0700 1 -- 172.21.15.135:0/3184364615 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548003dd0 con 0x7f55500c1f70 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 -- 172.21.15.135:0/3184364615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 msgr2=0x7f55500c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 --2- 172.21.15.135:0/3184364615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55500c23c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f55500c1c60 tx=0x7f554800b330 comp rx=0 tx=0).stop 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 -- 172.21.15.135:0/3184364615 shutdown_connections 2024-05-08T20:55:31.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 --2- 172.21.15.135:0/3184364615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55500c23c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 --2- 172.21.15.135:0/3184364615 >> v2:172.21.15.183:3300/0 conn(0x7f5550151400 0x7f555015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 -- 172.21.15.135:0/3184364615 >> 172.21.15.135:0/3184364615 conn(0x7f5550066d70 msgr2=0x7f555006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:31.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 -- 172.21.15.135:0/3184364615 shutdown_connections 2024-05-08T20:55:31.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.021+0000 7f5558726700 1 -- 172.21.15.135:0/3184364615 wait complete. 2024-05-08T20:55:31.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.022+0000 7f5558726700 1 Processor -- start 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.022+0000 7f5558726700 1 -- start start 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5558726700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55501f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5558726700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55500c9e80 0x7f5550159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5558726700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5550151400 0x7f5550157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5558726700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55501eda10 con 0x7f55500c1f70 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5558726700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55501ecb40 con 0x7f55500c9e80 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5558726700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55501ece00 con 0x7f5550151400 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f55564c2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55501f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f55564c2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55501f0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33440/0 (socket says 172.21.15.135:33440) 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f55564c2700 1 -- 172.21.15.135:0/3370385629 learned_addr learned my addr 172.21.15.135:0/3370385629 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5555cc1700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55500c9e80 0x7f5550159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f5556cc3700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5550151400 0x7f5550157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f55564c2700 1 -- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5550151400 msgr2=0x7f5550157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f55564c2700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5550151400 0x7f5550157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.023+0000 7f55564c2700 1 -- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55500c9e80 msgr2=0x7f5550159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f55564c2700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55500c9e80 0x7f5550159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f55564c2700 1 -- 172.21.15.135:0/3370385629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548009b30 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f5555cc1700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55500c9e80 0x7f5550159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f55564c2700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55501f0ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f554000e870 tx=0x7f554000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f5546ffd700 1 -- 172.21.15.135:0/3370385629 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540009590 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f5546ffd700 1 -- 172.21.15.135:0/3370385629 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554000ee70 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55501ed0e0 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f5546ffd700 1 -- 172.21.15.135:0/3370385629 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000ca50 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.024+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55501ed6a0 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.025+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55501ed860 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.025+0000 7f5546ffd700 1 -- 172.21.15.135:0/3370385629 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f554000cbb0 con 0x7f55500c1f70 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.026+0000 7f5546ffd700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f553406acc0 0x7f553406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.026+0000 7f5555cc1700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f553406acc0 0x7f553406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.026+0000 7f5546ffd700 1 -- 172.21.15.135:0/3370385629 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5540089580 con 0x7f55500c1f70 2024-05-08T20:55:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.026+0000 7f5555cc1700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f553406acc0 0x7f553406d180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f555014ca50 tx=0x7f554c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.030+0000 7f5546ffd700 1 -- 172.21.15.135:0/3370385629 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5540054470 con 0x7f55500c1f70 2024-05-08T20:55:31.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.225+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55501517e0 con 0x7f55500c1f70 2024-05-08T20:55:31.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.225+0000 7f5546ffd700 1 -- 172.21.15.135:0/3370385629 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f554000ce60 con 0x7f55500c1f70 2024-05-08T20:55:31.227 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T20:55:31.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f553406acc0 msgr2=0x7f553406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f553406acc0 0x7f553406d180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f555014ca50 tx=0x7f554c009040 comp rx=0 tx=0).stop 2024-05-08T20:55:31.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 msgr2=0x7f55501f0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55501f0ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f554000e870 tx=0x7f554000ec30 comp rx=0 tx=0).stop 2024-05-08T20:55:31.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 shutdown_connections 2024-05-08T20:55:31.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f553406acc0 0x7f553406d180 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5550151400 0x7f5550157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55500c1f70 0x7f55501f0ac0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 --2- 172.21.15.135:0/3370385629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55500c9e80 0x7f5550159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 >> 172.21.15.135:0/3370385629 conn(0x7f5550066d70 msgr2=0x7f55500cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:31.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 shutdown_connections 2024-05-08T20:55:31.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.227+0000 7f5558726700 1 -- 172.21.15.135:0/3370385629 wait complete. 2024-05-08T20:55:31.241 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T20:55:31.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.364+0000 7fb893a2a700 1 Processor -- start 2024-05-08T20:55:31.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.364+0000 7fb893a2a700 1 -- start start 2024-05-08T20:55:31.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb893a2a700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb88c0c47c0 0x7fb88c164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb893a2a700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c15c990 con 0x7fb88c1535a0 2024-05-08T20:55:31.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb893a2a700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c15cbc0 con 0x7fb88c0cbf50 2024-05-08T20:55:31.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb893a2a700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c15ce60 con 0x7fb88c0c47c0 2024-05-08T20:55:31.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb8917c6700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb88c1535a0 0x7fb88c06a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59908/0 (socket says 172.21.15.135:59908) 2024-05-08T20:55:31.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb8917c6700 1 -- 172.21.15.135:0/261843788 learned_addr learned my addr 172.21.15.135:0/261843788 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb891fc7700 1 --2- 172.21.15.135:0/261843788 >> v2:172.21.15.183:3300/0 conn(0x7fb88c0c47c0 0x7fb88c164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb883fff700 1 -- 172.21.15.135:0/261843788 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769917311 0 0) 0x7fb88c15c990 con 0x7fb88c1535a0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb883fff700 1 -- 172.21.15.135:0/261843788 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8780035b0 con 0x7fb88c1535a0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb883fff700 1 -- 172.21.15.135:0/261843788 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125494928 0 0) 0x7fb8780035b0 con 0x7fb88c1535a0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb891fc7700 1 -- 172.21.15.135:0/261843788 >> v1:172.21.15.183:6789/0 conn(0x7fb88c0cbf50 legacy=0x7fb88c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb891fc7700 1 -- 172.21.15.135:0/261843788 >> v1:172.21.15.135:6789/0 conn(0x7fb88c1535a0 legacy=0x7fb88c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.365+0000 7fb891fc7700 1 -- 172.21.15.135:0/261843788 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c15d140 con 0x7fb88c0c47c0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb891fc7700 1 --2- 172.21.15.135:0/261843788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0c47c0 0x7fb88c164c90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb884009d90 tx=0x7fb88400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de4396e955c69079 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb883fff700 1 -- 172.21.15.135:0/261843788 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88400e070 con 0x7fb88c0c47c0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb883fff700 1 -- 172.21.15.135:0/261843788 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb884003a20 con 0x7fb88c0c47c0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb883fff700 1 -- 172.21.15.135:0/261843788 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888001670 con 0x7fb88c0c47c0 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb893a2a700 1 -- 172.21.15.135:0/261843788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0c47c0 msgr2=0x7fb88c164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb893a2a700 1 --2- 172.21.15.135:0/261843788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0c47c0 0x7fb88c164c90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb884009d90 tx=0x7fb88400b330 comp rx=0 tx=0).stop 2024-05-08T20:55:31.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb893a2a700 1 -- 172.21.15.135:0/261843788 shutdown_connections 2024-05-08T20:55:31.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb893a2a700 1 --2- 172.21.15.135:0/261843788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0c47c0 0x7fb88c164c90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb893a2a700 1 -- 172.21.15.135:0/261843788 >> 172.21.15.135:0/261843788 conn(0x7fb88c06daf0 msgr2=0x7fb88c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:31.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb893a2a700 1 -- 172.21.15.135:0/261843788 shutdown_connections 2024-05-08T20:55:31.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.366+0000 7fb893a2a700 1 -- 172.21.15.135:0/261843788 wait complete. 2024-05-08T20:55:31.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.367+0000 7fb893a2a700 1 Processor -- start 2024-05-08T20:55:31.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.367+0000 7fb893a2a700 1 -- start start 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb893a2a700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0c47c0 0x7fb88c157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb893a2a700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0cbf50 0x7fb88c1efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb893a2a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb88c1535a0 0x7fb88c1f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb893a2a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c1f2b10 con 0x7fb88c1535a0 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb893a2a700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c1ef060 con 0x7fb88c0cbf50 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb893a2a700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c1f2d80 con 0x7fb88c0c47c0 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb891fc7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb88c1535a0 0x7fb88c1f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb891fc7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb88c1535a0 0x7fb88c1f25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33450/0 (socket says 172.21.15.135:33450) 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb891fc7700 1 -- 172.21.15.135:0/516372664 learned_addr learned my addr 172.21.15.135:0/516372664 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb8917c6700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0c47c0 0x7fb88c157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.368+0000 7fb890fc5700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0cbf50 0x7fb88c1efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb891fc7700 1 -- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0c47c0 msgr2=0x7fb88c157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb891fc7700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0c47c0 0x7fb88c157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb891fc7700 1 -- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0cbf50 msgr2=0x7fb88c1efb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb891fc7700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0cbf50 0x7fb88c1efb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb891fc7700 1 -- 172.21.15.135:0/516372664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884009a70 con 0x7fb88c1535a0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb890fc5700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0cbf50 0x7fb88c1efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb891fc7700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb88c1535a0 0x7fb88c1f25d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb88400b370 tx=0x7fb884004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb881ffb700 1 -- 172.21.15.135:0/516372664 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884009450 con 0x7fb88c1535a0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb881ffb700 1 -- 172.21.15.135:0/516372664 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8840045e0 con 0x7fb88c1535a0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88c1f3060 con 0x7fb88c1535a0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb881ffb700 1 -- 172.21.15.135:0/516372664 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884012450 con 0x7fb88c1535a0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.369+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88c1ef320 con 0x7fb88c1535a0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.370+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c067fa0 con 0x7fb88c1535a0 2024-05-08T20:55:31.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.370+0000 7fb881ffb700 1 -- 172.21.15.135:0/516372664 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb8840125b0 con 0x7fb88c1535a0 2024-05-08T20:55:31.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.371+0000 7fb881ffb700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb87006acc0 0x7fb87006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.371+0000 7fb881ffb700 1 -- 172.21.15.135:0/516372664 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb88408adf0 con 0x7fb88c1535a0 2024-05-08T20:55:31.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.371+0000 7fb8917c6700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb87006acc0 0x7fb87006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.371+0000 7fb8917c6700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb87006acc0 0x7fb87006d180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb888000f60 tx=0x7fb888001e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.375+0000 7fb881ffb700 1 -- 172.21.15.135:0/516372664 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb884055d70 con 0x7fb88c1535a0 2024-05-08T20:55:31.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.569+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb88c06c690 con 0x7fb88c1535a0 2024-05-08T20:55:31.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.569+0000 7fb881ffb700 1 -- 172.21.15.135:0/516372664 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb884059390 con 0x7fb88c1535a0 2024-05-08T20:55:31.571 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb87006acc0 msgr2=0x7fb87006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb87006acc0 0x7fb87006d180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb888000f60 tx=0x7fb888001e40 comp rx=0 tx=0).stop 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb88c1535a0 msgr2=0x7fb88c1f25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb88c1535a0 0x7fb88c1f25d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb88400b370 tx=0x7fb884004ad0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 shutdown_connections 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb87006acc0 0x7fb87006d180 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb88c1535a0 0x7fb88c1f25d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb88c0c47c0 0x7fb88c157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 --2- 172.21.15.135:0/516372664 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb88c0cbf50 0x7fb88c1efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 >> 172.21.15.135:0/516372664 conn(0x7fb88c06daf0 msgr2=0x7fb88c0c65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:31.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 shutdown_connections 2024-05-08T20:55:31.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.572+0000 7fb893a2a700 1 -- 172.21.15.135:0/516372664 wait complete. 2024-05-08T20:55:31.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:55:31.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.707+0000 7fb8678dd700 1 Processor -- start 2024-05-08T20:55:31.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.708+0000 7fb8678dd700 1 -- start start 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.708+0000 7fb8678dd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb860151400 0x7fb86015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.708+0000 7fb8678dd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8600c9e80 0x7fb860070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.708+0000 7fb8678dd700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86015b620 con 0x7fb860071030 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.708+0000 7fb8678dd700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600c1b20 con 0x7fb8600c9e80 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.708+0000 7fb8678dd700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600cd8e0 con 0x7fb860151400 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb864e78700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8600c9e80 0x7fb860070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb865e7a700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb860071030 0x7fb8600c1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:59916/0 (socket says 172.21.15.135:59916) 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb864e78700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fb8600c9e80 0x7fb860070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33454/0 (socket says 172.21.15.135:33454) 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb865e7a700 1 -- 172.21.15.135:0/2934789485 learned_addr learned my addr 172.21.15.135:0/2934789485 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb865679700 1 --2- 172.21.15.135:0/2934789485 >> v2:172.21.15.183:3300/0 conn(0x7fb860151400 0x7fb86015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb864e78700 1 -- 172.21.15.135:0/2934789485 >> v2:172.21.15.183:3300/0 conn(0x7fb860151400 msgr2=0x7fb86015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:31.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb864e78700 1 --2- 172.21.15.135:0/2934789485 >> v2:172.21.15.183:3300/0 conn(0x7fb860151400 0x7fb86015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb864e78700 1 -- 172.21.15.135:0/2934789485 >> v1:172.21.15.135:6789/0 conn(0x7fb860071030 legacy=0x7fb8600c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb864e78700 1 -- 172.21.15.135:0/2934789485 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600ccd60 con 0x7fb8600c9e80 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb857fff700 1 -- 172.21.15.135:0/2934789485 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289911436 0 0) 0x7fb86015b620 con 0x7fb860071030 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb864e78700 1 --2- 172.21.15.135:0/2934789485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860070af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb8600c9da0 tx=0x7fb85c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a2c29c9ea5c46a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb857fff700 1 -- 172.21.15.135:0/2934789485 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011830 con 0x7fb8600c9e80 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb857fff700 1 -- 172.21.15.135:0/2934789485 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c011990 con 0x7fb8600c9e80 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.709+0000 7fb857fff700 1 -- 172.21.15.135:0/2934789485 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011d20 con 0x7fb8600c9e80 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 -- 172.21.15.135:0/2934789485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 msgr2=0x7fb860070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 --2- 172.21.15.135:0/2934789485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860070af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb8600c9da0 tx=0x7fb85c009b20 comp rx=0 tx=0).stop 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 -- 172.21.15.135:0/2934789485 shutdown_connections 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 --2- 172.21.15.135:0/2934789485 >> v2:172.21.15.183:3300/0 conn(0x7fb860151400 0x7fb86015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 --2- 172.21.15.135:0/2934789485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860070af0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 -- 172.21.15.135:0/2934789485 >> 172.21.15.135:0/2934789485 conn(0x7fb860066d70 msgr2=0x7fb86006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:31.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 -- 172.21.15.135:0/2934789485 shutdown_connections 2024-05-08T20:55:31.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.710+0000 7fb8678dd700 1 -- 172.21.15.135:0/2934789485 wait complete. 2024-05-08T20:55:31.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.711+0000 7fb8678dd700 1 Processor -- start 2024-05-08T20:55:31.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.711+0000 7fb8678dd700 1 -- start start 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb8678dd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb860071030 0x7fb86015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb8678dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb8678dd700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb860151400 0x7fb860156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb8678dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860159e20 con 0x7fb8600c9e80 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb8678dd700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601ecd20 con 0x7fb860151400 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb8678dd700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601ed000 con 0x7fb860071030 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33468/0 (socket says 172.21.15.135:33468) 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 -- 172.21.15.135:0/785118618 learned_addr learned my addr 172.21.15.135:0/785118618 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb865e7a700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb860151400 0x7fb860156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb865679700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb860071030 0x7fb86015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 -- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb860071030 msgr2=0x7fb86015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb860071030 0x7fb86015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 -- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb860151400 msgr2=0x7fb860156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb860151400 0x7fb860156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 -- 172.21.15.135:0/785118618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0094a0 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb864e78700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860159520 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0090b0 tx=0x7fb85c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb855ffb700 1 -- 172.21.15.135:0/785118618 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c0038a0 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.712+0000 7fb855ffb700 1 -- 172.21.15.135:0/785118618 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c01f070 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.713+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8601ed2e0 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.713+0000 7fb855ffb700 1 -- 172.21.15.135:0/785118618 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c003c20 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.713+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8601ec9d0 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.714+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8601ed800 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.714+0000 7fb855ffb700 1 -- 172.21.15.135:0/785118618 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb85c026480 con 0x7fb8600c9e80 2024-05-08T20:55:31.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.714+0000 7fb855ffb700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb84406ac90 0x7fb84406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:31.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.715+0000 7fb865679700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb84406ac90 0x7fb84406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:31.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.715+0000 7fb855ffb700 1 -- 172.21.15.135:0/785118618 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb85c021070 con 0x7fb8600c9e80 2024-05-08T20:55:31.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.715+0000 7fb865679700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb84406ac90 0x7fb84406d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb850009ad0 tx=0x7fb850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:31.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.719+0000 7fb855ffb700 1 -- 172.21.15.135:0/785118618 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb8601ed800 con 0x7fb8600c9e80 2024-05-08T20:55:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.961+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8601ed800 con 0x7fb8600c9e80 2024-05-08T20:55:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.962+0000 7fb855ffb700 1 -- 172.21.15.135:0/785118618 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6260 (secure 0 0 0) 0x7fb8601ed800 con 0x7fb8600c9e80 2024-05-08T20:55:31.964 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:31.964 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:23.530682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb84406ac90 msgr2=0x7fb84406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb84406ac90 0x7fb84406d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb850009ad0 tx=0x7fb850008040 comp rx=0 tx=0).stop 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 msgr2=0x7fb860159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860159520 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0090b0 tx=0x7fb85c004750 comp rx=0 tx=0).stop 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 shutdown_connections 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb84406ac90 0x7fb84406d150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb860151400 0x7fb860156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb860071030 0x7fb86015a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 --2- 172.21.15.135:0/785118618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8600c9e80 0x7fb860159520 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:31.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 >> 172.21.15.135:0/785118618 conn(0x7fb860066d70 msgr2=0x7fb8600c7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:31.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 shutdown_connections 2024-05-08T20:55:31.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:31.964+0000 7fb8678dd700 1 -- 172.21.15.135:0/785118618 wait complete. 2024-05-08T20:55:31.968 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-08T20:55:31.978 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:32.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.098+0000 7fada14a1700 1 Processor -- start 2024-05-08T20:55:32.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.099+0000 7fada14a1700 1 -- start start 2024-05-08T20:55:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.099+0000 7fada14a1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fad9c1594f0 0x7fad9c06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.099+0000 7fada14a1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.099+0000 7fada14a1700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c06cc30 con 0x7fad9c1598d0 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.099+0000 7fada14a1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c153c90 con 0x7fad9c1594f0 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.099+0000 7fada14a1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c15a470 con 0x7fad9c0cb8d0 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.099+0000 7fad9a7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9affd700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fad9c1594f0 0x7fad9c06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9a7fc700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:50646/0 (socket says 172.21.15.135:50646) 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9affd700 1 --2- 172.21.15.135:0/839078474 >> v2:172.21.15.183:3300/0 conn(0x7fad9c1594f0 0x7fad9c06d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:46856/0 (socket says 172.21.15.135:46856) 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9a7fc700 1 -- 172.21.15.135:0/839078474 learned_addr learned my addr 172.21.15.135:0/839078474 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9a7fc700 1 -- 172.21.15.135:0/839078474 >> v2:172.21.15.183:3300/0 conn(0x7fad9c1594f0 msgr2=0x7fad9c06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9a7fc700 1 --2- 172.21.15.135:0/839078474 >> v2:172.21.15.183:3300/0 conn(0x7fad9c1594f0 0x7fad9c06d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9a7fc700 1 -- 172.21.15.135:0/839078474 >> v1:172.21.15.183:6789/0 conn(0x7fad9c1598d0 legacy=0x7fad9c159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9a7fc700 1 -- 172.21.15.135:0/839078474 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0ccad0 con 0x7fad9c0cb8d0 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad9a7fc700 1 --2- 172.21.15.135:0/839078474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0cbd30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad900098f0 tx=0x7fad90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74e7a545548a16c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad99ffb700 1 -- 172.21.15.135:0/839078474 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90011830 con 0x7fad9c0cb8d0 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad99ffb700 1 -- 172.21.15.135:0/839078474 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad90011990 con 0x7fad9c0cb8d0 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.100+0000 7fad99ffb700 1 -- 172.21.15.135:0/839078474 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90011d20 con 0x7fad9c0cb8d0 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 -- 172.21.15.135:0/839078474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 msgr2=0x7fad9c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 --2- 172.21.15.135:0/839078474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0cbd30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fad900098f0 tx=0x7fad90009c00 comp rx=0 tx=0).stop 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 -- 172.21.15.135:0/839078474 shutdown_connections 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 --2- 172.21.15.135:0/839078474 >> v2:172.21.15.183:3300/0 conn(0x7fad9c1594f0 0x7fad9c06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 --2- 172.21.15.135:0/839078474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0cbd30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 -- 172.21.15.135:0/839078474 >> 172.21.15.135:0/839078474 conn(0x7fad9c072090 msgr2=0x7fad9c072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 -- 172.21.15.135:0/839078474 shutdown_connections 2024-05-08T20:55:32.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.101+0000 7fada14a1700 1 -- 172.21.15.135:0/839078474 wait complete. 2024-05-08T20:55:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.102+0000 7fada14a1700 1 Processor -- start 2024-05-08T20:55:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.102+0000 7fada14a1700 1 -- start start 2024-05-08T20:55:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fada14a1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fada14a1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad9c1594f0 0x7fad9c151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fada14a1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad9c1598d0 0x7fad9c1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fada14a1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1516c0 con 0x7fad9c1594f0 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fada14a1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1f0530 con 0x7fad9c1598d0 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fada14a1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c152d20 con 0x7fad9c0cb8d0 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad9c1594f0 0x7fad9c151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9affd700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad9c1594f0 0x7fad9c151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33478/0 (socket says 172.21.15.135:33478) 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9b7fe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad9c1598d0 0x7fad9c1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 -- 172.21.15.135:0/4082715322 learned_addr learned my addr 172.21.15.135:0/4082715322 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:32.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 -- 172.21.15.135:0/4082715322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 msgr2=0x7fad9c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 -- 172.21.15.135:0/4082715322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad9c1598d0 msgr2=0x7fad9c1f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad9c1598d0 0x7fad9c1f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.103+0000 7fad9a7fc700 1 -- 172.21.15.135:0/4082715322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009550 con 0x7fad9c1594f0 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.104+0000 7fad9a7fc700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad9c1594f0 0x7fad9c151ae0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad90014040 tx=0x7fad90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.104+0000 7fad837fe700 1 -- 172.21.15.135:0/4082715322 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90004510 con 0x7fad9c1594f0 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.104+0000 7fad837fe700 1 -- 172.21.15.135:0/4082715322 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9001e070 con 0x7fad9c1594f0 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.104+0000 7fad837fe700 1 -- 172.21.15.135:0/4082715322 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900038e0 con 0x7fad9c1594f0 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.104+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c151370 con 0x7fad9c1594f0 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.104+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c1efea0 con 0x7fad9c1594f0 2024-05-08T20:55:32.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.105+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c151800 con 0x7fad9c1594f0 2024-05-08T20:55:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.105+0000 7fad837fe700 1 -- 172.21.15.135:0/4082715322 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad90003a40 con 0x7fad9c1594f0 2024-05-08T20:55:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.105+0000 7fad837fe700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad8806acc0 0x7fad8806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.106+0000 7fad837fe700 1 -- 172.21.15.135:0/4082715322 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad9008a530 con 0x7fad9c1594f0 2024-05-08T20:55:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.106+0000 7fad9affd700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad8806acc0 0x7fad8806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.106+0000 7fad9affd700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad8806acc0 0x7fad8806d180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009be0 tx=0x7fad8c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.110+0000 7fad837fe700 1 -- 172.21.15.135:0/4082715322 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fad9c151800 con 0x7fad9c1594f0 2024-05-08T20:55:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.306+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad9c151800 con 0x7fad9c1594f0 2024-05-08T20:55:32.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.307+0000 7fad837fe700 1 -- 172.21.15.135:0/4082715322 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7fad9c151800 con 0x7fad9c1594f0 2024-05-08T20:55:32.309 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:32.309 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:32.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad8806acc0 msgr2=0x7fad8806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad8806acc0 0x7fad8806d180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009be0 tx=0x7fad8c009210 comp rx=0 tx=0).stop 2024-05-08T20:55:32.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad9c1594f0 msgr2=0x7fad9c151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad9c1594f0 0x7fad9c151ae0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad90014040 tx=0x7fad90004750 comp rx=0 tx=0).stop 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 shutdown_connections 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fad8806acc0 0x7fad8806d180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad9c1598d0 0x7fad9c1f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fad9c0cb8d0 0x7fad9c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 --2- 172.21.15.135:0/4082715322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad9c1594f0 0x7fad9c151ae0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 >> 172.21.15.135:0/4082715322 conn(0x7fad9c072090 msgr2=0x7fad9c1572f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 shutdown_connections 2024-05-08T20:55:32.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.309+0000 7fada14a1700 1 -- 172.21.15.135:0/4082715322 wait complete. 2024-05-08T20:55:32.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:54:57.947571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:54:58.988583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T20:55:02.098509+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T20:55:32.324 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:55:32.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.446+0000 7f0e417cf700 1 Processor -- start 2024-05-08T20:55:32.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.446+0000 7f0e417cf700 1 -- start start 2024-05-08T20:55:32.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e417cf700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0e3c0c47c0 0x7f0e3c164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e417cf700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c15c990 con 0x7f0e3c1535a0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e417cf700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c15cbc0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e417cf700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c15ce60 con 0x7f0e3c0c47c0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e3b7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f0e3c0c47c0 0x7f0e3c164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e3affd700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f0e3c1535a0 0x7f0e3c06a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36540/0 (socket says 172.21.15.135:36540) 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e3affd700 1 -- 172.21.15.135:0/900020384 learned_addr learned my addr 172.21.15.135:0/900020384 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e3b7fe700 1 -- 172.21.15.135:0/900020384 >> v1:172.21.15.183:6789/0 conn(0x7f0e3c0cbf50 legacy=0x7f0e3c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e3b7fe700 1 -- 172.21.15.135:0/900020384 >> v1:172.21.15.135:6789/0 conn(0x7f0e3c1535a0 legacy=0x7f0e3c06a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.447+0000 7f0e3b7fe700 1 -- 172.21.15.135:0/900020384 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c15d140 con 0x7f0e3c0c47c0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e3b7fe700 1 --2- 172.21.15.135:0/900020384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0c47c0 0x7f0e3c164c90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009d90 tx=0x7f0e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df69972f9cfed48 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e39ffb700 1 -- 172.21.15.135:0/900020384 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400e070 con 0x7f0e3c0c47c0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e39ffb700 1 -- 172.21.15.135:0/900020384 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400bbd0 con 0x7f0e3c0c47c0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e39ffb700 1 -- 172.21.15.135:0/900020384 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34012430 con 0x7f0e3c0c47c0 2024-05-08T20:55:32.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e417cf700 1 -- 172.21.15.135:0/900020384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0c47c0 msgr2=0x7f0e3c164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e417cf700 1 --2- 172.21.15.135:0/900020384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0c47c0 0x7f0e3c164c90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009d90 tx=0x7f0e3400b330 comp rx=0 tx=0).stop 2024-05-08T20:55:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e417cf700 1 -- 172.21.15.135:0/900020384 shutdown_connections 2024-05-08T20:55:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e417cf700 1 --2- 172.21.15.135:0/900020384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0c47c0 0x7f0e3c164c90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e417cf700 1 -- 172.21.15.135:0/900020384 >> 172.21.15.135:0/900020384 conn(0x7f0e3c06daf0 msgr2=0x7f0e3c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e417cf700 1 -- 172.21.15.135:0/900020384 shutdown_connections 2024-05-08T20:55:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.448+0000 7f0e417cf700 1 -- 172.21.15.135:0/900020384 wait complete. 2024-05-08T20:55:32.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 Processor -- start 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 -- start start 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3c0c47c0 0x7f0e3c1e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0cbf50 0x7f0e3c1e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3c1535a0 0x7f0e3c1e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c153c50 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1e2710 con 0x7f0e3c0c47c0 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e417cf700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1ef460 con 0x7f0e3c1535a0 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e3a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0cbf50 0x7f0e3c1e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e3a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0cbf50 0x7f0e3c1e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42072/0 (socket says 172.21.15.135:42072) 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.450+0000 7f0e3a7fc700 1 -- 172.21.15.135:0/2288256513 learned_addr learned my addr 172.21.15.135:0/2288256513 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3affd700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3c0c47c0 0x7f0e3c1e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3b7fe700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3c1535a0 0x7f0e3c1e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3a7fc700 1 -- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3c1535a0 msgr2=0x7f0e3c1e2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3a7fc700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3c1535a0 0x7f0e3c1e2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3a7fc700 1 -- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3c0c47c0 msgr2=0x7f0e3c1e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3a7fc700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3c0c47c0 0x7f0e3c1e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3a7fc700 1 -- 172.21.15.135:0/2288256513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009a70 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e3a7fc700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0cbf50 0x7f0e3c1e59f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00c4e0 tx=0x7f0e2c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e237fe700 1 -- 172.21.15.135:0/2288256513 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0052d0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e237fe700 1 -- 172.21.15.135:0/2288256513 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c005430 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c1ef740 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e237fe700 1 -- 172.21.15.135:0/2288256513 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0038c0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.451+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c1efd00 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.452+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c0c3bb0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.452+0000 7f0e237fe700 1 -- 172.21.15.135:0/2288256513 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e2c003a20 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.453+0000 7f0e237fe700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0e2806acc0 0x7f0e2806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.453+0000 7f0e237fe700 1 -- 172.21.15.135:0/2288256513 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e2c088ac0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.453+0000 7f0e3affd700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0e2806acc0 0x7f0e2806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.453+0000 7f0e3affd700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0e2806acc0 0x7f0e2806d180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0e30005910 tx=0x7f0e30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.457+0000 7f0e237fe700 1 -- 172.21.15.135:0/2288256513 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0e2c0539c0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.656+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e3c067fa0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.656+0000 7f0e237fe700 1 -- 172.21.15.135:0/2288256513 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e2c056fe0 con 0x7f0e3c0cbf50 2024-05-08T20:55:32.658 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T20:55:32.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0e2806acc0 msgr2=0x7f0e2806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0e2806acc0 0x7f0e2806d180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0e30005910 tx=0x7f0e30009040 comp rx=0 tx=0).stop 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0cbf50 msgr2=0x7f0e3c1e59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0cbf50 0x7f0e3c1e59f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00c4e0 tx=0x7f0e2c00c8a0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 shutdown_connections 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f0e2806acc0 0x7f0e2806d180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e3c0c47c0 0x7f0e3c1e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3c1535a0 0x7f0e3c1e2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 --2- 172.21.15.135:0/2288256513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e3c0cbf50 0x7f0e3c1e59f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 >> 172.21.15.135:0/2288256513 conn(0x7f0e3c06daf0 msgr2=0x7f0e3c0c75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 shutdown_connections 2024-05-08T20:55:32.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.658+0000 7f0e417cf700 1 -- 172.21.15.135:0/2288256513 wait complete. 2024-05-08T20:55:32.672 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:55:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.795+0000 7f9837f7b700 1 Processor -- start 2024-05-08T20:55:32.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9837f7b700 1 -- start start 2024-05-08T20:55:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9837f7b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98300c47c0 0x7f9830164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9837f7b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983015c990 con 0x7f98301535a0 2024-05-08T20:55:32.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9837f7b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983015cbc0 con 0x7f98300cbf50 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9837f7b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983015ce60 con 0x7f98300c47c0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9836518700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98300c47c0 0x7f9830164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9835d17700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f98301535a0 0x7f983006a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36554/0 (socket says 172.21.15.135:36554) 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.796+0000 7f9835d17700 1 -- 172.21.15.135:0/4193541846 learned_addr learned my addr 172.21.15.135:0/4193541846 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9836518700 1 -- 172.21.15.135:0/4193541846 >> v1:172.21.15.183:6789/0 conn(0x7f98300cbf50 legacy=0x7f98300c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9836518700 1 -- 172.21.15.135:0/4193541846 >> v1:172.21.15.135:6789/0 conn(0x7f98301535a0 legacy=0x7f983006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9836518700 1 -- 172.21.15.135:0/4193541846 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983015d140 con 0x7f98300c47c0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9834d15700 1 -- 172.21.15.135:0/4193541846 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641015800 0 0) 0x7f983015c990 con 0x7f98301535a0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9836518700 1 --2- 172.21.15.135:0/4193541846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f9830164c90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9828009d90 tx=0x7f982800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe94e33fc75747c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9834d15700 1 -- 172.21.15.135:0/4193541846 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800e070 con 0x7f98300c47c0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9834d15700 1 -- 172.21.15.135:0/4193541846 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800bbd0 con 0x7f98300c47c0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.797+0000 7f9834d15700 1 -- 172.21.15.135:0/4193541846 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828012430 con 0x7f98300c47c0 2024-05-08T20:55:32.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.798+0000 7f9837f7b700 1 -- 172.21.15.135:0/4193541846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 msgr2=0x7f9830164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.798+0000 7f9837f7b700 1 --2- 172.21.15.135:0/4193541846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f9830164c90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9828009d90 tx=0x7f982800b330 comp rx=0 tx=0).stop 2024-05-08T20:55:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.798+0000 7f9837f7b700 1 -- 172.21.15.135:0/4193541846 shutdown_connections 2024-05-08T20:55:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.798+0000 7f9837f7b700 1 --2- 172.21.15.135:0/4193541846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f9830164c90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.798+0000 7f9837f7b700 1 -- 172.21.15.135:0/4193541846 >> 172.21.15.135:0/4193541846 conn(0x7f983006daf0 msgr2=0x7f983006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.798+0000 7f9837f7b700 1 -- 172.21.15.135:0/4193541846 shutdown_connections 2024-05-08T20:55:32.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.798+0000 7f9837f7b700 1 -- 172.21.15.135:0/4193541846 wait complete. 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.799+0000 7f9837f7b700 1 Processor -- start 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.799+0000 7f9837f7b700 1 -- start start 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f98301ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98300cbf50 0x7f98301491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98301535a0 0x7f983014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98301f1d50 con 0x7f98300c47c0 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983014d030 con 0x7f98300cbf50 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983006c210 con 0x7f98301535a0 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f98301ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f98301ee9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42092/0 (socket says 172.21.15.135:42092) 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 -- 172.21.15.135:0/3570756626 learned_addr learned my addr 172.21.15.135:0/3570756626 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835516700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98300cbf50 0x7f98301491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9836518700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98301535a0 0x7f983014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 -- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98301535a0 msgr2=0x7f983014e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98301535a0 0x7f983014e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 -- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98300cbf50 msgr2=0x7f98301491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98300cbf50 0x7f98301491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 -- 172.21.15.135:0/3570756626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828009a70 con 0x7f98300c47c0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9836518700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98301535a0 0x7f983014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9835d17700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f98301ee9e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f982000c520 tx=0x7f982000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f98267fc700 1 -- 172.21.15.135:0/3570756626 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820004c80 con 0x7f98300c47c0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f98267fc700 1 -- 172.21.15.135:0/3570756626 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820004de0 con 0x7f98300c47c0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983014d2d0 con 0x7f98300c47c0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f98267fc700 1 -- 172.21.15.135:0/3570756626 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820007310 con 0x7f98300c47c0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.800+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983014d890 con 0x7f98300c47c0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.801+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9830067fa0 con 0x7f98300c47c0 2024-05-08T20:55:32.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.802+0000 7f98267fc700 1 -- 172.21.15.135:0/3570756626 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9820007470 con 0x7f98300c47c0 2024-05-08T20:55:32.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.802+0000 7f98267fc700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f981406ac90 0x7f981406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:32.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.802+0000 7f98267fc700 1 -- 172.21.15.135:0/3570756626 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9820089290 con 0x7f98300c47c0 2024-05-08T20:55:32.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.802+0000 7f9835516700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f981406ac90 0x7f981406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:32.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.802+0000 7f9835516700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f981406ac90 0x7f981406d150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f98300c5dd0 tx=0x7f982c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:32.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:32.807+0000 7f98267fc700 1 -- 172.21.15.135:0/3570756626 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9820054210 con 0x7f98300c47c0 2024-05-08T20:55:33.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.004+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98300cb690 con 0x7f98300c47c0 2024-05-08T20:55:33.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.004+0000 7f98267fc700 1 -- 172.21.15.135:0/3570756626 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9820057830 con 0x7f98300c47c0 2024-05-08T20:55:33.007 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f981406ac90 msgr2=0x7f981406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f981406ac90 0x7f981406d150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f98300c5dd0 tx=0x7f982c009040 comp rx=0 tx=0).stop 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 msgr2=0x7f98301ee9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f98301ee9e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f982000c520 tx=0x7f982000c830 comp rx=0 tx=0).stop 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 shutdown_connections 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f981406ac90 0x7f981406d150 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98301535a0 0x7f983014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98300c47c0 0x7f98301ee9e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 --2- 172.21.15.135:0/3570756626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98300cbf50 0x7f98301491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 >> 172.21.15.135:0/3570756626 conn(0x7f983006daf0 msgr2=0x7f98300728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:33.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 shutdown_connections 2024-05-08T20:55:33.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.007+0000 7f9837f7b700 1 -- 172.21.15.135:0/3570756626 wait complete. 2024-05-08T20:55:33.021 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:55:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.145+0000 7f4248d8f700 1 Processor -- start 2024-05-08T20:55:33.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.145+0000 7f4248d8f700 1 -- start start 2024-05-08T20:55:33.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f4248d8f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42441514b0 0x7f4244157910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f4248d8f700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440c8780 con 0x7f42440cca80 2024-05-08T20:55:33.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f4248d8f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424415b790 con 0x7f4244157e50 2024-05-08T20:55:33.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f4248d8f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42441571e0 con 0x7f42441514b0 2024-05-08T20:55:33.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f4242d9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f42440cca80 0x7f4244161b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36558/0 (socket says 172.21.15.135:36558) 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f424259c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f42441514b0 0x7f4244157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f4242d9d700 1 -- 172.21.15.135:0/3339913776 learned_addr learned my addr 172.21.15.135:0/3339913776 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f424259c700 1 -- 172.21.15.135:0/3339913776 >> v1:172.21.15.183:6789/0 conn(0x7f4244157e50 legacy=0x7f42440c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f424259c700 1 -- 172.21.15.135:0/3339913776 >> v1:172.21.15.135:6789/0 conn(0x7f42440cca80 legacy=0x7f4244161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f424259c700 1 -- 172.21.15.135:0/3339913776 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424415ac10 con 0x7f42441514b0 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.146+0000 7f424159a700 1 -- 172.21.15.135:0/3339913776 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300036871 0 0) 0x7f42440c8780 con 0x7f42440cca80 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f424259c700 1 --2- 172.21.15.135:0/3339913776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42441514b0 0x7f4244157910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4238009840 tx=0x7f4238009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1b3bd6997f1321 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f424159a700 1 -- 172.21.15.135:0/3339913776 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238004230 con 0x7f42441514b0 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f424159a700 1 -- 172.21.15.135:0/3339913776 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4238004390 con 0x7f42441514b0 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f424159a700 1 -- 172.21.15.135:0/3339913776 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380036a0 con 0x7f42441514b0 2024-05-08T20:55:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f4248d8f700 1 -- 172.21.15.135:0/3339913776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42441514b0 msgr2=0x7f4244157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3339913776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42441514b0 0x7f4244157910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4238009840 tx=0x7f4238009b50 comp rx=0 tx=0).stop 2024-05-08T20:55:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f4248d8f700 1 -- 172.21.15.135:0/3339913776 shutdown_connections 2024-05-08T20:55:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3339913776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42441514b0 0x7f4244157910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f4248d8f700 1 -- 172.21.15.135:0/3339913776 >> 172.21.15.135:0/3339913776 conn(0x7f424406a960 msgr2=0x7f424406ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f4248d8f700 1 -- 172.21.15.135:0/3339913776 shutdown_connections 2024-05-08T20:55:33.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.147+0000 7f4248d8f700 1 -- 172.21.15.135:0/3339913776 wait complete. 2024-05-08T20:55:33.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.149+0000 7f4248d8f700 1 Processor -- start 2024-05-08T20:55:33.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.149+0000 7f4248d8f700 1 -- start start 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42440cca80 0x7f424414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42441514b0 0x7f4244158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4244157e50 0x7f4244158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244158410 con 0x7f42440cca80 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441eccd0 con 0x7f42441514b0 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440c3370 con 0x7f4244157e50 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42440cca80 0x7f424414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42440cca80 0x7f424414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42104/0 (socket says 172.21.15.135:42104) 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 -- 172.21.15.135:0/3283229305 learned_addr learned my addr 172.21.15.135:0/3283229305 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4242d9d700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4244157e50 0x7f4244158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4241d9b700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42441514b0 0x7f4244158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 -- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4244157e50 msgr2=0x7f4244158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4244157e50 0x7f4244158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 -- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42441514b0 msgr2=0x7f4244158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42441514b0 0x7f4244158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 -- 172.21.15.135:0/3283229305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42380094a0 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f424259c700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42440cca80 0x7f424414fe00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42380090b0 tx=0x7f4238004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4232ffd700 1 -- 172.21.15.135:0/3283229305 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238011830 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4232ffd700 1 -- 172.21.15.135:0/3283229305 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423801e070 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4232ffd700 1 -- 172.21.15.135:0/3283229305 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238011bb0 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42441ecee0 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.150+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42441ed4a0 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.151+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4244158680 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.152+0000 7f4232ffd700 1 -- 172.21.15.135:0/3283229305 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4238011d10 con 0x7f42440cca80 2024-05-08T20:55:33.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.152+0000 7f4232ffd700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f422406ac90 0x7f422406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.152+0000 7f4241d9b700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f422406ac90 0x7f422406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.152+0000 7f4232ffd700 1 -- 172.21.15.135:0/3283229305 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f423808a9f0 con 0x7f42440cca80 2024-05-08T20:55:33.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.153+0000 7f4241d9b700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f422406ac90 0x7f422406d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f42441e1080 tx=0x7f4234009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.157+0000 7f4232ffd700 1 -- 172.21.15.135:0/3283229305 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f42380558e0 con 0x7f42440cca80 2024-05-08T20:55:33.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.351+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42440c7e30 con 0x7f42440cca80 2024-05-08T20:55:33.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.352+0000 7f4232ffd700 1 -- 172.21.15.135:0/3283229305 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4238020020 con 0x7f42440cca80 2024-05-08T20:55:33.354 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T20:55:33.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f422406ac90 msgr2=0x7f422406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f422406ac90 0x7f422406d150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f42441e1080 tx=0x7f4234009040 comp rx=0 tx=0).stop 2024-05-08T20:55:33.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42440cca80 msgr2=0x7f424414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42440cca80 0x7f424414fe00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f42380090b0 tx=0x7f4238004750 comp rx=0 tx=0).stop 2024-05-08T20:55:33.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 shutdown_connections 2024-05-08T20:55:33.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f422406ac90 0x7f422406d150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4244157e50 0x7f4244158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42440cca80 0x7f424414fe00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 --2- 172.21.15.135:0/3283229305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42441514b0 0x7f4244158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 >> 172.21.15.135:0/3283229305 conn(0x7f424406a960 msgr2=0x7f42440ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:33.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 shutdown_connections 2024-05-08T20:55:33.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.354+0000 7f4248d8f700 1 -- 172.21.15.135:0/3283229305 wait complete. 2024-05-08T20:55:33.368 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T20:55:33.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.490+0000 7f6e7c8d4700 1 Processor -- start 2024-05-08T20:55:33.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.490+0000 7f6e7c8d4700 1 -- start start 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e7c8d4700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e781504c0 0x7f6e780c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e7c8d4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e78159670 0x7f6e78072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e7c8d4700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e78159ab0 0x7f6e780c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e7c8d4700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780c2de0 con 0x7f6e78159ab0 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e7c8d4700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780c5720 con 0x7f6e781504c0 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e7c8d4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e781508a0 con 0x7f6e78159670 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e76d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e78159ab0 0x7f6e780c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e76d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6e78159ab0 0x7f6e780c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42112/0 (socket says 172.21.15.135:42112) 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.491+0000 7f6e76d9d700 1 -- 172.21.15.135:0/244311314 learned_addr learned my addr 172.21.15.135:0/244311314 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e7659c700 1 --2- 172.21.15.135:0/244311314 >> v2:172.21.15.183:3300/0 conn(0x7f6e781504c0 0x7f6e780c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e75d9b700 1 --2- 172.21.15.135:0/244311314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e78159670 0x7f6e78072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e76d9d700 1 -- 172.21.15.135:0/244311314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e78159670 msgr2=0x7f6e78072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e76d9d700 1 --2- 172.21.15.135:0/244311314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e78159670 0x7f6e78072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e76d9d700 1 -- 172.21.15.135:0/244311314 >> v2:172.21.15.183:3300/0 conn(0x7f6e781504c0 msgr2=0x7f6e780c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e76d9d700 1 --2- 172.21.15.135:0/244311314 >> v2:172.21.15.183:3300/0 conn(0x7f6e781504c0 0x7f6e780c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e76d9d700 1 -- 172.21.15.135:0/244311314 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780c5940 con 0x7f6e78159ab0 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e7659c700 1 --2- 172.21.15.135:0/244311314 >> v2:172.21.15.183:3300/0 conn(0x7f6e781504c0 0x7f6e780c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e76d9d700 1 --2- 172.21.15.135:0/244311314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159ab0 0x7f6e780c6600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6e780c94c0 tx=0x7f6e7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8e55be8308b53d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e7559a700 1 -- 172.21.15.135:0/244311314 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000e070 con 0x7f6e78159ab0 2024-05-08T20:55:33.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e7559a700 1 -- 172.21.15.135:0/244311314 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000b9c0 con 0x7f6e78159ab0 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e7559a700 1 -- 172.21.15.135:0/244311314 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000bd70 con 0x7f6e78159ab0 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/244311314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159ab0 msgr2=0x7f6e780c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.492+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/244311314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159ab0 0x7f6e780c6600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6e780c94c0 tx=0x7f6e7000b330 comp rx=0 tx=0).stop 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.493+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/244311314 shutdown_connections 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.493+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/244311314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159ab0 0x7f6e780c6600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.493+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/244311314 >> v2:172.21.15.183:3300/0 conn(0x7f6e781504c0 0x7f6e780c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.493+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/244311314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e78159670 0x7f6e78072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.493+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/244311314 >> 172.21.15.135:0/244311314 conn(0x7f6e7806daf0 msgr2=0x7f6e7806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.493+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/244311314 shutdown_connections 2024-05-08T20:55:33.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.493+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/244311314 wait complete. 2024-05-08T20:55:33.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.494+0000 7f6e7c8d4700 1 Processor -- start 2024-05-08T20:55:33.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.494+0000 7f6e7c8d4700 1 -- start start 2024-05-08T20:55:33.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e781504c0 0x7f6e7814dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159670 0x7f6e781ed7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e78159ab0 0x7f6e78140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78158c60 con 0x7f6e78159670 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7814e3d0 con 0x7f6e78159ab0 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78159080 con 0x7f6e781504c0 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159670 0x7f6e781ed7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159670 0x7f6e781ed7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42116/0 (socket says 172.21.15.135:42116) 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 -- 172.21.15.135:0/1330691017 learned_addr learned my addr 172.21.15.135:0/1330691017 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7659c700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e781504c0 0x7f6e7814dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e76d9d700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e78159ab0 0x7f6e78140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 -- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e781504c0 msgr2=0x7f6e7814dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e781504c0 0x7f6e7814dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 -- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e78159ab0 msgr2=0x7f6e78140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e78159ab0 0x7f6e78140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 -- 172.21.15.135:0/1330691017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e70009b30 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e75d9b700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159670 0x7f6e781ed7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00e870 tx=0x7f6e6c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e66ffd700 1 -- 172.21.15.135:0/1330691017 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c013610 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e66ffd700 1 -- 172.21.15.135:0/1330691017 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c013770 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e781edce0 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e66ffd700 1 -- 172.21.15.135:0/1330691017 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c013b20 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.495+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e781582c0 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.496+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e78158da0 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.497+0000 7f6e66ffd700 1 -- 172.21.15.135:0/1330691017 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e6c013c80 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.497+0000 7f6e66ffd700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6e5806acc0 0x7f6e5806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.497+0000 7f6e66ffd700 1 -- 172.21.15.135:0/1330691017 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e6c088f40 con 0x7f6e78159670 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.497+0000 7f6e7659c700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6e5806acc0 0x7f6e5806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.498+0000 7f6e7659c700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6e5806acc0 0x7f6e5806d180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e680045f0 tx=0x7f6e68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.502+0000 7f6e66ffd700 1 -- 172.21.15.135:0/1330691017 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6e78158da0 con 0x7f6e78159670 2024-05-08T20:55:33.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.697+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6e781edce0 con 0x7f6e78159670 2024-05-08T20:55:33.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.697+0000 7f6e66ffd700 1 -- 172.21.15.135:0/1330691017 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6e781edce0 con 0x7f6e78159670 2024-05-08T20:55:33.699 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6e5806acc0 msgr2=0x7f6e5806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6e5806acc0 0x7f6e5806d180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6e680045f0 tx=0x7f6e68008040 comp rx=0 tx=0).stop 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159670 msgr2=0x7f6e781ed7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159670 0x7f6e781ed7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00e870 tx=0x7f6e6c00eb80 comp rx=0 tx=0).stop 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 shutdown_connections 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6e5806acc0 0x7f6e5806d180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e78159ab0 0x7f6e78140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e781504c0 0x7f6e7814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 --2- 172.21.15.135:0/1330691017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e78159670 0x7f6e781ed7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 >> 172.21.15.135:0/1330691017 conn(0x7f6e7806daf0 msgr2=0x7f6e780c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:33.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 shutdown_connections 2024-05-08T20:55:33.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.700+0000 7f6e7c8d4700 1 -- 172.21.15.135:0/1330691017 wait complete. 2024-05-08T20:55:33.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:55:33.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.833+0000 7f31c4d74700 1 Processor -- start 2024-05-08T20:55:33.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.833+0000 7f31c4d74700 1 -- start start 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31c4d74700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f31c01535a0 0x7f31c006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31c4d74700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31c00cbf50 0x7f31c006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31c4d74700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c015c990 con 0x7f31c0072ae0 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31c4d74700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c015cbc0 con 0x7f31c01535a0 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31c4d74700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c015ce60 con 0x7f31c00cbf50 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31be59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f31c01535a0 0x7f31c006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31be59c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f31c01535a0 0x7f31c006a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42118/0 (socket says 172.21.15.135:42118) 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.834+0000 7f31be59c700 1 -- 172.21.15.135:0/4289905493 learned_addr learned my addr 172.21.15.135:0/4289905493 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:33.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31bdd9b700 1 --2- 172.21.15.135:0/4289905493 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cbf50 0x7f31c006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31be59c700 1 -- 172.21.15.135:0/4289905493 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cbf50 msgr2=0x7f31c006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31be59c700 1 --2- 172.21.15.135:0/4289905493 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cbf50 0x7f31c006aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31be59c700 1 -- 172.21.15.135:0/4289905493 >> v1:172.21.15.183:6789/0 conn(0x7f31c0072ae0 legacy=0x7f31c00c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31be59c700 1 -- 172.21.15.135:0/4289905493 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c015d140 con 0x7f31c01535a0 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31bdd9b700 1 --2- 172.21.15.135:0/4289905493 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cbf50 0x7f31c006aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31be59c700 1 --2- 172.21.15.135:0/4289905493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c01535a0 0x7f31c006a960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f31c0073b70 tx=0x7f31b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73385aa2a4ad18e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31bd59a700 1 -- 172.21.15.135:0/4289905493 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0004230 con 0x7f31c01535a0 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31bd59a700 1 -- 172.21.15.135:0/4289905493 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b0004390 con 0x7f31c01535a0 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31bd59a700 1 -- 172.21.15.135:0/4289905493 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00036a0 con 0x7f31c01535a0 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31c4d74700 1 -- 172.21.15.135:0/4289905493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c01535a0 msgr2=0x7f31c006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.835+0000 7f31c4d74700 1 --2- 172.21.15.135:0/4289905493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c01535a0 0x7f31c006a960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f31c0073b70 tx=0x7f31b0009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.836+0000 7f31c4d74700 1 -- 172.21.15.135:0/4289905493 shutdown_connections 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.836+0000 7f31c4d74700 1 --2- 172.21.15.135:0/4289905493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c01535a0 0x7f31c006a960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.836+0000 7f31c4d74700 1 --2- 172.21.15.135:0/4289905493 >> v2:172.21.15.183:3300/0 conn(0x7f31c00cbf50 0x7f31c006aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.836+0000 7f31c4d74700 1 -- 172.21.15.135:0/4289905493 >> 172.21.15.135:0/4289905493 conn(0x7f31c006daf0 msgr2=0x7f31c006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:33.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.836+0000 7f31c4d74700 1 -- 172.21.15.135:0/4289905493 shutdown_connections 2024-05-08T20:55:33.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.836+0000 7f31c4d74700 1 -- 172.21.15.135:0/4289905493 wait complete. 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.837+0000 7f31c4d74700 1 Processor -- start 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.837+0000 7f31c4d74700 1 -- start start 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c0072ae0 0x7f31c0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c00cbf50 0x7f31c01ef590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c01535a0 0x7f31c01efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01f3370 con 0x7f31c00cbf50 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01f27f0 con 0x7f31c01535a0 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c01f2ad0 con 0x7f31c0072ae0 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c00cbf50 0x7f31c01ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c00cbf50 0x7f31c01ef590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42134/0 (socket says 172.21.15.135:42134) 2024-05-08T20:55:33.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 -- 172.21.15.135:0/1912179630 learned_addr learned my addr 172.21.15.135:0/1912179630 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31be59c700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c0072ae0 0x7f31c0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bed9d700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c01535a0 0x7f31c01efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 -- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c0072ae0 msgr2=0x7f31c0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c0072ae0 0x7f31c0152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 -- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c01535a0 msgr2=0x7f31c01efad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c01535a0 0x7f31c01efad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 -- 172.21.15.135:0/1912179630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009550 con 0x7f31c00cbf50 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31be59c700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c0072ae0 0x7f31c0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31bdd9b700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c00cbf50 0x7f31c01ef590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c750 tx=0x7f31a800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31b6ffd700 1 -- 172.21.15.135:0/1912179630 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011800 con 0x7f31c00cbf50 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31b6ffd700 1 -- 172.21.15.135:0/1912179630 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a8011960 con 0x7f31c00cbf50 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c01f2db0 con 0x7f31c00cbf50 2024-05-08T20:55:33.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31b6ffd700 1 -- 172.21.15.135:0/1912179630 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8011cd0 con 0x7f31c00cbf50 2024-05-08T20:55:33.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.838+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c01ef070 con 0x7f31c00cbf50 2024-05-08T20:55:33.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.839+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c00c33c0 con 0x7f31c00cbf50 2024-05-08T20:55:33.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.840+0000 7f31b6ffd700 1 -- 172.21.15.135:0/1912179630 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f31a8021350 con 0x7f31c00cbf50 2024-05-08T20:55:33.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.840+0000 7f31b6ffd700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f31a006ac90 0x7f31a006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:33.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.840+0000 7f31b6ffd700 1 -- 172.21.15.135:0/1912179630 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31a8089620 con 0x7f31c00cbf50 2024-05-08T20:55:33.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.840+0000 7f31be59c700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f31a006ac90 0x7f31a006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:33.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.841+0000 7f31be59c700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f31a006ac90 0x7f31a006d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009130 tx=0x7f31b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:33.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:33.845+0000 7f31b6ffd700 1 -- 172.21.15.135:0/1912179630 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f31a8054510 con 0x7f31c00cbf50 2024-05-08T20:55:34.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.086+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31c01ef290 con 0x7f31c00cbf50 2024-05-08T20:55:34.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.087+0000 7f31b6ffd700 1 -- 172.21.15.135:0/1912179630 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f31a8057b30 con 0x7f31c00cbf50 2024-05-08T20:55:34.090 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:34.090 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:23.530682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:55:34.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f31a006ac90 msgr2=0x7f31a006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f31a006ac90 0x7f31a006d150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009130 tx=0x7f31b0008030 comp rx=0 tx=0).stop 2024-05-08T20:55:34.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c00cbf50 msgr2=0x7f31c01ef590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c00cbf50 0x7f31c01ef590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f31a800c750 tx=0x7f31a800cb10 comp rx=0 tx=0).stop 2024-05-08T20:55:34.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 shutdown_connections 2024-05-08T20:55:34.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f31a006ac90 0x7f31a006d150 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c01535a0 0x7f31c01efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31c0072ae0 0x7f31c0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 --2- 172.21.15.135:0/1912179630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31c00cbf50 0x7f31c01ef590 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 >> 172.21.15.135:0/1912179630 conn(0x7f31c006daf0 msgr2=0x7f31c00c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:34.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 shutdown_connections 2024-05-08T20:55:34.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.089+0000 7f31c4d74700 1 -- 172.21.15.135:0/1912179630 wait complete. 2024-05-08T20:55:34.094 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-08T20:55:34.104 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:55:34.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.223+0000 7f1a319bf700 1 Processor -- start 2024-05-08T20:55:34.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.223+0000 7f1a319bf700 1 -- start start 2024-05-08T20:55:34.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a319bf700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 0x7f1a2c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a319bf700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c15a220 con 0x7f1a2c0cb5a0 2024-05-08T20:55:34.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a319bf700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c0cb370 con 0x7f1a2c0cb980 2024-05-08T20:55:34.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a319bf700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0ce520 con 0x7f1a2c0cd250 2024-05-08T20:55:34.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a2affd700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1a2c0cb5a0 0x7f1a2c0cdb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36560/0 (socket says 172.21.15.135:36560) 2024-05-08T20:55:34.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a2affd700 1 -- 172.21.15.135:0/614644988 learned_addr learned my addr 172.21.15.135:0/614644988 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a2b7fe700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 0x7f1a2c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210941868 0 0) 0x7f1a2c15a220 con 0x7f1a2c0cb5a0 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a140035b0 con 0x7f1a2c0cb5a0 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078055063 0 0) 0x7f1a2c0cb370 con 0x7f1a2c0cb980 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a2c15a220 con 0x7f1a2c0cb980 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068915702 0 0) 0x7f1a140035b0 con 0x7f1a2c0cb5a0 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 msgr2=0x7f1a2c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 0x7f1a2c0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 >> v1:172.21.15.183:6789/0 conn(0x7f1a2c0cb980 legacy=0x7f1a2c0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0ce260 con 0x7f1a2c0cb5a0 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f1a1c001670 con 0x7f1a2c0cb5a0 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a2b7fe700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 0x7f1a2c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 >> v1:172.21.15.135:6789/0 conn(0x7f1a2c0cb5a0 legacy=0x7f1a2c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a14003bc0 0x7f1a14003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a14004850 0x7f1a14004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 0x7f1a14005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0ce520 con 0x7f1a14003bc0 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1400bac0 con 0x7f1a14004850 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.224+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1400bc50 con 0x7f1a2c0cd250 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2affd700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a14003bc0 0x7f1a14003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2a7fc700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a14004850 0x7f1a14004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2b7fe700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 0x7f1a14005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2affd700 1 -- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 msgr2=0x7f1a14005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2affd700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a2c0cd250 0x7f1a14005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2affd700 1 -- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a14004850 msgr2=0x7f1a14004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2affd700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a14004850 0x7f1a14004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2affd700 1 -- 172.21.15.135:0/614644988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24009a70 con 0x7f1a14003bc0 2024-05-08T20:55:34.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a2affd700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a14003bc0 0x7f1a14003fc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c0e0 tx=0x7f1a14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23576e1174996d1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00cc80 con 0x7f1a14003bc0 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c00cde0 con 0x7f1a14003bc0 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.225+0000 7f1a29ffb700 1 -- 172.21.15.135:0/614644988 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c005ba0 con 0x7f1a14003bc0 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.226+0000 7f1a319bf700 1 -- 172.21.15.135:0/614644988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a14003bc0 msgr2=0x7f1a14003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.226+0000 7f1a319bf700 1 --2- 172.21.15.135:0/614644988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a14003bc0 0x7f1a14003fc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c0e0 tx=0x7f1a14005880 comp rx=0 tx=0).stop 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.226+0000 7f1a2b7fe700 1 -- 172.21.15.135:0/614644988 reap_dead start 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.226+0000 7f1a319bf700 1 -- 172.21.15.135:0/614644988 shutdown_connections 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.226+0000 7f1a319bf700 1 -- 172.21.15.135:0/614644988 >> 172.21.15.135:0/614644988 conn(0x7f1a2c0726c0 msgr2=0x7f1a2c0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.226+0000 7f1a319bf700 1 -- 172.21.15.135:0/614644988 shutdown_connections 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.226+0000 7f1a319bf700 1 -- 172.21.15.135:0/614644988 wait complete. 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.227+0000 7f1a319bf700 1 Processor -- start 2024-05-08T20:55:34.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.227+0000 7f1a319bf700 1 -- start start 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a319bf700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a14003bc0 0x7f1a2c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a319bf700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a2c0c71c0 0x7f1a2c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a319bf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a2c0b0930 0x7f1a2c0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a319bf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c1f3870 con 0x7f1a2c0b0930 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a319bf700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c7b60 con 0x7f1a2c0c71c0 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a319bf700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c1f2980 con 0x7f1a14003bc0 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a2b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a2c0b0930 0x7f1a2c0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a2b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a2c0b0930 0x7f1a2c0b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42146/0 (socket says 172.21.15.135:42146) 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.228+0000 7f1a2b7fe700 1 -- 172.21.15.135:0/1972084773 learned_addr learned my addr 172.21.15.135:0/1972084773 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2a7fc700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a2c0c71c0 0x7f1a2c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2affd700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a14003bc0 0x7f1a2c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2b7fe700 1 -- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a14003bc0 msgr2=0x7f1a2c153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2b7fe700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a14003bc0 0x7f1a2c153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2b7fe700 1 -- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a2c0c71c0 msgr2=0x7f1a2c0c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2b7fe700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a2c0c71c0 0x7f1a2c0c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2b7fe700 1 -- 172.21.15.135:0/1972084773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c1f2c60 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a2b7fe700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a2c0b0930 0x7f1a2c0b0db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0cfc70 tx=0x7f1a2400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a13fff700 1 -- 172.21.15.135:0/1972084773 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2401c070 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a13fff700 1 -- 172.21.15.135:0/1972084773 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2400f040 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a13fff700 1 -- 172.21.15.135:0/1972084773 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400e040 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c1f2f40 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.229+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c1f3500 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.230+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c1f36c0 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.231+0000 7f1a13fff700 1 -- 172.21.15.135:0/1972084773 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a24015430 con 0x7f1a2c0b0930 2024-05-08T20:55:34.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.231+0000 7f1a13fff700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1a1806ac90 0x7f1a1806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.231+0000 7f1a13fff700 1 -- 172.21.15.135:0/1972084773 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a24089500 con 0x7f1a2c0b0930 2024-05-08T20:55:34.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.231+0000 7f1a2affd700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1a1806ac90 0x7f1a1806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.231+0000 7f1a2affd700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1a1806ac90 0x7f1a1806d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c0e0 tx=0x7f1a1c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:34.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.235+0000 7f1a13fff700 1 -- 172.21.15.135:0/1972084773 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1a240543f0 con 0x7f1a2c0b0930 2024-05-08T20:55:34.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.430+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a2c0c6ee0 con 0x7f1a2c0b0930 2024-05-08T20:55:34.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.431+0000 7f1a13fff700 1 -- 172.21.15.135:0/1972084773 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17926 (secure 0 0 0) 0x7f1a2c0c6ee0 con 0x7f1a2c0b0930 2024-05-08T20:55:34.435 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:34.435 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":25,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:04.509019+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:55:34.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1a1806ac90 msgr2=0x7f1a1806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1a1806ac90 0x7f1a1806d150 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c0e0 tx=0x7f1a1c007000 comp rx=0 tx=0).stop 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a2c0b0930 msgr2=0x7f1a2c0b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a2c0b0930 0x7f1a2c0b0db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0cfc70 tx=0x7f1a2400f490 comp rx=0 tx=0).stop 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 shutdown_connections 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1a1806ac90 0x7f1a1806d150 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a2c0b0930 0x7f1a2c0b0db0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a14003bc0 0x7f1a2c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 --2- 172.21.15.135:0/1972084773 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a2c0c71c0 0x7f1a2c0c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.433+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 >> 172.21.15.135:0/1972084773 conn(0x7f1a2c0726c0 msgr2=0x7f1a2c0cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.434+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 shutdown_connections 2024-05-08T20:55:34.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.434+0000 7f1a319bf700 1 -- 172.21.15.135:0/1972084773 wait complete. 2024-05-08T20:55:34.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:55:34.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.568+0000 7f8e9957e700 1 Processor -- start 2024-05-08T20:55:34.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.568+0000 7f8e9957e700 1 -- start start 2024-05-08T20:55:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e9957e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8e940c8dc0 0x7f8e94162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e9957e700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e940c8780 con 0x7f8e940c8980 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e9957e700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9415b790 con 0x7f8e941514b0 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e9957e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e941571e0 con 0x7f8e940c8dc0 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e937fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8e940c8dc0 0x7f8e94162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e927fc700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8e940c8980 0x7f8e940cca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:36576/0 (socket says 172.21.15.135:36576) 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e927fc700 1 -- 172.21.15.135:0/1394519823 learned_addr learned my addr 172.21.15.135:0/1394519823 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e937fe700 1 -- 172.21.15.135:0/1394519823 >> v1:172.21.15.183:6789/0 conn(0x7f8e941514b0 legacy=0x7f8e94157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e937fe700 1 -- 172.21.15.135:0/1394519823 >> v1:172.21.15.135:6789/0 conn(0x7f8e940c8980 legacy=0x7f8e940cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e937fe700 1 -- 172.21.15.135:0/1394519823 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e940c9230 con 0x7f8e940c8dc0 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e91ffb700 1 -- 172.21.15.135:0/1394519823 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472146169 0 0) 0x7f8e940c8780 con 0x7f8e940c8980 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e937fe700 1 --2- 172.21.15.135:0/1394519823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8dc0 0x7f8e94162b70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009d90 tx=0x7f8e8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b155090fc643cd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.569+0000 7f8e91ffb700 1 -- 172.21.15.135:0/1394519823 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c00e070 con 0x7f8e940c8dc0 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e91ffb700 1 -- 172.21.15.135:0/1394519823 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c00bbd0 con 0x7f8e940c8dc0 2024-05-08T20:55:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e91ffb700 1 -- 172.21.15.135:0/1394519823 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c012430 con 0x7f8e940c8dc0 2024-05-08T20:55:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e9957e700 1 -- 172.21.15.135:0/1394519823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8dc0 msgr2=0x7f8e94162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e9957e700 1 --2- 172.21.15.135:0/1394519823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8dc0 0x7f8e94162b70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009d90 tx=0x7f8e8c00b330 comp rx=0 tx=0).stop 2024-05-08T20:55:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e9957e700 1 -- 172.21.15.135:0/1394519823 shutdown_connections 2024-05-08T20:55:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e9957e700 1 --2- 172.21.15.135:0/1394519823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8dc0 0x7f8e94162b70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e9957e700 1 -- 172.21.15.135:0/1394519823 >> 172.21.15.135:0/1394519823 conn(0x7f8e9406a960 msgr2=0x7f8e9406ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e9957e700 1 -- 172.21.15.135:0/1394519823 shutdown_connections 2024-05-08T20:55:34.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.570+0000 7f8e9957e700 1 -- 172.21.15.135:0/1394519823 wait complete. 2024-05-08T20:55:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.571+0000 7f8e9957e700 1 Processor -- start 2024-05-08T20:55:34.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e9957e700 1 -- start start 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e9957e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8980 0x7f8e941f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e9957e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940c8dc0 0x7f8e941f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e9957e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e941514b0 0x7f8e940c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e9957e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940c5840 con 0x7f8e940c8980 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e9957e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94151ba0 con 0x7f8e940c8dc0 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e9957e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940cd1f0 con 0x7f8e941514b0 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e92ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8980 0x7f8e941f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e92ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8980 0x7f8e941f0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42164/0 (socket says 172.21.15.135:42164) 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e92ffd700 1 -- 172.21.15.135:0/2882796057 learned_addr learned my addr 172.21.15.135:0/2882796057 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e927fc700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940c8dc0 0x7f8e941f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.572+0000 7f8e937fe700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e941514b0 0x7f8e940c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e92ffd700 1 -- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e941514b0 msgr2=0x7f8e940c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e92ffd700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e941514b0 0x7f8e940c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e92ffd700 1 -- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940c8dc0 msgr2=0x7f8e941f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e92ffd700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940c8dc0 0x7f8e941f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e92ffd700 1 -- 172.21.15.135:0/2882796057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c009a70 con 0x7f8e940c8980 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e92ffd700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8980 0x7f8e941f0080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c450 tx=0x7f8e8400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e7b7fe700 1 -- 172.21.15.135:0/2882796057 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e840052d0 con 0x7f8e940c8980 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e7b7fe700 1 -- 172.21.15.135:0/2882796057 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84005430 con 0x7f8e940c8980 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e941f0bb0 con 0x7f8e940c8980 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e7b7fe700 1 -- 172.21.15.135:0/2882796057 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e840038c0 con 0x7f8e940c8980 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.573+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e940c5a90 con 0x7f8e940c8980 2024-05-08T20:55:34.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.574+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9415b1d0 con 0x7f8e940c8980 2024-05-08T20:55:34.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.574+0000 7f8e7b7fe700 1 -- 172.21.15.135:0/2882796057 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e84003a20 con 0x7f8e940c8980 2024-05-08T20:55:34.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.575+0000 7f8e7b7fe700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8e8006acc0 0x7f8e8006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:34.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.575+0000 7f8e7b7fe700 1 -- 172.21.15.135:0/2882796057 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e84088930 con 0x7f8e940c8980 2024-05-08T20:55:34.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.575+0000 7f8e927fc700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8e8006acc0 0x7f8e8006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:34.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.575+0000 7f8e927fc700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8e8006acc0 0x7f8e8006d180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8e94158550 tx=0x7f8e88007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:34.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.579+0000 7f8e7b7fe700 1 -- 172.21.15.135:0/2882796057 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8e84053820 con 0x7f8e940c8980 2024-05-08T20:55:34.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.820+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e94067fa0 con 0x7f8e940c8980 2024-05-08T20:55:34.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.821+0000 7f8e7b7fe700 1 -- 172.21.15.135:0/2882796057 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f8e8400ce60 con 0x7f8e940c8980 2024-05-08T20:55:34.824 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T20:55:34.824 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:23.530682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:55:34.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8e8006acc0 msgr2=0x7f8e8006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8e8006acc0 0x7f8e8006d180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8e94158550 tx=0x7f8e88007de0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8980 msgr2=0x7f8e941f0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:34.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8980 0x7f8e941f0080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c450 tx=0x7f8e8400c760 comp rx=0 tx=0).stop 2024-05-08T20:55:34.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 shutdown_connections 2024-05-08T20:55:34.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8e8006acc0 0x7f8e8006d180 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e941514b0 0x7f8e940c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e940c8980 0x7f8e941f0080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 --2- 172.21.15.135:0/2882796057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940c8dc0 0x7f8e941f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:34.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 >> 172.21.15.135:0/2882796057 conn(0x7f8e9406a960 msgr2=0x7f8e94157810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:34.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 shutdown_connections 2024-05-08T20:55:34.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:34.823+0000 7f8e9957e700 1 -- 172.21.15.135:0/2882796057 wait complete. 2024-05-08T20:55:34.827 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-08T20:55:35.442 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T20:55:00.066076+0000', 'modified': '2024-05-08T20:55:23.530682+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6837/2419873080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 2419873080}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 2419873080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T20:55:35.442 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T20:55:35.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-08T20:55:35.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.569+0000 7fa04eefe700 1 Processor -- start 2024-05-08T20:55:35.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.569+0000 7fa04eefe700 1 -- start start 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04eefe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa04814dcc0 0x7fa0480c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04eefe700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa0480cb830 0x7fa048157a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04eefe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480c4ff0 0x7fa0480c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04eefe700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0481575b0 con 0x7fa04814dcc0 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04eefe700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0480c6700 con 0x7fa0480cb830 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04eefe700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480c69c0 con 0x7fa0480c4ff0 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa04814dcc0 0x7fa0480c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa04814dcc0 0x7fa0480c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42170/0 (socket says 172.21.15.135:42170) 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2958861067 learned_addr learned my addr 172.21.15.135:0/2958861067 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa047fff700 1 --2- 172.21.15.135:0/2958861067 >> v2:172.21.15.183:3300/0 conn(0x7fa0480cb830 0x7fa048157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04d49b700 1 --2- 172.21.15.135:0/2958861067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480c4ff0 0x7fa0480c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2958861067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480c4ff0 msgr2=0x7fa0480c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2958861067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480c4ff0 0x7fa0480c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2958861067 >> v2:172.21.15.183:3300/0 conn(0x7fa0480cb830 msgr2=0x7fa048157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2958861067 >> v2:172.21.15.183:3300/0 conn(0x7fa0480cb830 0x7fa048157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2958861067 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480c6ca0 con 0x7fa04814dcc0 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2958861067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa0480c8b70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa0480c5f70 tx=0x7fa03c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855d73d15f49c1c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.570+0000 7fa0477fe700 1 -- 172.21.15.135:0/2958861067 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00b870 con 0x7fa04814dcc0 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa0477fe700 1 -- 172.21.15.135:0/2958861067 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00b9d0 con 0x7fa04814dcc0 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa0477fe700 1 -- 172.21.15.135:0/2958861067 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00bd60 con 0x7fa04814dcc0 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 -- 172.21.15.135:0/2958861067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 msgr2=0x7fa0480c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 --2- 172.21.15.135:0/2958861067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa0480c8b70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa0480c5f70 tx=0x7fa03c009bd0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 -- 172.21.15.135:0/2958861067 shutdown_connections 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 --2- 172.21.15.135:0/2958861067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa0480c8b70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 --2- 172.21.15.135:0/2958861067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480c4ff0 0x7fa0480c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 --2- 172.21.15.135:0/2958861067 >> v2:172.21.15.183:3300/0 conn(0x7fa0480cb830 0x7fa048157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 -- 172.21.15.135:0/2958861067 >> 172.21.15.135:0/2958861067 conn(0x7fa04806daf0 msgr2=0x7fa04806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 -- 172.21.15.135:0/2958861067 shutdown_connections 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.571+0000 7fa04eefe700 1 -- 172.21.15.135:0/2958861067 wait complete. 2024-05-08T20:55:35.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.572+0000 7fa04eefe700 1 Processor -- start 2024-05-08T20:55:35.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.572+0000 7fa04eefe700 1 -- start start 2024-05-08T20:55:35.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04eefe700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0480c4ff0 0x7fa048156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04eefe700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480cb830 0x7fa04814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04eefe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa048154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04eefe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa048156d70 con 0x7fa04814dcc0 2024-05-08T20:55:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04eefe700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0481599b0 con 0x7fa0480c4ff0 2024-05-08T20:55:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04eefe700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04815a4f0 con 0x7fa0480cb830 2024-05-08T20:55:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04d49b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa048154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04d49b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa048154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42180/0 (socket says 172.21.15.135:42180) 2024-05-08T20:55:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04d49b700 1 -- 172.21.15.135:0/1131283579 learned_addr learned my addr 172.21.15.135:0/1131283579 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0480c4ff0 0x7fa048156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.573+0000 7fa047fff700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480cb830 0x7fa04814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.574+0000 7fa04d49b700 1 -- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480cb830 msgr2=0x7fa04814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.574+0000 7fa04d49b700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480cb830 0x7fa04814b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.574+0000 7fa04d49b700 1 -- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0480c4ff0 msgr2=0x7fa048156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.574+0000 7fa04d49b700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0480c4ff0 0x7fa048156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.574+0000 7fa04d49b700 1 -- 172.21.15.135:0/1131283579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c009550 con 0x7fa04814dcc0 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.574+0000 7fa04d49b700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa048154b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa040007e60 tx=0x7fa04000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.575+0000 7fa0457fa700 1 -- 172.21.15.135:0/1131283579 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000ed30 con 0x7fa04814dcc0 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.575+0000 7fa0457fa700 1 -- 172.21.15.135:0/1131283579 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040014420 con 0x7fa04814dcc0 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.575+0000 7fa0457fa700 1 -- 172.21.15.135:0/1131283579 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0400147d0 con 0x7fa04814dcc0 2024-05-08T20:55:35.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.575+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04815a8a0 con 0x7fa04814dcc0 2024-05-08T20:55:35.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.575+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa048159f30 con 0x7fa04814dcc0 2024-05-08T20:55:35.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.577+0000 7fa0457fa700 1 -- 172.21.15.135:0/1131283579 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa040014930 con 0x7fa04814dcc0 2024-05-08T20:55:35.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.577+0000 7fa0457fa700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa02c06ac90 0x7fa02c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.577+0000 7fa0457fa700 1 -- 172.21.15.135:0/1131283579 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa040089bf0 con 0x7fa04814dcc0 2024-05-08T20:55:35.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.577+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa02c06ac90 0x7fa02c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.578+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa02c06ac90 0x7fa02c06d150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa03c014040 tx=0x7fa03c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.579+0000 7fa05b0b8b80 1 Processor -- start 2024-05-08T20:55:35.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.579+0000 7fa05b0b8b80 1 -- start start 2024-05-08T20:55:35.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c2959a1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c295964930 0x55c29598b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a21b0 0x55c29598bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2958b9100 con 0x55c2959a1dd0 2024-05-08T20:55:35.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2958b6ac0 con 0x55c2959a21b0 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2958b23b0 con 0x55c295964930 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c2959a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c2959a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42190/0 (socket says 172.21.15.135:42190) 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 -- 172.21.15.135:0/1974225850 learned_addr learned my addr 172.21.15.135:0/1974225850 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa047fff700 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c295964930 0x55c29598b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04d49b700 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a21b0 0x55c29598bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 -- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c295964930 msgr2=0x55c29598b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c295964930 0x55c29598b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 -- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a21b0 msgr2=0x55c29598bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a21b0 0x55c29598bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 -- 172.21.15.135:0/1974225850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c295733360 con 0x55c2959a1dd0 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04d49b700 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a21b0 0x55c29598bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.580+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c2959a1450 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00bc40 tx=0x7fa03c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4390b014bb18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa0327fc700 1 -- 172.21.15.135:0/1974225850 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c01f070 con 0x55c2959a1dd0 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa0327fc700 1 -- 172.21.15.135:0/1974225850 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c0278c0 con 0x55c2959a1dd0 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa0327fc700 1 -- 172.21.15.135:0/1974225850 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c027cb0 con 0x55c2959a1dd0 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/1974225850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 msgr2=0x55c2959a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c2959a1450 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00bc40 tx=0x7fa03c010000 comp rx=0 tx=0).stop 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/1974225850 shutdown_connections 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a21b0 0x55c29598bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c2959a1450 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/1974225850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c295964930 0x55c29598b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/1974225850 >> 172.21.15.135:0/1974225850 conn(0x55c2958c01c0 msgr2=0x55c295960300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/1974225850 shutdown_connections 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.581+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/1974225850 wait complete. 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.582+0000 7fa05b0b8b80 1 -- start start 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.582+0000 7fa05b0b8b80 1 Processor -- start 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c29598b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c2959b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c295962c80 0x55c2959a0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29584e510 con 0x55c2959a1dd0 2024-05-08T20:55:35.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29584e1b0 con 0x55c295962c80 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c295735650 con 0x55c2959a21b0 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 10 client.0 _ll_register_callbacks cb 0x55c295857ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c29598b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c29598b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42202/0 (socket says 172.21.15.135:42202) 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2594584114 learned_addr learned my addr 172.21.15.135:0/2594584114 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa047fff700 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c2959b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04d49b700 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c295962c80 0x55c2959a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 msgr2=0x55c2959b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c2959b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c295962c80 msgr2=0x55c2959a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c295962c80 0x55c2959a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 -- 172.21.15.135:0/2594584114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0480c6ca0 con 0x55c2959a1dd0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c29598b8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009ff0 tx=0x7fa03c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971f81a8ce775c69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa0277fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa0277fe700 1 -- 172.21.15.135:0/2594584114 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c038630 con 0x55c2959a1dd0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa0277fe700 1 -- 172.21.15.135:0/2594584114 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa03c038790 con 0x55c2959a1dd0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.583+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c29580b220 con 0x55c2959a1dd0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa0277fe700 1 -- 172.21.15.135:0/2594584114 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa03c038950 con 0x55c2959a1dd0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 10 client.4854 fetch_fsmap learned FSMap version 10 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x55c2956dfb10 con 0x55c2959a1dd0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa0277fe700 1 -- 172.21.15.135:0/2594584114 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c29580b220 con 0x55c2959a1dd0 2024-05-08T20:55:35.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa0277fe700 1 -- 172.21.15.135:0/2594584114 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fa03c038ab0 con 0x55c2959a1dd0 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 10 client.4854 fetch_fsmap finished waiting for FSMap version 10 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 10 client.4854 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 20 client.4854 populate_metadata read hostname 'smithi135' 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c295960e60 0x55c295961240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 4 client.4854 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 --> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c295931790 con 0x55c295960e60 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa047fff700 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c295960e60 0x55c295961240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa0277fe700 10 client.4854 ms_handle_connect on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.584+0000 7fa047fff700 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c295960e60 0x55c295961240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f0a64aeaaa80d6 server_cookie=c697732fe7bc3812 in_seq=0 out_seq=0 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa0277fe700 1 -- 172.21.15.135:0/2594584114 <== mds.0 v2:172.21.15.183:6834/2419873080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c295931790 con 0x55c295960e60 2024-05-08T20:55:35.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa0277fe700 10 client.4854 handle_command_reply: tid=0 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 client.4854 shutdown 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 msgr2=0x55c29598b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c29598b8f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009ff0 tx=0x7fa03c0047c0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 shutdown_connections 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c295960e60 0x55c295961240 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c295962c80 0x55c2959a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c29598b8f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa0277fe700 0 client.4854 ms_handle_reset on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2594584114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c2959b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 >> 172.21.15.135:0/2594584114 conn(0x55c2958c01c0 msgr2=0x55c295960290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:35.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 shutdown_connections 2024-05-08T20:55:35.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.585+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2594584114 wait complete. 2024-05-08T20:55:35.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.586+0000 7fa05b0b8b80 20 client.4854 trim_cache size 0 max 16384 2024-05-08T20:55:35.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.603+0000 7fa05b0b8b80 1 Processor -- start 2024-05-08T20:55:35.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.604+0000 7fa05b0b8b80 1 -- start start 2024-05-08T20:55:35.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.604+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a1dd0 0x55c2959c5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.604+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a21b0 0x55c2959a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.604+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c29595f2b0 0x55c2959a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.604+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29599df00 con 0x55c2959a21b0 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.604+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29595f730 con 0x55c2959a1dd0 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.604+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2959b6540 con 0x55c29595f2b0 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a21b0 0x55c2959a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a21b0 0x55c2959a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42206/0 (socket says 172.21.15.135:42206) 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 -- 172.21.15.135:0/186841794 learned_addr learned my addr 172.21.15.135:0/186841794 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa04d49b700 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c29595f2b0 0x55c2959a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a1dd0 0x55c2959c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 -- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c29595f2b0 msgr2=0x55c2959a6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c29595f2b0 0x55c2959a6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 -- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a1dd0 msgr2=0x55c2959c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a1dd0 0x55c2959c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 -- 172.21.15.135:0/186841794 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c295878510 con 0x55c2959a21b0 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa04d49b700 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c29595f2b0 0x55c2959a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a1dd0 0x55c2959c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa047fff700 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a21b0 0x55c2959a6a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0481512d0 tx=0x7fa034008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73afe4f8f30559e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa032ffd700 1 -- 172.21.15.135:0/186841794 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03401c040 con 0x55c2959a21b0 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa032ffd700 1 -- 172.21.15.135:0/186841794 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa034022070 con 0x55c2959a21b0 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.605+0000 7fa032ffd700 1 -- 172.21.15.135:0/186841794 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034004030 con 0x55c2959a21b0 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/186841794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a21b0 msgr2=0x55c2959a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a21b0 0x55c2959a6a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0481512d0 tx=0x7fa034008040 comp rx=0 tx=0).stop 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/186841794 shutdown_connections 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c2959a1dd0 0x55c2959c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c29595f2b0 0x55c2959a6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/186841794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a21b0 0x55c2959a6a30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/186841794 >> 172.21.15.135:0/186841794 conn(0x55c2958c01c0 msgr2=0x55c295963db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/186841794 shutdown_connections 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/186841794 wait complete. 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 -- start start 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.606+0000 7fa05b0b8b80 1 Processor -- start 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c29595f2b0 0x55c29598a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c295a10110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa05b0b8b80 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c295a06800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29599fe10 con 0x55c2959a1dd0 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29598a7c0 con 0x55c29595f2b0 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa05b0b8b80 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c295a10b20 con 0x55c2959a21b0 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa05b0b8b80 10 client.0 _ll_register_callbacks cb 0x55c295857ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c295a10110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c295a10110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42216/0 (socket says 172.21.15.135:42216) 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 -- 172.21.15.135:0/2697954565 learned_addr learned my addr 172.21.15.135:0/2697954565 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c29595f2b0 0x55c29598a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa04d49b700 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c295a06800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 -- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 msgr2=0x55c295a06800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c295a06800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 -- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c29595f2b0 msgr2=0x55c29598a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c29595f2b0 0x55c29598a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.607+0000 7fa047fff700 1 -- 172.21.15.135:0/2697954565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03400e040 con 0x55c2959a1dd0 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa047fff700 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c295a10110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa034021000 tx=0x7fa034019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5814b8979074433d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa0277fe700 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa0277fe700 1 -- 172.21.15.135:0/2697954565 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034004030 con 0x55c2959a1dd0 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa0277fe700 1 -- 172.21.15.135:0/2697954565 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa034004190 con 0x55c2959a1dd0 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c29599e600 con 0x55c2959a1dd0 2024-05-08T20:55:35.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa0277fe700 1 -- 172.21.15.135:0/2697954565 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa034004370 con 0x55c2959a1dd0 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 10 client.4860 fetch_fsmap learned FSMap version 10 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x55c295737c80 con 0x55c2959a1dd0 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa0277fe700 1 -- 172.21.15.135:0/2697954565 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c29599e600 con 0x55c2959a1dd0 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa0277fe700 1 -- 172.21.15.135:0/2697954565 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 10) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fa034031070 con 0x55c2959a1dd0 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 10 client.4860 fetch_fsmap finished waiting for FSMap version 10 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 10 client.4860 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 20 client.4860 populate_metadata read hostname 'smithi135' 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c2959a2590 0x55c2959a2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 4 client.4860 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 --> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fa03c0278c0 con 0x55c2959a2590 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.608+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c2959a2590 0x55c2959a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa0277fe700 10 client.4860 ms_handle_connect on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa04cc9a700 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c2959a2590 0x55c2959a2970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65b7ceee76078d06 server_cookie=191153a71cd14049 in_seq=0 out_seq=0 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa0277fe700 1 -- 172.21.15.135:0/2697954565 <== mds.0 v2:172.21.15.183:6834/2419873080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7fa03c0278c0 con 0x55c2959a2590 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa0277fe700 10 client.4860 handle_command_reply: tid=0 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 client.4860 shutdown 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 msgr2=0x55c295a10110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c295a10110 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa034021000 tx=0x7fa034019040 comp rx=0 tx=0).stop 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 shutdown_connections 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:6834/2419873080,v1:172.21.15.183:6837/2419873080] conn(0x55c2959a2590 0x55c2959a2970 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c29595f2b0 0x55c29598a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c2959a21b0 0x55c295a06800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa0277fe700 0 client.4860 ms_handle_reset on v2:172.21.15.183:6834/2419873080 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 --2- 172.21.15.135:0/2697954565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2959a1dd0 0x55c295a10110 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 >> 172.21.15.135:0/2697954565 conn(0x55c2958c01c0 msgr2=0x55c2959a6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 shutdown_connections 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 1 -- 172.21.15.135:0/2697954565 wait complete. 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.609+0000 7fa05b0b8b80 20 client.4860 trim_cache size 0 max 16384 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T20:55:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "2800f999-7ad2-4fbf-96c4-2e5fd73f8089", 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4299, 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 35.542378266999997, 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 10, 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 25, 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 25, 2024-05-08T20:55:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 42.466462997000001 2024-05-08T20:55:35.624 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T20:55:35.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa02c06ac90 msgr2=0x7fa02c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa02c06ac90 0x7fa02c06d150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa03c014040 tx=0x7fa03c008030 comp rx=0 tx=0).stop 2024-05-08T20:55:35.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 msgr2=0x7fa048154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa048154b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa040007e60 tx=0x7fa04000e3c0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 shutdown_connections 2024-05-08T20:55:35.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa02c06ac90 0x7fa02c06d150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0480c4ff0 0x7fa048156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04814dcc0 0x7fa048154b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 --2- 172.21.15.135:0/1131283579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0480cb830 0x7fa04814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 >> 172.21.15.135:0/1131283579 conn(0x7fa04806daf0 msgr2=0x7fa0480cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:35.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 shutdown_connections 2024-05-08T20:55:35.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.610+0000 7fa04eefe700 1 -- 172.21.15.135:0/1131283579 wait complete. 2024-05-08T20:55:35.627 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T20:55:35.637 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T20:55:35.637 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T20:55:35.637 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T20:55:35.637 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-08T20:55:35.648 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-08T20:55:35.648 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-08T20:55:35.649 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-08T20:55:35.649 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:55:35.649 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:35.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:35.649 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-08T20:55:35.667 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-08T20:55:35.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:35.667 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T20:55:35.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:35.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-08T20:55:35.850 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-08T20:55:35.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:55:35.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.970+0000 7fa8d5a5d700 1 Processor -- start 2024-05-08T20:55:35.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.970+0000 7fa8d5a5d700 1 -- start start 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8d5a5d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d00c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8d5a5d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa8d00c1830 0x7fa8d0070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8d5a5d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa8d0155870 0x7fa8d014f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8d5a5d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00c7130 con 0x7fa8d0155870 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8d5a5d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00c6b70 con 0x7fa8d00c1830 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8d5a5d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00c6e50 con 0x7fa8d00c1450 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa8d0155870 0x7fa8d014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa8d0155870 0x7fa8d014f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42226/0 (socket says 172.21.15.135:42226) 2024-05-08T20:55:35.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/3105948898 learned_addr learned my addr 172.21.15.135:0/3105948898 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8ce7fc700 1 --2- 172.21.15.135:0/3105948898 >> v2:172.21.15.183:3300/0 conn(0x7fa8d00c1830 0x7fa8d0070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8ceffd700 1 --2- 172.21.15.135:0/3105948898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d00c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/3105948898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 msgr2=0x7fa8d00c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 --2- 172.21.15.135:0/3105948898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d00c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/3105948898 >> v2:172.21.15.183:3300/0 conn(0x7fa8d00c1830 msgr2=0x7fa8d0070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 --2- 172.21.15.135:0/3105948898 >> v2:172.21.15.183:3300/0 conn(0x7fa8d00c1830 0x7fa8d0070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/3105948898 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00c3a10 con 0x7fa8d0155870 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.971+0000 7fa8cf7fe700 1 --2- 172.21.15.135:0/3105948898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d014f610 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006b710 tx=0x7fa8c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3de54592371a899 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8cdffb700 1 -- 172.21.15.135:0/3105948898 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800e070 con 0x7fa8d0155870 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8cdffb700 1 -- 172.21.15.135:0/3105948898 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800b910 con 0x7fa8d0155870 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8cdffb700 1 -- 172.21.15.135:0/3105948898 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800bcc0 con 0x7fa8d0155870 2024-05-08T20:55:35.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/3105948898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 msgr2=0x7fa8d014f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/3105948898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d014f610 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006b710 tx=0x7fa8c800b330 comp rx=0 tx=0).stop 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/3105948898 shutdown_connections 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/3105948898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d014f610 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/3105948898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d00c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/3105948898 >> v2:172.21.15.183:3300/0 conn(0x7fa8d00c1830 0x7fa8d0070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/3105948898 >> 172.21.15.135:0/3105948898 conn(0x7fa8d006a960 msgr2=0x7fa8d006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/3105948898 shutdown_connections 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.972+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/3105948898 wait complete. 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.973+0000 7fa8d5a5d700 1 Processor -- start 2024-05-08T20:55:35.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.973+0000 7fa8d5a5d700 1 -- start start 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8d5a5d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d013eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8d5a5d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d00c1830 0x7fa8d01f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8d5a5d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d0144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8d5a5d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01f0a90 con 0x7fa8d0155870 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8d5a5d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006f490 con 0x7fa8d00c1830 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8d5a5d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01ec6e0 con 0x7fa8d00c1450 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8cf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d0144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8cf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d0144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42242/0 (socket says 172.21.15.135:42242) 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/464122512 learned_addr learned my addr 172.21.15.135:0/464122512 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8ce7fc700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d00c1830 0x7fa8d01f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.974+0000 7fa8ceffd700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d013eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 msgr2=0x7fa8d013eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8cf7fe700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d013eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d00c1830 msgr2=0x7fa8d01f0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8cf7fe700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d00c1830 0x7fa8d01f0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8cf7fe700 1 -- 172.21.15.135:0/464122512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009b30 con 0x7fa8d0155870 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8cf7fe700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d0144950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00c7f50 tx=0x7fa8c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8b7fff700 1 -- 172.21.15.135:0/464122512 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80092e0 con 0x7fa8d0155870 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8b7fff700 1 -- 172.21.15.135:0/464122512 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800ce80 con 0x7fa8d0155870 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d01ed500 con 0x7fa8d0155870 2024-05-08T20:55:35.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8b7fff700 1 -- 172.21.15.135:0/464122512 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80044b0 con 0x7fa8d0155870 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.975+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d01ecc60 con 0x7fa8d0155870 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.976+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d0067890 con 0x7fa8d0155870 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.976+0000 7fa8b7fff700 1 -- 172.21.15.135:0/464122512 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa8c8004610 con 0x7fa8d0155870 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.977+0000 7fa8b7fff700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa8bc06acc0 0x7fa8bc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.977+0000 7fa8b7fff700 1 -- 172.21.15.135:0/464122512 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8c808a680 con 0x7fa8d0155870 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.977+0000 7fa8ceffd700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa8bc06acc0 0x7fa8bc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.977+0000 7fa8ceffd700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa8bc06acc0 0x7fa8bc06d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009b60 tx=0x7fa8c0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:55:35.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:35.981+0000 7fa8b7fff700 1 -- 172.21.15.135:0/464122512 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa8c8055620 con 0x7fa8d0155870 2024-05-08T20:55:36.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.231+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa8d0156470 con 0x7fa8d0155870 2024-05-08T20:55:36.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.231+0000 7fa8b7fff700 1 -- 172.21.15.135:0/464122512 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa8c8058c40 con 0x7fa8d0155870 2024-05-08T20:55:36.234 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T20:55:36.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa8bc06acc0 msgr2=0x7fa8bc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:36.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa8bc06acc0 0x7fa8bc06d180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009b60 tx=0x7fa8c0009210 comp rx=0 tx=0).stop 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 msgr2=0x7fa8d0144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d0144950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00c7f50 tx=0x7fa8c8004ad0 comp rx=0 tx=0).stop 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 shutdown_connections 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa8bc06acc0 0x7fa8bc06d180 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8d0155870 0x7fa8d0144950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8d00c1450 0x7fa8d013eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 --2- 172.21.15.135:0/464122512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8d00c1830 0x7fa8d01f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.233+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 >> 172.21.15.135:0/464122512 conn(0x7fa8d006a960 msgr2=0x7fa8d006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.234+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 shutdown_connections 2024-05-08T20:55:36.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T20:55:36.234+0000 7fa8d5a5d700 1 -- 172.21.15.135:0/464122512 wait complete. 2024-05-08T20:55:36.248 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:55:36.249 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:55:36.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.249 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:55:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42267sec preferred_lft 42267sec 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::7646:fe7f:32d6:e733/64 scope link noprefixroute 2024-05-08T20:55:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:55:36.269 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T20:55:36.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.269 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:36.269 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:36.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-05-08T20:55:36.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-05-08T20:55:36.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-05-08T20:55:36.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T20:55:36.270 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:36.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.386 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:55:36.411 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-05-08T20:55:36.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.413 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-05-08T20:55:36.472 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-05-08T20:55:36.473 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:55:36.473 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:55:36.473 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T20:55:36.473 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:55:36.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.473 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:36.473 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:36.473 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:55:36.473 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:55:36.474 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:55:36.474 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:36.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.579 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-08T20:55:36.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.596 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-05-08T20:55:36.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.653 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:36.653 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:36.653 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T20:55:36.653 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T20:55:36.653 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:36.747 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T20:55:36.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.747 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:36.748 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:36.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T20:55:36.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T20:55:36.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T20:55:36.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T20:55:36.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T20:55:36.748 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:36.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:36.952 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec bash -c ' 2024-05-08T20:55:36.952 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-05-08T20:55:36.953 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-05-08T20:55:36.953 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T20:55:36.953 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-05-08T20:55:37.050 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-08T20:55:37.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:55:37.051 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:37.067 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:55:37.068 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:55:37.068 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:37.123 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-08T20:55:37.191 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:55:37.191 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:55:37.258 INFO:teuthology.orchestra.run.smithi135.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:55:37.259 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:55:37.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:37.260 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-08T20:55:37.316 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T20:55:37.317 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-08T20:55:37.359 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-05-08T20:55:37.385 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:55:37.385 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:55:37.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:2024-05-08T20:55:37.444+0000 7f64c75705c0 -1 init, newargv = 0x55700c489cf0 newargc=15 2024-05-08T20:55:37.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:ceph-fuse[59034]: starting ceph client 2024-05-08T20:55:37.452 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:ceph-fuse[59034]: starting fuse 2024-05-08T20:55:37.454 INFO:teuthology.orchestra.run.smithi135.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:55:37.455 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:55:37.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:37.456 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-05-08T20:55:37.513 INFO:teuthology.orchestra.run.smithi135.stdout:47 2024-05-08T20:55:37.513 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-05-08T20:55:37.513 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> import re 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> import os 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2024-05-08T20:55:37.514 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> return f 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.0")) 2024-05-08T20:55:37.515 DEBUG:teuthology.orchestra.run.smithi135:> ' 2024-05-08T20:55:37.637 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.0.59034.asok 2024-05-08T20:55:37.821 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59034.asok 2024-05-08T20:55:37.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:37.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59034.asok status 2024-05-08T20:55:37.984 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T20:55:37.984 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2024-05-08T20:55:37.984 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:55:37.984 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:55:37.984 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "0", 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "59034", 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 4872, 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2024-05-08T20:55:37.985 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 4872 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 3328484861 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-05-08T20:55:37.986 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 3328484861 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.4872 192.168.0.1:0/3328484861", 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/3328484861", 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 10, 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 25, 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2024-05-08T20:55:37.987 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2024-05-08T20:55:37.988 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T20:55:37.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:37.994 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2024-05-08T20:55:37.994 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:38.013 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2024-05-08T20:55:38.013 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:38.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:55:38.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:38.083 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T20:55:38.102 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:55:38.102 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T20:55:38.102 INFO:tasks.workunit:timeout=3h 2024-05-08T20:55:38.103 INFO:tasks.workunit:cleanup=True 2024-05-08T20:55:38.103 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:38.141 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:38.141 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-08T20:55:38.141 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 2fh/47d Inode: 1 Links: 2 2024-05-08T20:55:38.142 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:38.142 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-08T20:55:38.142 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T20:55:38.142 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-05-08 20:55:00.069120210 +0000 2024-05-08T20:55:38.142 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-05-08 20:55:09.649733217 +0000 2024-05-08T20:55:38.142 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2024-05-08T20:55:38.142 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T20:55:38.142 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T20:55:38.214 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:55:38.271 INFO:tasks.workunit.client.0.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T20:55:58.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:58.802 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:28.889 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:28.891 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:58.972 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:58.975 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr: git switch -c 2024-05-08T20:57:01.512 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T20:57:01.513 INFO:tasks.workunit.client.0.smithi135.stderr:Or undo this operation with: 2024-05-08T20:57:01.513 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T20:57:01.513 INFO:tasks.workunit.client.0.smithi135.stderr: git switch - 2024-05-08T20:57:01.513 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T20:57:01.513 INFO:tasks.workunit.client.0.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T20:57:01.513 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-05-08T20:57:01.513 INFO:tasks.workunit.client.0.smithi135.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:57:01.518 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T20:57:01.547 INFO:tasks.workunit.client.0.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T20:57:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:57:01.549 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T20:57:02.026 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T20:57:02.081 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T20:57:02.118 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:57:02.120 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:57:02.120 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T20:57:02.156 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:57:02.159 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T20:57:02.159 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T20:57:02.217 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-05-08T20:57:02.218 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-05-08T20:57:02.218 DEBUG:teuthology.orchestra.run.smithi135:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-05-08T20:57:02.301 INFO:tasks.workunit.client.0.smithi135.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-08T20:57:02.301 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-08T20:57:02.301 INFO:tasks.workunit.client.0.smithi135.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-08T20:57:02.301 INFO:tasks.workunit.client.0.smithi135.stdout:0 of 1 processes prepared for launch 0 sec 2024-05-08T20:57:02.402 INFO:tasks.workunit.client.0.smithi135.stdout:1 of 1 processes prepared for launch 0 sec 2024-05-08T20:57:02.403 INFO:tasks.workunit.client.0.smithi135.stdout:releasing clients 2024-05-08T20:57:03.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 878 21.66 MB/sec warmup 1 sec latency 12.422 ms 2024-05-08T20:57:04.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 1617 13.08 MB/sec warmup 2 sec latency 13.701 ms 2024-05-08T20:57:05.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 2362 9.30 MB/sec warmup 3 sec latency 65.944 ms 2024-05-08T20:57:06.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3287 8.84 MB/sec warmup 4 sec latency 12.164 ms 2024-05-08T20:57:07.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 3836 7.95 MB/sec warmup 5 sec latency 12.514 ms 2024-05-08T20:57:08.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 4360 6.76 MB/sec warmup 6 sec latency 14.644 ms 2024-05-08T20:57:09.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5065 6.45 MB/sec warmup 7 sec latency 19.588 ms 2024-05-08T20:57:10.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 5863 5.86 MB/sec warmup 8 sec latency 19.324 ms 2024-05-08T20:57:11.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 6743 5.93 MB/sec warmup 9 sec latency 13.643 ms 2024-05-08T20:57:12.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 7312 5.89 MB/sec warmup 10 sec latency 13.503 ms 2024-05-08T20:57:13.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 7767 5.39 MB/sec warmup 11 sec latency 13.877 ms 2024-05-08T20:57:14.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 8494 5.35 MB/sec warmup 12 sec latency 12.513 ms 2024-05-08T20:57:15.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 9246 4.99 MB/sec warmup 13 sec latency 12.648 ms 2024-05-08T20:57:16.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 10076 5.12 MB/sec warmup 14 sec latency 14.436 ms 2024-05-08T20:57:17.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 10754 5.13 MB/sec warmup 15 sec latency 13.077 ms 2024-05-08T20:57:18.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 11244 4.90 MB/sec warmup 16 sec latency 17.727 ms 2024-05-08T20:57:19.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 11900 4.73 MB/sec warmup 17 sec latency 14.318 ms 2024-05-08T20:57:20.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 12708 4.67 MB/sec warmup 18 sec latency 14.870 ms 2024-05-08T20:57:21.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 13435 4.70 MB/sec warmup 19 sec latency 12.665 ms 2024-05-08T20:57:22.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 14186 4.79 MB/sec warmup 20 sec latency 15.255 ms 2024-05-08T20:57:23.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 14699 4.64 MB/sec warmup 21 sec latency 10.218 ms 2024-05-08T20:57:24.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 15370 4.52 MB/sec warmup 22 sec latency 12.261 ms 2024-05-08T20:57:25.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 16166 4.48 MB/sec warmup 23 sec latency 13.602 ms 2024-05-08T20:57:26.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 16816 4.40 MB/sec warmup 24 sec latency 25.298 ms 2024-05-08T20:57:27.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 17585 4.48 MB/sec warmup 25 sec latency 15.332 ms 2024-05-08T20:57:28.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 18217 4.48 MB/sec warmup 26 sec latency 15.754 ms 2024-05-08T20:57:29.068 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:29.071 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:29.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 18877 4.39 MB/sec warmup 27 sec latency 14.153 ms 2024-05-08T20:57:30.402 INFO:tasks.workunit.client.0.smithi135.stdout: 1 19633 4.36 MB/sec warmup 28 sec latency 13.710 ms 2024-05-08T20:57:31.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 20364 4.30 MB/sec warmup 29 sec latency 16.954 ms 2024-05-08T20:57:32.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 21143 4.37 MB/sec warmup 30 sec latency 17.228 ms 2024-05-08T20:57:33.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 21787 4.38 MB/sec warmup 31 sec latency 13.782 ms 2024-05-08T20:57:34.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 22417 4.30 MB/sec warmup 32 sec latency 13.126 ms 2024-05-08T20:57:35.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 23192 4.28 MB/sec warmup 33 sec latency 13.137 ms 2024-05-08T20:57:36.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 23900 4.23 MB/sec warmup 34 sec latency 25.591 ms 2024-05-08T20:57:37.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 24676 4.29 MB/sec warmup 35 sec latency 12.239 ms 2024-05-08T20:57:38.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 25336 4.30 MB/sec warmup 36 sec latency 10.269 ms 2024-05-08T20:57:39.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 25983 4.24 MB/sec warmup 37 sec latency 15.031 ms 2024-05-08T20:57:40.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 26753 4.22 MB/sec warmup 38 sec latency 14.771 ms 2024-05-08T20:57:41.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 27455 4.18 MB/sec warmup 39 sec latency 16.867 ms 2024-05-08T20:57:42.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 28243 4.23 MB/sec warmup 40 sec latency 13.091 ms 2024-05-08T20:57:43.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 28877 4.24 MB/sec warmup 41 sec latency 13.124 ms 2024-05-08T20:57:44.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 29499 4.19 MB/sec warmup 42 sec latency 16.875 ms 2024-05-08T20:57:45.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 30282 4.17 MB/sec warmup 43 sec latency 14.406 ms 2024-05-08T20:57:46.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 30988 4.14 MB/sec warmup 44 sec latency 26.672 ms 2024-05-08T20:57:47.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 31745 4.19 MB/sec warmup 45 sec latency 15.440 ms 2024-05-08T20:57:48.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 32372 4.20 MB/sec warmup 46 sec latency 16.734 ms 2024-05-08T20:57:49.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 32943 4.13 MB/sec warmup 47 sec latency 29.839 ms 2024-05-08T20:57:50.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 33730 4.13 MB/sec warmup 48 sec latency 24.030 ms 2024-05-08T20:57:51.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 34407 4.09 MB/sec warmup 49 sec latency 23.719 ms 2024-05-08T20:57:52.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 35280 4.15 MB/sec warmup 50 sec latency 15.614 ms 2024-05-08T20:57:53.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 35887 4.16 MB/sec warmup 51 sec latency 9.551 ms 2024-05-08T20:57:54.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 36455 4.10 MB/sec warmup 52 sec latency 14.523 ms 2024-05-08T20:57:55.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 37221 4.10 MB/sec warmup 53 sec latency 12.906 ms 2024-05-08T20:57:56.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 37975 4.07 MB/sec warmup 54 sec latency 18.471 ms 2024-05-08T20:57:57.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 38827 4.12 MB/sec warmup 55 sec latency 16.013 ms 2024-05-08T20:57:58.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 39434 4.13 MB/sec warmup 56 sec latency 11.405 ms 2024-05-08T20:57:59.136 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:59.139 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:59.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 40029 4.07 MB/sec warmup 57 sec latency 15.074 ms 2024-05-08T20:58:00.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 40832 4.08 MB/sec warmup 58 sec latency 15.942 ms 2024-05-08T20:58:01.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 41529 4.05 MB/sec warmup 59 sec latency 20.798 ms 2024-05-08T20:58:02.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 42371 4.10 MB/sec warmup 60 sec latency 15.790 ms 2024-05-08T20:58:03.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 42956 4.11 MB/sec warmup 61 sec latency 13.962 ms 2024-05-08T20:58:04.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 43510 4.05 MB/sec warmup 62 sec latency 43.429 ms 2024-05-08T20:58:05.403 INFO:tasks.workunit.client.0.smithi135.stdout: 1 44220 4.06 MB/sec warmup 63 sec latency 13.658 ms 2024-05-08T20:58:06.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 44987 4.02 MB/sec warmup 64 sec latency 23.088 ms 2024-05-08T20:58:07.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 45895 4.07 MB/sec warmup 65 sec latency 13.839 ms 2024-05-08T20:58:08.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 46458 4.08 MB/sec warmup 66 sec latency 13.626 ms 2024-05-08T20:58:09.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 47012 4.03 MB/sec warmup 67 sec latency 12.990 ms 2024-05-08T20:58:10.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 47763 4.04 MB/sec warmup 68 sec latency 12.407 ms 2024-05-08T20:58:11.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 48515 4.01 MB/sec warmup 69 sec latency 24.708 ms 2024-05-08T20:58:12.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 49433 4.06 MB/sec warmup 70 sec latency 12.596 ms 2024-05-08T20:58:13.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 49995 4.06 MB/sec warmup 71 sec latency 12.770 ms 2024-05-08T20:58:14.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 50515 4.02 MB/sec warmup 72 sec latency 41.028 ms 2024-05-08T20:58:15.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 51283 4.03 MB/sec warmup 73 sec latency 11.995 ms 2024-05-08T20:58:16.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 52050 4.00 MB/sec warmup 74 sec latency 27.837 ms 2024-05-08T20:58:17.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 52974 4.04 MB/sec warmup 75 sec latency 15.995 ms 2024-05-08T20:58:18.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 53526 4.05 MB/sec warmup 76 sec latency 13.023 ms 2024-05-08T20:58:19.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 54026 4.00 MB/sec warmup 77 sec latency 39.335 ms 2024-05-08T20:58:20.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 54752 4.01 MB/sec warmup 78 sec latency 12.657 ms 2024-05-08T20:58:21.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 55559 3.98 MB/sec warmup 79 sec latency 14.962 ms 2024-05-08T20:58:22.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 56514 4.03 MB/sec warmup 80 sec latency 12.870 ms 2024-05-08T20:58:23.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 57035 4.03 MB/sec warmup 81 sec latency 13.804 ms 2024-05-08T20:58:24.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 57538 3.99 MB/sec warmup 82 sec latency 18.337 ms 2024-05-08T20:58:25.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 58276 4.00 MB/sec warmup 83 sec latency 12.469 ms 2024-05-08T20:58:26.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 59084 3.97 MB/sec warmup 84 sec latency 28.529 ms 2024-05-08T20:58:27.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 59985 4.00 MB/sec warmup 85 sec latency 13.241 ms 2024-05-08T20:58:28.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 60568 4.02 MB/sec warmup 86 sec latency 13.471 ms 2024-05-08T20:58:29.194 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:29.197 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:29.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 61061 3.98 MB/sec warmup 87 sec latency 17.658 ms 2024-05-08T20:58:30.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 61821 3.99 MB/sec warmup 88 sec latency 17.184 ms 2024-05-08T20:58:31.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 62624 3.96 MB/sec warmup 89 sec latency 32.671 ms 2024-05-08T20:58:32.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 63535 3.99 MB/sec warmup 90 sec latency 11.532 ms 2024-05-08T20:58:33.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 64103 4.01 MB/sec warmup 91 sec latency 13.488 ms 2024-05-08T20:58:34.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 64602 3.97 MB/sec warmup 92 sec latency 16.908 ms 2024-05-08T20:58:35.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 65342 3.98 MB/sec warmup 93 sec latency 17.882 ms 2024-05-08T20:58:36.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 66164 3.96 MB/sec warmup 94 sec latency 32.357 ms 2024-05-08T20:58:37.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 67056 3.98 MB/sec warmup 95 sec latency 12.931 ms 2024-05-08T20:58:38.404 INFO:tasks.workunit.client.0.smithi135.stdout: 1 67662 4.00 MB/sec warmup 96 sec latency 14.856 ms 2024-05-08T20:58:39.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 68178 3.97 MB/sec warmup 97 sec latency 10.175 ms 2024-05-08T20:58:40.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 68924 3.97 MB/sec warmup 98 sec latency 14.418 ms 2024-05-08T20:58:41.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 69719 3.95 MB/sec warmup 99 sec latency 30.869 ms 2024-05-08T20:58:42.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 70626 3.98 MB/sec warmup 100 sec latency 14.396 ms 2024-05-08T20:58:43.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 71197 3.99 MB/sec warmup 101 sec latency 12.793 ms 2024-05-08T20:58:44.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 71712 3.96 MB/sec warmup 102 sec latency 16.217 ms 2024-05-08T20:58:45.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 72460 3.97 MB/sec warmup 103 sec latency 15.863 ms 2024-05-08T20:58:46.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 73296 3.95 MB/sec warmup 104 sec latency 19.253 ms 2024-05-08T20:58:47.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 74202 3.97 MB/sec warmup 105 sec latency 12.452 ms 2024-05-08T20:58:48.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 74791 3.98 MB/sec warmup 106 sec latency 10.709 ms 2024-05-08T20:58:49.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 75265 3.95 MB/sec warmup 107 sec latency 29.668 ms 2024-05-08T20:58:50.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 76015 3.96 MB/sec warmup 108 sec latency 11.872 ms 2024-05-08T20:58:51.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 76818 3.93 MB/sec warmup 109 sec latency 29.980 ms 2024-05-08T20:58:52.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 77731 3.96 MB/sec warmup 110 sec latency 16.714 ms 2024-05-08T20:58:53.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 78326 3.98 MB/sec warmup 111 sec latency 12.789 ms 2024-05-08T20:58:54.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 78809 3.95 MB/sec warmup 112 sec latency 26.029 ms 2024-05-08T20:58:55.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 79559 3.95 MB/sec warmup 113 sec latency 16.257 ms 2024-05-08T20:58:56.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 80318 3.93 MB/sec warmup 114 sec latency 39.982 ms 2024-05-08T20:58:57.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 81271 3.96 MB/sec warmup 115 sec latency 13.577 ms 2024-05-08T20:58:58.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 81865 3.97 MB/sec warmup 116 sec latency 12.317 ms 2024-05-08T20:58:59.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:59.267 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:59.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 82373 3.94 MB/sec warmup 117 sec latency 20.903 ms 2024-05-08T20:59:00.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 83121 3.95 MB/sec warmup 118 sec latency 15.995 ms 2024-05-08T20:59:01.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 83862 3.92 MB/sec warmup 119 sec latency 29.120 ms 2024-05-08T20:59:03.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 85411 5.51 MB/sec execute 1 sec latency 16.617 ms 2024-05-08T20:59:04.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 85871 3.02 MB/sec execute 2 sec latency 32.344 ms 2024-05-08T20:59:05.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 86644 3.63 MB/sec execute 3 sec latency 18.103 ms 2024-05-08T20:59:06.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 87399 2.91 MB/sec execute 4 sec latency 32.080 ms 2024-05-08T20:59:07.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 88342 3.80 MB/sec execute 5 sec latency 13.503 ms 2024-05-08T20:59:08.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 88950 4.11 MB/sec execute 6 sec latency 16.075 ms 2024-05-08T20:59:09.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 89391 3.58 MB/sec execute 7 sec latency 12.815 ms 2024-05-08T20:59:10.405 INFO:tasks.workunit.client.0.smithi135.stdout: 1 90115 3.75 MB/sec execute 8 sec latency 15.031 ms 2024-05-08T20:59:11.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 90869 3.41 MB/sec execute 9 sec latency 30.033 ms 2024-05-08T20:59:12.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 91716 3.75 MB/sec execute 10 sec latency 10.665 ms 2024-05-08T20:59:13.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 92407 3.89 MB/sec execute 11 sec latency 13.109 ms 2024-05-08T20:59:14.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 92921 3.68 MB/sec execute 12 sec latency 9.807 ms 2024-05-08T20:59:15.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 93657 3.78 MB/sec execute 13 sec latency 15.578 ms 2024-05-08T20:59:16.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 94411 3.56 MB/sec execute 14 sec latency 31.095 ms 2024-05-08T20:59:17.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 95245 3.77 MB/sec execute 15 sec latency 12.623 ms 2024-05-08T20:59:18.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 95953 3.87 MB/sec execute 16 sec latency 12.827 ms 2024-05-08T20:59:19.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 96478 3.72 MB/sec execute 17 sec latency 12.390 ms 2024-05-08T20:59:20.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 97233 3.79 MB/sec execute 18 sec latency 12.639 ms 2024-05-08T20:59:21.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 97959 3.63 MB/sec execute 19 sec latency 40.732 ms 2024-05-08T20:59:22.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 98804 3.79 MB/sec execute 20 sec latency 12.719 ms 2024-05-08T20:59:23.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 99501 3.86 MB/sec execute 21 sec latency 12.682 ms 2024-05-08T20:59:24.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 100019 3.75 MB/sec execute 22 sec latency 10.692 ms 2024-05-08T20:59:25.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 100765 3.80 MB/sec execute 23 sec latency 14.744 ms 2024-05-08T20:59:26.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 101534 3.67 MB/sec execute 24 sec latency 12.750 ms 2024-05-08T20:59:27.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 102372 3.80 MB/sec execute 25 sec latency 13.141 ms 2024-05-08T20:59:28.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 103084 3.86 MB/sec execute 26 sec latency 13.024 ms 2024-05-08T20:59:29.346 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:59:29.349 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:59:29.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 103566 3.76 MB/sec execute 27 sec latency 12.434 ms 2024-05-08T20:59:30.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 104200 3.70 MB/sec execute 28 sec latency 63.020 ms 2024-05-08T20:59:31.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 104995 3.69 MB/sec execute 29 sec latency 23.389 ms 2024-05-08T20:59:32.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 105845 3.80 MB/sec execute 30 sec latency 12.523 ms 2024-05-08T20:59:33.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 106560 3.85 MB/sec execute 31 sec latency 16.572 ms 2024-05-08T20:59:34.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 107063 3.77 MB/sec execute 32 sec latency 10.135 ms 2024-05-08T20:59:35.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 107741 3.72 MB/sec execute 33 sec latency 26.248 ms 2024-05-08T20:59:36.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 108546 3.71 MB/sec execute 34 sec latency 37.318 ms 2024-05-08T20:59:37.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 109393 3.80 MB/sec execute 35 sec latency 13.138 ms 2024-05-08T20:59:38.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 110115 3.84 MB/sec execute 36 sec latency 13.320 ms 2024-05-08T20:59:39.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 110617 3.78 MB/sec execute 37 sec latency 27.534 ms 2024-05-08T20:59:40.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 111232 3.73 MB/sec execute 38 sec latency 106.499 ms 2024-05-08T20:59:41.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 112054 3.73 MB/sec execute 39 sec latency 12.821 ms 2024-05-08T20:59:42.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 112759 3.77 MB/sec execute 40 sec latency 68.248 ms 2024-05-08T20:59:43.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 113542 3.83 MB/sec execute 41 sec latency 14.291 ms 2024-05-08T20:59:44.406 INFO:tasks.workunit.client.0.smithi135.stdout: 1 114075 3.78 MB/sec execute 42 sec latency 14.566 ms 2024-05-08T20:59:45.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 114730 3.74 MB/sec execute 43 sec latency 15.871 ms 2024-05-08T20:59:46.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 115521 3.73 MB/sec execute 44 sec latency 28.844 ms 2024-05-08T20:59:47.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 116160 3.71 MB/sec execute 45 sec latency 45.139 ms 2024-05-08T20:59:48.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 117033 3.83 MB/sec execute 46 sec latency 15.285 ms 2024-05-08T20:59:49.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 117586 3.79 MB/sec execute 47 sec latency 17.128 ms 2024-05-08T20:59:50.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 118266 3.75 MB/sec execute 48 sec latency 13.972 ms 2024-05-08T20:59:51.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 119068 3.74 MB/sec execute 49 sec latency 35.773 ms 2024-05-08T20:59:52.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 119842 3.78 MB/sec execute 50 sec latency 16.537 ms 2024-05-08T20:59:53.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 120602 3.83 MB/sec execute 51 sec latency 15.864 ms 2024-05-08T20:59:54.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 121139 3.79 MB/sec execute 52 sec latency 12.530 ms 2024-05-08T20:59:55.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 121808 3.76 MB/sec execute 53 sec latency 24.290 ms 2024-05-08T20:59:56.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 122612 3.75 MB/sec execute 54 sec latency 12.272 ms 2024-05-08T20:59:57.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 123250 3.73 MB/sec execute 55 sec latency 14.115 ms 2024-05-08T20:59:58.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 124026 3.78 MB/sec execute 56 sec latency 12.441 ms 2024-05-08T20:59:59.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 124668 3.79 MB/sec execute 57 sec latency 15.835 ms 2024-05-08T20:59:59.768 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:59:59.773 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:00.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 125349 3.76 MB/sec execute 58 sec latency 12.487 ms 2024-05-08T21:00:01.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 126110 3.76 MB/sec execute 59 sec latency 15.544 ms 2024-05-08T21:00:02.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 126807 3.74 MB/sec execute 60 sec latency 18.084 ms 2024-05-08T21:00:03.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 127689 3.83 MB/sec execute 61 sec latency 15.201 ms 2024-05-08T21:00:04.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 128209 3.79 MB/sec execute 62 sec latency 16.703 ms 2024-05-08T21:00:05.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 128895 3.77 MB/sec execute 63 sec latency 12.058 ms 2024-05-08T21:00:06.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 129626 3.76 MB/sec execute 64 sec latency 20.944 ms 2024-05-08T21:00:07.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 130345 3.74 MB/sec execute 65 sec latency 19.275 ms 2024-05-08T21:00:08.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 131120 3.79 MB/sec execute 66 sec latency 18.538 ms 2024-05-08T21:00:09.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 131749 3.80 MB/sec execute 67 sec latency 16.517 ms 2024-05-08T21:00:10.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 132371 3.77 MB/sec execute 68 sec latency 51.251 ms 2024-05-08T21:00:11.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 133116 3.77 MB/sec execute 69 sec latency 16.670 ms 2024-05-08T21:00:12.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 133837 3.75 MB/sec execute 70 sec latency 15.076 ms 2024-05-08T21:00:13.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 134624 3.79 MB/sec execute 71 sec latency 15.756 ms 2024-05-08T21:00:14.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 135229 3.80 MB/sec execute 72 sec latency 64.855 ms 2024-05-08T21:00:15.407 INFO:tasks.workunit.client.0.smithi135.stdout: 1 135824 3.76 MB/sec execute 73 sec latency 12.867 ms 2024-05-08T21:00:16.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 136607 3.77 MB/sec execute 74 sec latency 22.530 ms 2024-05-08T21:00:17.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 137314 3.75 MB/sec execute 75 sec latency 23.789 ms 2024-05-08T21:00:18.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 138140 3.79 MB/sec execute 76 sec latency 29.190 ms 2024-05-08T21:00:19.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 138753 3.80 MB/sec execute 77 sec latency 12.352 ms 2024-05-08T21:00:20.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 139314 3.76 MB/sec execute 78 sec latency 42.613 ms 2024-05-08T21:00:21.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 140062 3.77 MB/sec execute 79 sec latency 13.166 ms 2024-05-08T21:00:22.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 140810 3.75 MB/sec execute 80 sec latency 16.021 ms 2024-05-08T21:00:23.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 141682 3.79 MB/sec execute 81 sec latency 23.240 ms 2024-05-08T21:00:24.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 142285 3.80 MB/sec execute 82 sec latency 16.248 ms 2024-05-08T21:00:25.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 142825 3.77 MB/sec execute 83 sec latency 62.101 ms 2024-05-08T21:00:26.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 143561 3.77 MB/sec execute 84 sec latency 17.731 ms 2024-05-08T21:00:27.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 144343 3.75 MB/sec execute 85 sec latency 25.400 ms 2024-05-08T21:00:28.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 145216 3.79 MB/sec execute 86 sec latency 27.347 ms 2024-05-08T21:00:29.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 145796 3.80 MB/sec execute 87 sec latency 15.212 ms 2024-05-08T21:00:29.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:29.842 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:30.408 INFO:tasks.workunit.client.0.smithi135.stdout: 1 146374 3.77 MB/sec execute 88 sec latency 18.406 ms 2024-05-08T21:00:31.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 147109 3.78 MB/sec execute 89 sec latency 12.517 ms 2024-05-08T21:00:32.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 147872 3.76 MB/sec execute 90 sec latency 24.737 ms 2024-05-08T21:00:33.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 148764 3.79 MB/sec execute 91 sec latency 31.681 ms 2024-05-08T21:00:34.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 149359 3.80 MB/sec execute 92 sec latency 16.379 ms 2024-05-08T21:00:35.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 149941 3.77 MB/sec execute 93 sec latency 16.440 ms 2024-05-08T21:00:36.409 INFO:tasks.workunit.client.0.smithi135.stdout: 1 150692 3.78 MB/sec execute 94 sec latency 12.918 ms 2024-05-08T21:00:37.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 151433 3.76 MB/sec execute 95 sec latency 19.355 ms 2024-05-08T21:00:38.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 152312 3.80 MB/sec execute 96 sec latency 33.133 ms 2024-05-08T21:00:39.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 152906 3.81 MB/sec execute 97 sec latency 16.091 ms 2024-05-08T21:00:40.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 153489 3.78 MB/sec execute 98 sec latency 10.696 ms 2024-05-08T21:00:41.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 154243 3.78 MB/sec execute 99 sec latency 12.598 ms 2024-05-08T21:00:42.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 154967 3.76 MB/sec execute 100 sec latency 14.645 ms 2024-05-08T21:00:43.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 155852 3.80 MB/sec execute 101 sec latency 26.468 ms 2024-05-08T21:00:44.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 156431 3.81 MB/sec execute 102 sec latency 16.970 ms 2024-05-08T21:00:45.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 157003 3.78 MB/sec execute 103 sec latency 19.327 ms 2024-05-08T21:00:46.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 157740 3.78 MB/sec execute 104 sec latency 13.951 ms 2024-05-08T21:00:47.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 158511 3.77 MB/sec execute 105 sec latency 24.474 ms 2024-05-08T21:00:48.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 159400 3.80 MB/sec execute 106 sec latency 15.812 ms 2024-05-08T21:00:49.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 159981 3.81 MB/sec execute 107 sec latency 17.248 ms 2024-05-08T21:00:50.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 160575 3.78 MB/sec execute 108 sec latency 17.984 ms 2024-05-08T21:00:51.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 161288 3.79 MB/sec execute 109 sec latency 15.393 ms 2024-05-08T21:00:52.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 162051 3.77 MB/sec execute 110 sec latency 20.511 ms 2024-05-08T21:00:53.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 162949 3.80 MB/sec execute 111 sec latency 24.020 ms 2024-05-08T21:00:54.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 163528 3.81 MB/sec execute 112 sec latency 16.406 ms 2024-05-08T21:00:55.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 164050 3.78 MB/sec execute 113 sec latency 43.128 ms 2024-05-08T21:00:56.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 164806 3.79 MB/sec execute 114 sec latency 12.740 ms 2024-05-08T21:00:57.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 165550 3.77 MB/sec execute 115 sec latency 58.154 ms 2024-05-08T21:00:58.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 166469 3.80 MB/sec execute 116 sec latency 14.011 ms 2024-05-08T21:00:59.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 167023 3.81 MB/sec execute 117 sec latency 17.957 ms 2024-05-08T21:00:59.907 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:59.910 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:01:00.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 167561 3.78 MB/sec execute 118 sec latency 12.258 ms 2024-05-08T21:01:01.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 168293 3.79 MB/sec execute 119 sec latency 15.600 ms 2024-05-08T21:01:02.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 169098 3.77 MB/sec execute 120 sec latency 21.863 ms 2024-05-08T21:01:03.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 170021 3.80 MB/sec execute 121 sec latency 16.376 ms 2024-05-08T21:01:04.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 170585 3.81 MB/sec execute 122 sec latency 16.030 ms 2024-05-08T21:01:05.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 171137 3.78 MB/sec execute 123 sec latency 11.134 ms 2024-05-08T21:01:06.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 171882 3.79 MB/sec execute 124 sec latency 12.351 ms 2024-05-08T21:01:07.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 172637 3.77 MB/sec execute 125 sec latency 12.666 ms 2024-05-08T21:01:08.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 173557 3.80 MB/sec execute 126 sec latency 29.547 ms 2024-05-08T21:01:09.410 INFO:tasks.workunit.client.0.smithi135.stdout: 1 174086 3.81 MB/sec execute 127 sec latency 17.028 ms 2024-05-08T21:01:10.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 174544 3.78 MB/sec execute 128 sec latency 12.948 ms 2024-05-08T21:01:11.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 175310 3.79 MB/sec execute 129 sec latency 15.588 ms 2024-05-08T21:01:12.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 176121 3.77 MB/sec execute 130 sec latency 17.645 ms 2024-05-08T21:01:13.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 177031 3.80 MB/sec execute 131 sec latency 26.834 ms 2024-05-08T21:01:14.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 177604 3.81 MB/sec execute 132 sec latency 18.532 ms 2024-05-08T21:01:15.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 178103 3.78 MB/sec execute 133 sec latency 11.536 ms 2024-05-08T21:01:16.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 178849 3.79 MB/sec execute 134 sec latency 11.788 ms 2024-05-08T21:01:17.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 179592 3.77 MB/sec execute 135 sec latency 15.823 ms 2024-05-08T21:01:18.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 180393 3.79 MB/sec execute 136 sec latency 31.687 ms 2024-05-08T21:01:19.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 181125 3.81 MB/sec execute 137 sec latency 14.341 ms 2024-05-08T21:01:20.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 181594 3.78 MB/sec execute 138 sec latency 12.941 ms 2024-05-08T21:01:21.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 182303 3.79 MB/sec execute 139 sec latency 12.690 ms 2024-05-08T21:01:22.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 183060 3.77 MB/sec execute 140 sec latency 22.197 ms 2024-05-08T21:01:23.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 183884 3.79 MB/sec execute 141 sec latency 15.680 ms 2024-05-08T21:01:24.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 184573 3.80 MB/sec execute 142 sec latency 13.248 ms 2024-05-08T21:01:25.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 185069 3.78 MB/sec execute 143 sec latency 12.433 ms 2024-05-08T21:01:26.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 185747 3.77 MB/sec execute 144 sec latency 18.792 ms 2024-05-08T21:01:27.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 186554 3.77 MB/sec execute 145 sec latency 12.125 ms 2024-05-08T21:01:28.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 187391 3.79 MB/sec execute 146 sec latency 20.173 ms 2024-05-08T21:01:29.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 188090 3.80 MB/sec execute 147 sec latency 12.556 ms 2024-05-08T21:01:29.973 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:01:29.976 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:01:30.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 188481 3.79 MB/sec execute 148 sec latency 61.121 ms 2024-05-08T21:01:31.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 189102 3.77 MB/sec execute 149 sec latency 68.133 ms 2024-05-08T21:01:32.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 189870 3.77 MB/sec execute 150 sec latency 13.557 ms 2024-05-08T21:01:33.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 190586 3.76 MB/sec execute 151 sec latency 29.882 ms 2024-05-08T21:01:34.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 191335 3.78 MB/sec execute 152 sec latency 68.697 ms 2024-05-08T21:01:35.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 191968 3.79 MB/sec execute 153 sec latency 11.632 ms 2024-05-08T21:01:36.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 192583 3.78 MB/sec execute 154 sec latency 11.609 ms 2024-05-08T21:01:37.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 193355 3.77 MB/sec execute 155 sec latency 18.411 ms 2024-05-08T21:01:38.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 194045 3.76 MB/sec execute 156 sec latency 15.549 ms 2024-05-08T21:01:39.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 194878 3.78 MB/sec execute 157 sec latency 13.104 ms 2024-05-08T21:01:40.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 195508 3.79 MB/sec execute 158 sec latency 12.922 ms 2024-05-08T21:01:41.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 196133 3.78 MB/sec execute 159 sec latency 12.370 ms 2024-05-08T21:01:42.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 196922 3.77 MB/sec execute 160 sec latency 11.426 ms 2024-05-08T21:01:43.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 197601 3.77 MB/sec execute 161 sec latency 20.734 ms 2024-05-08T21:01:44.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 198418 3.78 MB/sec execute 162 sec latency 28.779 ms 2024-05-08T21:01:45.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 199025 3.79 MB/sec execute 163 sec latency 12.824 ms 2024-05-08T21:01:46.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 199600 3.77 MB/sec execute 164 sec latency 12.753 ms 2024-05-08T21:01:47.411 INFO:tasks.workunit.client.0.smithi135.stdout: 1 200346 3.78 MB/sec execute 165 sec latency 16.631 ms 2024-05-08T21:01:48.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 201064 3.76 MB/sec execute 166 sec latency 16.602 ms 2024-05-08T21:01:49.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 201949 3.79 MB/sec execute 167 sec latency 20.881 ms 2024-05-08T21:01:50.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 202554 3.79 MB/sec execute 168 sec latency 17.339 ms 2024-05-08T21:01:51.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 203127 3.77 MB/sec execute 169 sec latency 11.896 ms 2024-05-08T21:01:52.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 203878 3.78 MB/sec execute 170 sec latency 15.184 ms 2024-05-08T21:01:53.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 204620 3.77 MB/sec execute 171 sec latency 21.599 ms 2024-05-08T21:01:54.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 205496 3.79 MB/sec execute 172 sec latency 26.649 ms 2024-05-08T21:01:55.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 206087 3.79 MB/sec execute 173 sec latency 16.320 ms 2024-05-08T21:01:56.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 206620 3.77 MB/sec execute 174 sec latency 18.378 ms 2024-05-08T21:01:57.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 207376 3.78 MB/sec execute 175 sec latency 12.204 ms 2024-05-08T21:01:58.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 208121 3.77 MB/sec execute 176 sec latency 25.386 ms 2024-05-08T21:01:59.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 209020 3.79 MB/sec execute 177 sec latency 25.135 ms 2024-05-08T21:02:00.412 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:00.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 209588 3.79 MB/sec execute 178 sec latency 14.211 ms 2024-05-08T21:02:00.415 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:01.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 210107 3.77 MB/sec execute 179 sec latency 19.383 ms 2024-05-08T21:02:02.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 210839 3.78 MB/sec execute 180 sec latency 12.644 ms 2024-05-08T21:02:03.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 211642 3.77 MB/sec execute 181 sec latency 12.533 ms 2024-05-08T21:02:04.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 212563 3.79 MB/sec execute 182 sec latency 32.266 ms 2024-05-08T21:02:05.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 213111 3.79 MB/sec execute 183 sec latency 18.445 ms 2024-05-08T21:02:06.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 213645 3.78 MB/sec execute 184 sec latency 13.670 ms 2024-05-08T21:02:07.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 214388 3.78 MB/sec execute 185 sec latency 13.464 ms 2024-05-08T21:02:08.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 215210 3.77 MB/sec execute 186 sec latency 21.909 ms 2024-05-08T21:02:09.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 216149 3.79 MB/sec execute 187 sec latency 31.150 ms 2024-05-08T21:02:10.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 216671 3.79 MB/sec execute 188 sec latency 17.488 ms 2024-05-08T21:02:11.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 217107 3.78 MB/sec execute 189 sec latency 84.777 ms 2024-05-08T21:02:12.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 217870 3.78 MB/sec execute 190 sec latency 15.452 ms 2024-05-08T21:02:13.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 218598 3.77 MB/sec execute 191 sec latency 46.866 ms 2024-05-08T21:02:14.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 219414 3.78 MB/sec execute 192 sec latency 24.790 ms 2024-05-08T21:02:15.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 220166 3.79 MB/sec execute 193 sec latency 10.060 ms 2024-05-08T21:02:16.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 220632 3.78 MB/sec execute 194 sec latency 13.400 ms 2024-05-08T21:02:17.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 221375 3.78 MB/sec execute 195 sec latency 12.254 ms 2024-05-08T21:02:18.412 INFO:tasks.workunit.client.0.smithi135.stdout: 1 222142 3.77 MB/sec execute 196 sec latency 13.843 ms 2024-05-08T21:02:19.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 222939 3.78 MB/sec execute 197 sec latency 34.717 ms 2024-05-08T21:02:20.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 223618 3.79 MB/sec execute 198 sec latency 13.503 ms 2024-05-08T21:02:21.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 224122 3.78 MB/sec execute 199 sec latency 10.867 ms 2024-05-08T21:02:22.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 224785 3.77 MB/sec execute 200 sec latency 14.018 ms 2024-05-08T21:02:23.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 225574 3.77 MB/sec execute 201 sec latency 20.582 ms 2024-05-08T21:02:24.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 226408 3.78 MB/sec execute 202 sec latency 19.435 ms 2024-05-08T21:02:25.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 227119 3.79 MB/sec execute 203 sec latency 12.771 ms 2024-05-08T21:02:26.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 227629 3.78 MB/sec execute 204 sec latency 9.884 ms 2024-05-08T21:02:27.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 228293 3.77 MB/sec execute 205 sec latency 13.973 ms 2024-05-08T21:02:28.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 229110 3.77 MB/sec execute 206 sec latency 18.598 ms 2024-05-08T21:02:29.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 229929 3.78 MB/sec execute 207 sec latency 36.662 ms 2024-05-08T21:02:30.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 230634 3.79 MB/sec execute 208 sec latency 10.447 ms 2024-05-08T21:02:30.478 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:30.480 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:31.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 231137 3.78 MB/sec execute 209 sec latency 39.315 ms 2024-05-08T21:02:32.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 231786 3.77 MB/sec execute 210 sec latency 18.320 ms 2024-05-08T21:02:33.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 232586 3.77 MB/sec execute 211 sec latency 17.271 ms 2024-05-08T21:02:34.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 233354 3.78 MB/sec execute 212 sec latency 23.157 ms 2024-05-08T21:02:35.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 234146 3.79 MB/sec execute 213 sec latency 10.563 ms 2024-05-08T21:02:36.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 234674 3.78 MB/sec execute 214 sec latency 13.273 ms 2024-05-08T21:02:37.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 235354 3.77 MB/sec execute 215 sec latency 19.884 ms 2024-05-08T21:02:38.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 236185 3.77 MB/sec execute 216 sec latency 13.551 ms 2024-05-08T21:02:39.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 236971 3.78 MB/sec execute 217 sec latency 33.950 ms 2024-05-08T21:02:40.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 237698 3.79 MB/sec execute 218 sec latency 14.297 ms 2024-05-08T21:02:41.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 238230 3.78 MB/sec execute 219 sec latency 13.082 ms 2024-05-08T21:02:42.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 238913 3.77 MB/sec execute 220 sec latency 13.678 ms 2024-05-08T21:02:43.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 239750 3.77 MB/sec execute 221 sec latency 12.691 ms 2024-05-08T21:02:44.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 240568 3.78 MB/sec execute 222 sec latency 14.243 ms 2024-05-08T21:02:45.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 241260 3.79 MB/sec execute 223 sec latency 12.935 ms 2024-05-08T21:02:46.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 241752 3.78 MB/sec execute 224 sec latency 32.499 ms 2024-05-08T21:02:47.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 242425 3.77 MB/sec execute 225 sec latency 13.304 ms 2024-05-08T21:02:48.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 243242 3.77 MB/sec execute 226 sec latency 18.511 ms 2024-05-08T21:02:49.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 243988 3.78 MB/sec execute 227 sec latency 35.299 ms 2024-05-08T21:02:50.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 244769 3.79 MB/sec execute 228 sec latency 12.905 ms 2024-05-08T21:02:51.413 INFO:tasks.workunit.client.0.smithi135.stdout: 1 245285 3.78 MB/sec execute 229 sec latency 47.304 ms 2024-05-08T21:02:52.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 245951 3.78 MB/sec execute 230 sec latency 12.461 ms 2024-05-08T21:02:53.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 246763 3.77 MB/sec execute 231 sec latency 14.030 ms 2024-05-08T21:02:54.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 247532 3.78 MB/sec execute 232 sec latency 31.235 ms 2024-05-08T21:02:55.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 248313 3.79 MB/sec execute 233 sec latency 12.534 ms 2024-05-08T21:02:56.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 248834 3.78 MB/sec execute 234 sec latency 12.170 ms 2024-05-08T21:02:57.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 249512 3.78 MB/sec execute 235 sec latency 12.163 ms 2024-05-08T21:02:58.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 250331 3.78 MB/sec execute 236 sec latency 18.277 ms 2024-05-08T21:02:59.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 251086 3.78 MB/sec execute 237 sec latency 41.128 ms 2024-05-08T21:03:00.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 251841 3.79 MB/sec execute 238 sec latency 18.783 ms 2024-05-08T21:03:00.906 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:03:00.908 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:03:00.960 INFO:tasks.ceph.mds.b.smithi183.stderr:2024-05-08T21:03:00.958+0000 7f45113a8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53483) UID: 0 2024-05-08T21:03:00.961 INFO:tasks.ceph.mds.d.smithi183.stderr:2024-05-08T21:03:00.958+0000 7f4edd07a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53483) UID: 0 2024-05-08T21:03:00.961 INFO:tasks.ceph.mds.f.smithi183.stderr:2024-05-08T21:03:00.958+0000 7f1bb1cae700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53483) UID: 0 2024-05-08T21:03:01.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 252385 3.78 MB/sec execute 239 sec latency 11.080 ms 2024-05-08T21:03:02.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 253056 3.78 MB/sec execute 240 sec latency 21.142 ms 2024-05-08T21:03:03.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 253862 3.78 MB/sec execute 241 sec latency 18.951 ms 2024-05-08T21:03:04.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 254628 3.78 MB/sec execute 242 sec latency 21.478 ms 2024-05-08T21:03:05.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 255389 3.79 MB/sec execute 243 sec latency 22.185 ms 2024-05-08T21:03:06.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 255901 3.79 MB/sec execute 244 sec latency 12.780 ms 2024-05-08T21:03:07.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 256577 3.78 MB/sec execute 245 sec latency 12.428 ms 2024-05-08T21:03:08.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 257325 3.78 MB/sec execute 246 sec latency 13.192 ms 2024-05-08T21:03:09.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 257981 3.77 MB/sec execute 247 sec latency 33.428 ms 2024-05-08T21:03:10.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 258750 3.78 MB/sec execute 248 sec latency 19.843 ms 2024-05-08T21:03:11.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 259358 3.79 MB/sec execute 249 sec latency 12.903 ms 2024-05-08T21:03:12.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 259916 3.77 MB/sec execute 250 sec latency 20.974 ms 2024-05-08T21:03:13.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 260672 3.78 MB/sec execute 251 sec latency 17.571 ms 2024-05-08T21:03:14.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 261376 3.77 MB/sec execute 252 sec latency 32.287 ms 2024-05-08T21:03:15.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 262269 3.78 MB/sec execute 253 sec latency 28.867 ms 2024-05-08T21:03:16.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 262833 3.79 MB/sec execute 254 sec latency 15.298 ms 2024-05-08T21:03:17.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 263376 3.77 MB/sec execute 255 sec latency 12.609 ms 2024-05-08T21:03:18.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 264098 3.78 MB/sec execute 256 sec latency 15.643 ms 2024-05-08T21:03:19.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 264849 3.77 MB/sec execute 257 sec latency 24.777 ms 2024-05-08T21:03:20.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 265777 3.78 MB/sec execute 258 sec latency 25.368 ms 2024-05-08T21:03:21.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 266289 3.79 MB/sec execute 259 sec latency 66.789 ms 2024-05-08T21:03:22.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 266725 3.77 MB/sec execute 260 sec latency 18.022 ms 2024-05-08T21:03:23.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 267464 3.78 MB/sec execute 261 sec latency 13.656 ms 2024-05-08T21:03:24.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 268203 3.77 MB/sec execute 262 sec latency 27.066 ms 2024-05-08T21:03:25.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 269025 3.78 MB/sec execute 263 sec latency 36.583 ms 2024-05-08T21:03:26.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 269711 3.78 MB/sec execute 264 sec latency 18.033 ms 2024-05-08T21:03:27.414 INFO:tasks.workunit.client.0.smithi135.stdout: 1 270173 3.77 MB/sec execute 265 sec latency 57.375 ms 2024-05-08T21:03:28.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 270840 3.77 MB/sec execute 266 sec latency 20.854 ms 2024-05-08T21:03:29.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 271657 3.77 MB/sec execute 267 sec latency 16.661 ms 2024-05-08T21:03:30.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 272475 3.77 MB/sec execute 268 sec latency 23.508 ms 2024-05-08T21:03:31.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 273115 3.78 MB/sec execute 269 sec latency 61.870 ms 2024-05-08T21:03:32.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 273638 3.78 MB/sec execute 270 sec latency 18.899 ms 2024-05-08T21:03:33.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 274321 3.77 MB/sec execute 271 sec latency 18.207 ms 2024-05-08T21:03:34.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 275067 3.77 MB/sec execute 272 sec latency 12.953 ms 2024-05-08T21:03:35.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 275732 3.76 MB/sec execute 273 sec latency 39.990 ms 2024-05-08T21:03:36.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 276490 3.77 MB/sec execute 274 sec latency 14.014 ms 2024-05-08T21:03:37.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 277139 3.78 MB/sec execute 275 sec latency 13.919 ms 2024-05-08T21:03:38.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 277749 3.77 MB/sec execute 276 sec latency 15.374 ms 2024-05-08T21:03:39.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 278509 3.77 MB/sec execute 277 sec latency 12.636 ms 2024-05-08T21:03:40.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 279187 3.76 MB/sec execute 278 sec latency 38.685 ms 2024-05-08T21:03:41.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 280016 3.77 MB/sec execute 279 sec latency 18.723 ms 2024-05-08T21:03:42.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 280630 3.78 MB/sec execute 280 sec latency 12.331 ms 2024-05-08T21:03:43.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 281194 3.77 MB/sec execute 281 sec latency 13.586 ms 2024-05-08T21:03:44.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 281947 3.77 MB/sec execute 282 sec latency 17.579 ms 2024-05-08T21:03:45.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 282653 3.76 MB/sec execute 283 sec latency 18.336 ms 2024-05-08T21:03:46.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 283536 3.77 MB/sec execute 284 sec latency 13.338 ms 2024-05-08T21:03:47.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 284096 3.78 MB/sec execute 285 sec latency 12.642 ms 2024-05-08T21:03:48.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 284649 3.77 MB/sec execute 286 sec latency 12.991 ms 2024-05-08T21:03:49.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 285393 3.77 MB/sec execute 287 sec latency 12.551 ms 2024-05-08T21:03:50.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 286149 3.76 MB/sec execute 288 sec latency 15.364 ms 2024-05-08T21:03:51.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 287065 3.78 MB/sec execute 289 sec latency 24.625 ms 2024-05-08T21:03:52.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 287587 3.78 MB/sec execute 290 sec latency 18.342 ms 2024-05-08T21:03:53.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 288088 3.77 MB/sec execute 291 sec latency 16.871 ms 2024-05-08T21:03:54.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 288805 3.77 MB/sec execute 292 sec latency 13.541 ms 2024-05-08T21:03:55.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 289533 3.76 MB/sec execute 293 sec latency 28.025 ms 2024-05-08T21:03:56.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 290326 3.77 MB/sec execute 294 sec latency 18.232 ms 2024-05-08T21:03:57.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 291078 3.78 MB/sec execute 295 sec latency 18.313 ms 2024-05-08T21:03:58.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 291568 3.77 MB/sec execute 296 sec latency 13.326 ms 2024-05-08T21:03:59.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 292299 3.77 MB/sec execute 297 sec latency 14.266 ms 2024-05-08T21:04:00.415 INFO:tasks.workunit.client.0.smithi135.stdout: 1 293053 3.76 MB/sec execute 298 sec latency 24.040 ms 2024-05-08T21:04:01.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 293845 3.77 MB/sec execute 299 sec latency 24.483 ms 2024-05-08T21:04:02.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 294536 3.78 MB/sec execute 300 sec latency 17.243 ms 2024-05-08T21:04:03.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 295048 3.77 MB/sec execute 301 sec latency 12.505 ms 2024-05-08T21:04:04.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 295809 3.77 MB/sec execute 302 sec latency 12.141 ms 2024-05-08T21:04:05.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 296574 3.76 MB/sec execute 303 sec latency 13.211 ms 2024-05-08T21:04:06.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 297411 3.77 MB/sec execute 304 sec latency 37.777 ms 2024-05-08T21:04:07.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 298104 3.78 MB/sec execute 305 sec latency 22.341 ms 2024-05-08T21:04:08.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 298590 3.77 MB/sec execute 306 sec latency 13.374 ms 2024-05-08T21:04:09.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 299228 3.76 MB/sec execute 307 sec latency 79.588 ms 2024-05-08T21:04:10.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 299993 3.76 MB/sec execute 308 sec latency 26.214 ms 2024-05-08T21:04:11.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 300692 3.77 MB/sec execute 309 sec latency 36.064 ms 2024-05-08T21:04:12.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 301509 3.78 MB/sec execute 310 sec latency 13.161 ms 2024-05-08T21:04:13.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 302010 3.77 MB/sec execute 311 sec latency 16.394 ms 2024-05-08T21:04:14.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 302674 3.76 MB/sec execute 312 sec latency 21.558 ms 2024-05-08T21:04:15.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 303440 3.76 MB/sec execute 313 sec latency 12.740 ms 2024-05-08T21:04:16.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 304102 3.76 MB/sec execute 314 sec latency 57.380 ms 2024-05-08T21:04:17.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 304853 3.77 MB/sec execute 315 sec latency 13.384 ms 2024-05-08T21:04:18.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 305478 3.77 MB/sec execute 316 sec latency 12.218 ms 2024-05-08T21:04:19.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 306069 3.76 MB/sec execute 317 sec latency 12.383 ms 2024-05-08T21:04:20.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 306843 3.76 MB/sec execute 318 sec latency 13.066 ms 2024-05-08T21:04:21.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 307552 3.76 MB/sec execute 319 sec latency 13.160 ms 2024-05-08T21:04:22.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 308380 3.77 MB/sec execute 320 sec latency 13.158 ms 2024-05-08T21:04:23.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 308985 3.77 MB/sec execute 321 sec latency 17.849 ms 2024-05-08T21:04:24.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 309539 3.76 MB/sec execute 322 sec latency 15.926 ms 2024-05-08T21:04:25.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 310301 3.76 MB/sec execute 323 sec latency 17.081 ms 2024-05-08T21:04:26.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 311041 3.76 MB/sec execute 324 sec latency 41.070 ms 2024-05-08T21:04:27.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 311919 3.77 MB/sec execute 325 sec latency 13.296 ms 2024-05-08T21:04:28.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 312506 3.77 MB/sec execute 326 sec latency 13.849 ms 2024-05-08T21:04:29.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 313074 3.76 MB/sec execute 327 sec latency 13.004 ms 2024-05-08T21:04:30.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 313795 3.76 MB/sec execute 328 sec latency 13.392 ms 2024-05-08T21:04:31.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 314518 3.76 MB/sec execute 329 sec latency 34.078 ms 2024-05-08T21:04:32.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 315435 3.77 MB/sec execute 330 sec latency 17.236 ms 2024-05-08T21:04:33.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 315971 3.77 MB/sec execute 331 sec latency 12.786 ms 2024-05-08T21:04:34.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 316510 3.76 MB/sec execute 332 sec latency 11.631 ms 2024-05-08T21:04:35.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 317241 3.77 MB/sec execute 333 sec latency 12.646 ms 2024-05-08T21:04:36.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 318051 3.76 MB/sec execute 334 sec latency 11.809 ms 2024-05-08T21:04:37.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 318982 3.77 MB/sec execute 335 sec latency 36.713 ms 2024-05-08T21:04:38.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 319514 3.77 MB/sec execute 336 sec latency 15.387 ms 2024-05-08T21:04:39.416 INFO:tasks.workunit.client.0.smithi135.stdout: 1 319963 3.76 MB/sec execute 337 sec latency 78.085 ms 2024-05-08T21:04:40.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 320681 3.77 MB/sec execute 338 sec latency 15.070 ms 2024-05-08T21:04:41.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 321428 3.76 MB/sec execute 339 sec latency 14.992 ms 2024-05-08T21:04:42.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 322185 3.77 MB/sec execute 340 sec latency 17.968 ms 2024-05-08T21:04:43.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 322899 3.77 MB/sec execute 341 sec latency 18.996 ms 2024-05-08T21:04:44.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 323370 3.76 MB/sec execute 342 sec latency 13.408 ms 2024-05-08T21:04:45.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 324038 3.76 MB/sec execute 343 sec latency 13.813 ms 2024-05-08T21:04:46.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 324844 3.76 MB/sec execute 344 sec latency 14.746 ms 2024-05-08T21:04:47.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 325563 3.76 MB/sec execute 345 sec latency 30.103 ms 2024-05-08T21:04:48.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 326318 3.77 MB/sec execute 346 sec latency 20.021 ms 2024-05-08T21:04:49.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 326838 3.76 MB/sec execute 347 sec latency 13.442 ms 2024-05-08T21:04:50.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 327502 3.76 MB/sec execute 348 sec latency 17.049 ms 2024-05-08T21:04:51.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 328260 3.76 MB/sec execute 349 sec latency 15.616 ms 2024-05-08T21:04:52.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 328844 3.75 MB/sec execute 350 sec latency 125.288 ms 2024-05-08T21:04:53.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 329667 3.76 MB/sec execute 351 sec latency 14.922 ms 2024-05-08T21:04:54.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 330304 3.76 MB/sec execute 352 sec latency 9.770 ms 2024-05-08T21:04:55.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 330922 3.76 MB/sec execute 353 sec latency 12.317 ms 2024-05-08T21:04:56.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 331692 3.76 MB/sec execute 354 sec latency 14.082 ms 2024-05-08T21:04:57.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 332318 3.75 MB/sec execute 355 sec latency 105.876 ms 2024-05-08T21:04:58.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 333194 3.76 MB/sec execute 356 sec latency 15.564 ms 2024-05-08T21:04:59.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 333792 3.77 MB/sec execute 357 sec latency 10.787 ms 2024-05-08T21:05:00.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 334339 3.76 MB/sec execute 358 sec latency 13.929 ms 2024-05-08T21:05:01.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 335075 3.76 MB/sec execute 359 sec latency 11.971 ms 2024-05-08T21:05:02.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 335825 3.75 MB/sec execute 360 sec latency 25.185 ms 2024-05-08T21:05:03.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 336731 3.76 MB/sec execute 361 sec latency 14.660 ms 2024-05-08T21:05:04.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 337294 3.77 MB/sec execute 362 sec latency 12.610 ms 2024-05-08T21:05:05.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 337857 3.76 MB/sec execute 363 sec latency 15.281 ms 2024-05-08T21:05:06.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 338597 3.76 MB/sec execute 364 sec latency 12.692 ms 2024-05-08T21:05:07.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 339346 3.75 MB/sec execute 365 sec latency 21.299 ms 2024-05-08T21:05:08.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 340264 3.76 MB/sec execute 366 sec latency 26.936 ms 2024-05-08T21:05:09.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 340822 3.77 MB/sec execute 367 sec latency 9.831 ms 2024-05-08T21:05:10.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 341347 3.76 MB/sec execute 368 sec latency 12.671 ms 2024-05-08T21:05:11.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 342079 3.76 MB/sec execute 369 sec latency 13.685 ms 2024-05-08T21:05:12.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 342864 3.76 MB/sec execute 370 sec latency 12.851 ms 2024-05-08T21:05:13.417 INFO:tasks.workunit.client.0.smithi135.stdout: 1 343705 3.76 MB/sec execute 371 sec latency 77.379 ms 2024-05-08T21:05:14.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 344292 3.77 MB/sec execute 372 sec latency 18.322 ms 2024-05-08T21:05:14.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:05:14.804 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:05:15.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 344733 3.76 MB/sec execute 373 sec latency 64.413 ms 2024-05-08T21:05:16.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 345471 3.76 MB/sec execute 374 sec latency 13.898 ms 2024-05-08T21:05:17.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 346245 3.75 MB/sec execute 375 sec latency 24.843 ms 2024-05-08T21:05:18.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 347053 3.76 MB/sec execute 376 sec latency 21.668 ms 2024-05-08T21:05:19.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 347769 3.77 MB/sec execute 377 sec latency 15.766 ms 2024-05-08T21:05:20.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 348276 3.76 MB/sec execute 378 sec latency 13.162 ms 2024-05-08T21:05:21.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 349014 3.76 MB/sec execute 379 sec latency 14.159 ms 2024-05-08T21:05:22.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 349770 3.75 MB/sec execute 380 sec latency 17.725 ms 2024-05-08T21:05:23.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 350596 3.76 MB/sec execute 381 sec latency 25.626 ms 2024-05-08T21:05:24.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 351300 3.77 MB/sec execute 382 sec latency 17.702 ms 2024-05-08T21:05:25.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 351784 3.76 MB/sec execute 383 sec latency 20.113 ms 2024-05-08T21:05:26.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 352541 3.76 MB/sec execute 384 sec latency 13.066 ms 2024-05-08T21:05:27.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 353263 3.75 MB/sec execute 385 sec latency 16.234 ms 2024-05-08T21:05:28.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 354094 3.76 MB/sec execute 386 sec latency 16.873 ms 2024-05-08T21:05:29.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 354785 3.77 MB/sec execute 387 sec latency 19.322 ms 2024-05-08T21:05:30.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 355289 3.76 MB/sec execute 388 sec latency 12.422 ms 2024-05-08T21:05:31.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 355952 3.76 MB/sec execute 389 sec latency 19.477 ms 2024-05-08T21:05:32.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 356756 3.76 MB/sec execute 390 sec latency 17.398 ms 2024-05-08T21:05:33.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 357496 3.76 MB/sec execute 391 sec latency 23.273 ms 2024-05-08T21:05:34.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 358278 3.77 MB/sec execute 392 sec latency 18.978 ms 2024-05-08T21:05:35.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 358760 3.76 MB/sec execute 393 sec latency 63.975 ms 2024-05-08T21:05:36.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 359426 3.76 MB/sec execute 394 sec latency 16.351 ms 2024-05-08T21:05:37.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 360176 3.76 MB/sec execute 395 sec latency 12.523 ms 2024-05-08T21:05:38.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 360851 3.75 MB/sec execute 396 sec latency 29.185 ms 2024-05-08T21:05:39.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 361611 3.76 MB/sec execute 397 sec latency 12.345 ms 2024-05-08T21:05:40.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 362258 3.76 MB/sec execute 398 sec latency 16.189 ms 2024-05-08T21:05:41.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 362893 3.76 MB/sec execute 399 sec latency 12.692 ms 2024-05-08T21:05:42.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 363665 3.76 MB/sec execute 400 sec latency 12.340 ms 2024-05-08T21:05:43.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 364372 3.75 MB/sec execute 401 sec latency 38.782 ms 2024-05-08T21:05:44.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 365148 3.76 MB/sec execute 402 sec latency 14.789 ms 2024-05-08T21:05:45.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:05:45.165 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:05:45.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 365794 3.76 MB/sec execute 403 sec latency 13.019 ms 2024-05-08T21:05:46.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 366440 3.76 MB/sec execute 404 sec latency 20.950 ms 2024-05-08T21:05:47.418 INFO:tasks.workunit.client.0.smithi135.stdout: 1 367210 3.76 MB/sec execute 405 sec latency 12.342 ms 2024-05-08T21:05:48.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 367898 3.75 MB/sec execute 406 sec latency 12.936 ms 2024-05-08T21:05:49.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 368670 3.76 MB/sec execute 407 sec latency 20.564 ms 2024-05-08T21:05:50.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 369269 3.76 MB/sec execute 408 sec latency 68.521 ms 2024-05-08T21:05:51.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 369845 3.76 MB/sec execute 409 sec latency 12.769 ms 2024-05-08T21:05:52.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 370606 3.76 MB/sec execute 410 sec latency 12.652 ms 2024-05-08T21:05:53.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 371321 3.75 MB/sec execute 411 sec latency 45.572 ms 2024-05-08T21:05:54.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 372195 3.76 MB/sec execute 412 sec latency 12.248 ms 2024-05-08T21:05:55.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 372770 3.76 MB/sec execute 413 sec latency 18.905 ms 2024-05-08T21:05:56.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 373322 3.76 MB/sec execute 414 sec latency 14.220 ms 2024-05-08T21:05:57.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 374062 3.76 MB/sec execute 415 sec latency 16.763 ms 2024-05-08T21:05:58.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 374821 3.75 MB/sec execute 416 sec latency 45.217 ms 2024-05-08T21:05:59.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 375724 3.76 MB/sec execute 417 sec latency 13.321 ms 2024-05-08T21:06:00.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 376270 3.76 MB/sec execute 418 sec latency 18.461 ms 2024-05-08T21:06:01.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 376803 3.76 MB/sec execute 419 sec latency 15.309 ms 2024-05-08T21:06:02.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 377566 3.76 MB/sec execute 420 sec latency 13.142 ms 2024-05-08T21:06:03.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 378360 3.75 MB/sec execute 421 sec latency 29.919 ms 2024-05-08T21:06:04.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 379297 3.76 MB/sec execute 422 sec latency 14.210 ms 2024-05-08T21:06:05.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 379845 3.77 MB/sec execute 423 sec latency 14.223 ms 2024-05-08T21:06:06.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 380386 3.76 MB/sec execute 424 sec latency 10.084 ms 2024-05-08T21:06:07.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 381124 3.76 MB/sec execute 425 sec latency 18.045 ms 2024-05-08T21:06:08.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 381918 3.76 MB/sec execute 426 sec latency 31.076 ms 2024-05-08T21:06:09.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 382844 3.76 MB/sec execute 427 sec latency 17.372 ms 2024-05-08T21:06:10.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 383362 3.77 MB/sec execute 428 sec latency 44.787 ms 2024-05-08T21:06:11.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 383885 3.76 MB/sec execute 429 sec latency 12.066 ms 2024-05-08T21:06:12.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 384613 3.76 MB/sec execute 430 sec latency 12.851 ms 2024-05-08T21:06:13.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 385436 3.76 MB/sec execute 431 sec latency 26.536 ms 2024-05-08T21:06:14.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 386316 3.76 MB/sec execute 432 sec latency 23.032 ms 2024-05-08T21:06:15.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:06:15.232 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:06:15.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 386893 3.77 MB/sec execute 433 sec latency 25.236 ms 2024-05-08T21:06:16.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 387293 3.76 MB/sec execute 434 sec latency 53.761 ms 2024-05-08T21:06:17.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 388059 3.76 MB/sec execute 435 sec latency 13.346 ms 2024-05-08T21:06:18.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 388816 3.75 MB/sec execute 436 sec latency 14.890 ms 2024-05-08T21:06:19.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 389640 3.76 MB/sec execute 437 sec latency 38.059 ms 2024-05-08T21:06:20.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 390327 3.76 MB/sec execute 438 sec latency 18.432 ms 2024-05-08T21:06:21.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 390813 3.76 MB/sec execute 439 sec latency 13.047 ms 2024-05-08T21:06:22.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 391506 3.76 MB/sec execute 440 sec latency 11.800 ms 2024-05-08T21:06:23.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 392302 3.76 MB/sec execute 441 sec latency 24.849 ms 2024-05-08T21:06:24.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 393107 3.76 MB/sec execute 442 sec latency 35.229 ms 2024-05-08T21:06:25.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 393770 3.76 MB/sec execute 443 sec latency 20.352 ms 2024-05-08T21:06:26.419 INFO:tasks.workunit.client.0.smithi135.stdout: 1 394297 3.76 MB/sec execute 444 sec latency 12.400 ms 2024-05-08T21:06:27.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 394978 3.76 MB/sec execute 445 sec latency 17.156 ms 2024-05-08T21:06:28.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 395729 3.76 MB/sec execute 446 sec latency 53.908 ms 2024-05-08T21:06:29.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 396384 3.75 MB/sec execute 447 sec latency 44.094 ms 2024-05-08T21:06:30.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 397155 3.76 MB/sec execute 448 sec latency 13.749 ms 2024-05-08T21:06:31.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 397715 3.76 MB/sec execute 449 sec latency 145.111 ms 2024-05-08T21:06:32.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 398348 3.76 MB/sec execute 450 sec latency 10.536 ms 2024-05-08T21:06:33.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 399121 3.76 MB/sec execute 451 sec latency 16.106 ms 2024-05-08T21:06:34.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 399781 3.75 MB/sec execute 452 sec latency 28.197 ms 2024-05-08T21:06:35.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 400624 3.76 MB/sec execute 453 sec latency 20.893 ms 2024-05-08T21:06:36.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 401224 3.76 MB/sec execute 454 sec latency 12.698 ms 2024-05-08T21:06:37.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 401792 3.75 MB/sec execute 455 sec latency 12.212 ms 2024-05-08T21:06:38.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 402509 3.76 MB/sec execute 456 sec latency 17.495 ms 2024-05-08T21:06:39.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 403248 3.75 MB/sec execute 457 sec latency 14.423 ms 2024-05-08T21:06:40.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 404158 3.76 MB/sec execute 458 sec latency 22.176 ms 2024-05-08T21:06:41.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 404720 3.76 MB/sec execute 459 sec latency 12.455 ms 2024-05-08T21:06:42.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 405273 3.76 MB/sec execute 460 sec latency 15.017 ms 2024-05-08T21:06:43.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 406018 3.76 MB/sec execute 461 sec latency 14.345 ms 2024-05-08T21:06:44.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 406766 3.75 MB/sec execute 462 sec latency 41.033 ms 2024-05-08T21:06:45.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 407690 3.76 MB/sec execute 463 sec latency 12.642 ms 2024-05-08T21:06:45.708 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:06:45.711 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:06:46.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 408234 3.76 MB/sec execute 464 sec latency 12.646 ms 2024-05-08T21:06:47.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 408775 3.76 MB/sec execute 465 sec latency 13.565 ms 2024-05-08T21:06:48.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 409484 3.76 MB/sec execute 466 sec latency 30.475 ms 2024-05-08T21:06:49.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 410257 3.75 MB/sec execute 467 sec latency 13.094 ms 2024-05-08T21:06:50.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 411155 3.76 MB/sec execute 468 sec latency 30.122 ms 2024-05-08T21:06:51.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 411723 3.76 MB/sec execute 469 sec latency 41.582 ms 2024-05-08T21:06:52.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 412224 3.76 MB/sec execute 470 sec latency 13.023 ms 2024-05-08T21:06:53.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 412983 3.76 MB/sec execute 471 sec latency 17.145 ms 2024-05-08T21:06:54.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 413696 3.75 MB/sec execute 472 sec latency 52.032 ms 2024-05-08T21:06:55.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 414503 3.76 MB/sec execute 473 sec latency 27.630 ms 2024-05-08T21:06:56.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 415205 3.76 MB/sec execute 474 sec latency 17.752 ms 2024-05-08T21:06:57.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 415708 3.76 MB/sec execute 475 sec latency 15.093 ms 2024-05-08T21:06:58.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 416444 3.76 MB/sec execute 476 sec latency 14.045 ms 2024-05-08T21:06:59.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 417195 3.75 MB/sec execute 477 sec latency 13.027 ms 2024-05-08T21:07:00.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 418012 3.76 MB/sec execute 478 sec latency 25.519 ms 2024-05-08T21:07:01.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 418693 3.76 MB/sec execute 479 sec latency 17.404 ms 2024-05-08T21:07:02.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 419197 3.76 MB/sec execute 480 sec latency 13.850 ms 2024-05-08T21:07:03.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 419871 3.75 MB/sec execute 481 sec latency 15.880 ms 2024-05-08T21:07:04.420 INFO:tasks.workunit.client.0.smithi135.stdout: 1 420647 3.75 MB/sec execute 482 sec latency 27.171 ms 2024-05-08T21:07:05.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 421460 3.76 MB/sec execute 483 sec latency 20.520 ms 2024-05-08T21:07:06.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 422128 3.76 MB/sec execute 484 sec latency 59.382 ms 2024-05-08T21:07:07.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 422618 3.76 MB/sec execute 485 sec latency 67.074 ms 2024-05-08T21:07:08.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 423274 3.75 MB/sec execute 486 sec latency 15.820 ms 2024-05-08T21:07:09.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 424052 3.75 MB/sec execute 487 sec latency 17.957 ms 2024-05-08T21:07:10.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 424749 3.75 MB/sec execute 488 sec latency 16.890 ms 2024-05-08T21:07:11.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 425521 3.76 MB/sec execute 489 sec latency 15.066 ms 2024-05-08T21:07:12.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 426149 3.76 MB/sec execute 490 sec latency 10.850 ms 2024-05-08T21:07:13.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 426817 3.75 MB/sec execute 491 sec latency 12.420 ms 2024-05-08T21:07:14.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 427541 3.75 MB/sec execute 492 sec latency 15.787 ms 2024-05-08T21:07:15.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 428254 3.75 MB/sec execute 493 sec latency 16.937 ms 2024-05-08T21:07:15.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:07:15.791 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:07:16.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 429015 3.76 MB/sec execute 494 sec latency 19.229 ms 2024-05-08T21:07:17.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 429663 3.76 MB/sec execute 495 sec latency 12.707 ms 2024-05-08T21:07:18.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 430290 3.76 MB/sec execute 496 sec latency 14.358 ms 2024-05-08T21:07:19.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 431066 3.75 MB/sec execute 497 sec latency 13.354 ms 2024-05-08T21:07:20.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 431717 3.75 MB/sec execute 498 sec latency 42.566 ms 2024-05-08T21:07:21.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 432549 3.76 MB/sec execute 499 sec latency 15.773 ms 2024-05-08T21:07:22.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 433160 3.76 MB/sec execute 500 sec latency 12.993 ms 2024-05-08T21:07:23.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 433708 3.75 MB/sec execute 501 sec latency 29.646 ms 2024-05-08T21:07:24.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 434470 3.76 MB/sec execute 502 sec latency 12.660 ms 2024-05-08T21:07:25.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 435199 3.75 MB/sec execute 503 sec latency 26.015 ms 2024-05-08T21:07:26.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 436075 3.76 MB/sec execute 504 sec latency 21.589 ms 2024-05-08T21:07:27.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 436653 3.76 MB/sec execute 505 sec latency 17.549 ms 2024-05-08T21:07:28.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 437226 3.75 MB/sec execute 506 sec latency 11.188 ms 2024-05-08T21:07:29.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 437960 3.76 MB/sec execute 507 sec latency 15.853 ms 2024-05-08T21:07:30.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 438698 3.75 MB/sec execute 508 sec latency 43.156 ms 2024-05-08T21:07:31.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 439608 3.76 MB/sec execute 509 sec latency 19.743 ms 2024-05-08T21:07:32.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 440167 3.76 MB/sec execute 510 sec latency 16.253 ms 2024-05-08T21:07:33.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 440671 3.75 MB/sec execute 511 sec latency 17.060 ms 2024-05-08T21:07:34.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 441388 3.76 MB/sec execute 512 sec latency 13.154 ms 2024-05-08T21:07:35.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 442178 3.75 MB/sec execute 513 sec latency 31.371 ms 2024-05-08T21:07:36.421 INFO:tasks.workunit.client.0.smithi135.stdout: 1 443022 3.76 MB/sec execute 514 sec latency 40.960 ms 2024-05-08T21:07:37.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 443618 3.76 MB/sec execute 515 sec latency 12.598 ms 2024-05-08T21:07:38.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 444062 3.75 MB/sec execute 516 sec latency 12.472 ms 2024-05-08T21:07:39.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 444792 3.76 MB/sec execute 517 sec latency 12.551 ms 2024-05-08T21:07:40.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 445546 3.75 MB/sec execute 518 sec latency 28.024 ms 2024-05-08T21:07:41.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 446327 3.76 MB/sec execute 519 sec latency 19.189 ms 2024-05-08T21:07:42.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 446946 3.76 MB/sec execute 520 sec latency 79.461 ms 2024-05-08T21:07:43.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 447442 3.75 MB/sec execute 521 sec latency 12.732 ms 2024-05-08T21:07:44.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 448113 3.75 MB/sec execute 522 sec latency 16.934 ms 2024-05-08T21:07:45.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 448819 3.75 MB/sec execute 523 sec latency 52.163 ms 2024-05-08T21:07:45.902 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:07:45.904 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:07:46.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 449517 3.75 MB/sec execute 524 sec latency 39.795 ms 2024-05-08T21:07:47.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 450280 3.75 MB/sec execute 525 sec latency 12.523 ms 2024-05-08T21:07:48.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 450918 3.76 MB/sec execute 526 sec latency 13.495 ms 2024-05-08T21:07:49.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 451541 3.75 MB/sec execute 527 sec latency 16.907 ms 2024-05-08T21:07:50.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 452300 3.75 MB/sec execute 528 sec latency 16.799 ms 2024-05-08T21:07:51.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 452931 3.75 MB/sec execute 529 sec latency 69.348 ms 2024-05-08T21:07:52.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 453803 3.75 MB/sec execute 530 sec latency 17.246 ms 2024-05-08T21:07:53.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 454394 3.76 MB/sec execute 531 sec latency 11.274 ms 2024-05-08T21:07:54.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 454975 3.75 MB/sec execute 532 sec latency 11.246 ms 2024-05-08T21:07:55.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 455688 3.75 MB/sec execute 533 sec latency 16.372 ms 2024-05-08T21:07:56.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 456434 3.75 MB/sec execute 534 sec latency 44.124 ms 2024-05-08T21:07:57.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 457326 3.75 MB/sec execute 535 sec latency 16.011 ms 2024-05-08T21:07:58.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 457870 3.76 MB/sec execute 536 sec latency 13.368 ms 2024-05-08T21:07:59.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 458344 3.75 MB/sec execute 537 sec latency 20.089 ms 2024-05-08T21:08:00.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 459156 3.78 MB/sec execute 538 sec latency 59.800 ms 2024-05-08T21:08:01.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 459867 3.78 MB/sec execute 539 sec latency 45.013 ms 2024-05-08T21:08:02.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 460647 3.78 MB/sec execute 540 sec latency 54.224 ms 2024-05-08T21:08:03.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 461515 3.79 MB/sec execute 541 sec latency 13.408 ms 2024-05-08T21:08:04.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 462124 3.79 MB/sec execute 542 sec latency 14.898 ms 2024-05-08T21:08:05.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 462594 3.78 MB/sec execute 543 sec latency 14.762 ms 2024-05-08T21:08:06.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 463313 3.78 MB/sec execute 544 sec latency 17.207 ms 2024-05-08T21:08:07.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 464079 3.78 MB/sec execute 545 sec latency 26.973 ms 2024-05-08T21:08:08.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 464873 3.78 MB/sec execute 546 sec latency 36.520 ms 2024-05-08T21:08:09.422 INFO:tasks.workunit.client.0.smithi135.stdout: 1 465575 3.79 MB/sec execute 547 sec latency 20.310 ms 2024-05-08T21:08:10.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 466062 3.78 MB/sec execute 548 sec latency 13.014 ms 2024-05-08T21:08:11.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 466734 3.78 MB/sec execute 549 sec latency 16.985 ms 2024-05-08T21:08:12.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 467531 3.78 MB/sec execute 550 sec latency 13.092 ms 2024-05-08T21:08:13.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 468346 3.78 MB/sec execute 551 sec latency 29.542 ms 2024-05-08T21:08:14.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 469024 3.79 MB/sec execute 552 sec latency 21.980 ms 2024-05-08T21:08:15.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 469558 3.78 MB/sec execute 553 sec latency 10.420 ms 2024-05-08T21:08:15.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:08:16.001 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:08:16.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 470181 3.78 MB/sec execute 554 sec latency 49.045 ms 2024-05-08T21:08:17.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 470978 3.78 MB/sec execute 555 sec latency 25.206 ms 2024-05-08T21:08:18.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 471611 3.78 MB/sec execute 556 sec latency 35.230 ms 2024-05-08T21:08:19.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 472386 3.78 MB/sec execute 557 sec latency 21.319 ms 2024-05-08T21:08:20.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 473005 3.78 MB/sec execute 558 sec latency 12.704 ms 2024-05-08T21:08:21.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 473543 3.78 MB/sec execute 559 sec latency 43.437 ms 2024-05-08T21:08:22.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 474317 3.78 MB/sec execute 560 sec latency 34.309 ms 2024-05-08T21:08:23.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 474981 3.78 MB/sec execute 561 sec latency 69.421 ms 2024-05-08T21:08:24.426 INFO:tasks.workunit.client.0.smithi135.stdout: 1 475853 3.78 MB/sec execute 562 sec latency 11.986 ms 2024-05-08T21:08:25.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 476458 3.78 MB/sec execute 563 sec latency 12.747 ms 2024-05-08T21:08:26.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 477025 3.78 MB/sec execute 564 sec latency 19.747 ms 2024-05-08T21:08:27.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 477756 3.78 MB/sec execute 565 sec latency 20.107 ms 2024-05-08T21:08:28.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 478530 3.78 MB/sec execute 566 sec latency 43.423 ms 2024-05-08T21:08:29.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 479429 3.78 MB/sec execute 567 sec latency 13.003 ms 2024-05-08T21:08:30.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 479983 3.78 MB/sec execute 568 sec latency 12.706 ms 2024-05-08T21:08:31.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 480532 3.78 MB/sec execute 569 sec latency 11.019 ms 2024-05-08T21:08:32.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 481229 3.78 MB/sec execute 570 sec latency 12.317 ms 2024-05-08T21:08:33.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 481977 3.78 MB/sec execute 571 sec latency 16.870 ms 2024-05-08T21:08:34.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 482855 3.78 MB/sec execute 572 sec latency 19.211 ms 2024-05-08T21:08:35.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 483429 3.78 MB/sec execute 573 sec latency 15.590 ms 2024-05-08T21:08:36.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 483876 3.78 MB/sec execute 574 sec latency 13.090 ms 2024-05-08T21:08:37.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 484601 3.78 MB/sec execute 575 sec latency 12.776 ms 2024-05-08T21:08:38.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 485310 3.78 MB/sec execute 576 sec latency 14.430 ms 2024-05-08T21:08:39.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 486104 3.78 MB/sec execute 577 sec latency 21.980 ms 2024-05-08T21:08:40.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 486794 3.78 MB/sec execute 578 sec latency 18.322 ms 2024-05-08T21:08:41.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 487263 3.78 MB/sec execute 579 sec latency 12.282 ms 2024-05-08T21:08:42.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 487902 3.78 MB/sec execute 580 sec latency 18.297 ms 2024-05-08T21:08:43.427 INFO:tasks.workunit.client.0.smithi135.stdout: 1 488653 3.77 MB/sec execute 581 sec latency 27.156 ms 2024-05-08T21:08:44.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 489342 3.77 MB/sec execute 582 sec latency 39.509 ms 2024-05-08T21:08:45.423 INFO:tasks.workunit.client.0.smithi135.stdout: 1 490098 3.78 MB/sec execute 583 sec latency 16.490 ms 2024-05-08T21:08:46.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:08:46.065 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:08:46.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 490709 3.78 MB/sec execute 584 sec latency 13.763 ms 2024-05-08T21:08:47.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 491250 3.77 MB/sec execute 585 sec latency 12.641 ms 2024-05-08T21:08:48.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 491957 3.78 MB/sec execute 586 sec latency 19.058 ms 2024-05-08T21:08:49.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 492698 3.77 MB/sec execute 587 sec latency 40.952 ms 2024-05-08T21:08:50.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 493595 3.78 MB/sec execute 588 sec latency 17.693 ms 2024-05-08T21:08:51.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 494100 3.78 MB/sec execute 589 sec latency 46.280 ms 2024-05-08T21:08:52.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 494574 3.77 MB/sec execute 590 sec latency 22.055 ms 2024-05-08T21:08:53.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 495269 3.78 MB/sec execute 591 sec latency 15.561 ms 2024-05-08T21:08:54.429 INFO:tasks.workunit.client.0.smithi135.stdout: 1 495993 3.77 MB/sec execute 592 sec latency 33.952 ms 2024-05-08T21:08:55.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 496723 3.77 MB/sec execute 593 sec latency 65.792 ms 2024-05-08T21:08:56.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 497245 3.77 MB/sec execute 594 sec latency 61.256 ms 2024-05-08T21:08:57.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 497861 3.77 MB/sec execute 595 sec latency 17.753 ms 2024-05-08T21:08:58.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 498386 3.77 MB/sec execute 596 sec latency 54.400 ms 2024-05-08T21:08:59.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 499113 3.77 MB/sec execute 597 sec latency 14.270 ms 2024-05-08T21:09:00.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 499829 3.77 MB/sec execute 598 sec latency 29.887 ms 2024-05-08T21:09:01.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 500700 3.77 MB/sec execute 599 sec latency 13.021 ms 2024-05-08T21:09:02.424 INFO:tasks.workunit.client.0.smithi135.stdout: 1 cleanup 600 sec 2024-05-08T21:09:02.752 INFO:tasks.workunit.client.0.smithi135.stdout: 0 cleanup 600 sec 2024-05-08T21:09:02.752 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-08T21:09:02.752 INFO:tasks.workunit.client.0.smithi135.stdout: Operation Count AvgLat MaxLat 2024-05-08T21:09:02.752 INFO:tasks.workunit.client.0.smithi135.stdout: ---------------------------------------- 2024-05-08T21:09:02.752 INFO:tasks.workunit.client.0.smithi135.stdout: NTCreateX 71984 2.390 78.083 2024-05-08T21:09:02.752 INFO:tasks.workunit.client.0.smithi135.stdout: Close 52869 0.049 3.047 2024-05-08T21:09:02.752 INFO:tasks.workunit.client.0.smithi135.stdout: Rename 3048 6.890 63.014 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Unlink 14540 2.756 54.394 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Deltree 2 119.474 179.153 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Mkdir 1 0.235 0.235 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Qpathinfo 65226 1.447 84.769 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Qfileinfo 11430 0.070 1.589 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Qfsinfo 11979 0.273 6.925 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Sfileinfo 5854 0.653 16.866 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Find 25245 9.418 145.106 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: WriteX 35922 0.161 32.341 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: ReadX 112827 0.004 0.482 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: LockX 234 0.629 0.996 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: UnlockX 234 0.456 0.791 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: Flush 5042 3.304 40.571 2024-05-08T21:09:02.753 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-08T21:09:02.754 INFO:tasks.workunit.client.0.smithi135.stdout:Throughput 3.77227 MB/sec 1 clients 1 procs max_latency=145.111 ms 2024-05-08T21:09:02.754 INFO:tasks.workunit.client.0.smithi135.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-08T21:09:02.754 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-08T21:09:02.754 INFO:tasks.workunit.client.0.smithi135.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-08T21:09:02.754 INFO:tasks.workunit.client.0.smithi135.stdout:8 of 10 processes prepared for launch 0 sec 2024-05-08T21:09:02.854 INFO:tasks.workunit.client.0.smithi135.stdout:10 of 10 processes prepared for launch 0 sec 2024-05-08T21:09:02.854 INFO:tasks.workunit.client.0.smithi135.stdout:releasing clients 2024-05-08T21:09:03.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 259 98.01 MB/sec warmup 1 sec latency 40.496 ms 2024-05-08T21:09:04.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 478 83.56 MB/sec warmup 2 sec latency 43.093 ms 2024-05-08T21:09:05.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 690 70.63 MB/sec warmup 3 sec latency 144.793 ms 2024-05-08T21:09:06.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 837 53.83 MB/sec warmup 4 sec latency 97.728 ms 2024-05-08T21:09:07.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 971 43.89 MB/sec warmup 5 sec latency 85.655 ms 2024-05-08T21:09:08.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1123 38.29 MB/sec warmup 6 sec latency 100.285 ms 2024-05-08T21:09:09.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1242 32.98 MB/sec warmup 7 sec latency 161.133 ms 2024-05-08T21:09:10.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1407 32.52 MB/sec warmup 8 sec latency 154.563 ms 2024-05-08T21:09:11.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1551 29.01 MB/sec warmup 9 sec latency 101.622 ms 2024-05-08T21:09:12.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1698 26.23 MB/sec warmup 10 sec latency 124.609 ms 2024-05-08T21:09:13.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 1868 23.97 MB/sec warmup 11 sec latency 96.743 ms 2024-05-08T21:09:14.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 2047 22.17 MB/sec warmup 12 sec latency 82.830 ms 2024-05-08T21:09:15.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 2200 20.66 MB/sec warmup 13 sec latency 84.111 ms 2024-05-08T21:09:16.132 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:16.135 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:09:16.170 INFO:tasks.ceph.mds.b.smithi183.stderr:2024-05-08T21:09:16.167+0000 7f45113a8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53732) UID: 0 2024-05-08T21:09:16.170 INFO:tasks.ceph.mds.f.smithi183.stderr:2024-05-08T21:09:16.167+0000 7f1bb1cae700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53732) UID: 0 2024-05-08T21:09:16.171 INFO:tasks.ceph.mds.d.smithi183.stderr:2024-05-08T21:09:16.167+0000 7f4edd07a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53732) UID: 0 2024-05-08T21:09:16.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 2349 19.90 MB/sec warmup 14 sec latency 107.851 ms 2024-05-08T21:09:17.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 2448 18.85 MB/sec warmup 15 sec latency 101.360 ms 2024-05-08T21:09:18.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 2583 18.11 MB/sec warmup 16 sec latency 94.881 ms 2024-05-08T21:09:19.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 2822 19.03 MB/sec warmup 17 sec latency 87.667 ms 2024-05-08T21:09:20.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3066 18.80 MB/sec warmup 18 sec latency 115.786 ms 2024-05-08T21:09:21.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3284 18.60 MB/sec warmup 19 sec latency 177.916 ms 2024-05-08T21:09:22.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3310 17.68 MB/sec warmup 20 sec latency 80.256 ms 2024-05-08T21:09:23.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3332 16.85 MB/sec warmup 21 sec latency 91.733 ms 2024-05-08T21:09:24.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3439 16.53 MB/sec warmup 22 sec latency 116.260 ms 2024-05-08T21:09:25.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3654 16.85 MB/sec warmup 23 sec latency 117.972 ms 2024-05-08T21:09:26.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3794 16.57 MB/sec warmup 24 sec latency 116.967 ms 2024-05-08T21:09:27.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3875 15.94 MB/sec warmup 25 sec latency 96.416 ms 2024-05-08T21:09:28.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 3959 15.41 MB/sec warmup 26 sec latency 114.185 ms 2024-05-08T21:09:29.854 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4046 14.84 MB/sec warmup 27 sec latency 126.631 ms 2024-05-08T21:09:30.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4154 14.33 MB/sec warmup 28 sec latency 129.926 ms 2024-05-08T21:09:31.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4265 13.90 MB/sec warmup 29 sec latency 146.328 ms 2024-05-08T21:09:32.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4394 13.54 MB/sec warmup 30 sec latency 152.748 ms 2024-05-08T21:09:33.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4504 13.25 MB/sec warmup 31 sec latency 199.922 ms 2024-05-08T21:09:34.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4643 13.14 MB/sec warmup 32 sec latency 98.647 ms 2024-05-08T21:09:35.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4781 12.87 MB/sec warmup 33 sec latency 99.050 ms 2024-05-08T21:09:36.855 INFO:tasks.workunit.client.0.smithi135.stdout: 10 4943 12.97 MB/sec warmup 34 sec latency 97.198 ms 2024-05-08T21:09:37.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 5101 12.92 MB/sec warmup 35 sec latency 97.955 ms 2024-05-08T21:09:38.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 5246 12.59 MB/sec warmup 36 sec latency 109.977 ms 2024-05-08T21:09:39.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 5413 12.29 MB/sec warmup 37 sec latency 129.100 ms 2024-05-08T21:09:40.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 5568 12.01 MB/sec warmup 38 sec latency 74.636 ms 2024-05-08T21:09:41.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 5719 11.80 MB/sec warmup 39 sec latency 116.212 ms 2024-05-08T21:09:42.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 5871 11.69 MB/sec warmup 40 sec latency 93.086 ms 2024-05-08T21:09:43.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 5978 11.54 MB/sec warmup 41 sec latency 111.980 ms 2024-05-08T21:09:44.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 6086 11.39 MB/sec warmup 42 sec latency 137.987 ms 2024-05-08T21:09:45.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 6276 11.56 MB/sec warmup 43 sec latency 102.151 ms 2024-05-08T21:09:46.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 6560 11.94 MB/sec warmup 44 sec latency 100.579 ms 2024-05-08T21:09:47.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 6747 11.92 MB/sec warmup 45 sec latency 145.011 ms 2024-05-08T21:09:48.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 6853 11.84 MB/sec warmup 46 sec latency 109.402 ms 2024-05-08T21:09:49.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 6877 11.59 MB/sec warmup 47 sec latency 95.265 ms 2024-05-08T21:09:50.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 6963 11.55 MB/sec warmup 48 sec latency 92.419 ms 2024-05-08T21:09:51.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7154 11.79 MB/sec warmup 49 sec latency 106.994 ms 2024-05-08T21:09:52.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7295 11.67 MB/sec warmup 50 sec latency 113.521 ms 2024-05-08T21:09:53.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7406 11.56 MB/sec warmup 51 sec latency 109.006 ms 2024-05-08T21:09:54.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7494 11.38 MB/sec warmup 52 sec latency 157.787 ms 2024-05-08T21:09:55.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7584 11.17 MB/sec warmup 53 sec latency 118.575 ms 2024-05-08T21:09:56.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7677 10.97 MB/sec warmup 54 sec latency 154.952 ms 2024-05-08T21:09:57.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7797 10.80 MB/sec warmup 55 sec latency 174.653 ms 2024-05-08T21:09:58.856 INFO:tasks.workunit.client.0.smithi135.stdout: 10 7909 10.66 MB/sec warmup 56 sec latency 204.933 ms 2024-05-08T21:09:59.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 8027 10.54 MB/sec warmup 57 sec latency 215.321 ms 2024-05-08T21:10:00.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 8147 10.47 MB/sec warmup 58 sec latency 133.994 ms 2024-05-08T21:10:01.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 8288 10.38 MB/sec warmup 59 sec latency 113.548 ms 2024-05-08T21:10:02.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 8446 10.42 MB/sec warmup 60 sec latency 97.262 ms 2024-05-08T21:10:03.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 8610 10.54 MB/sec warmup 61 sec latency 118.221 ms 2024-05-08T21:10:04.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 8750 10.39 MB/sec warmup 62 sec latency 100.134 ms 2024-05-08T21:10:05.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 8911 10.25 MB/sec warmup 63 sec latency 92.801 ms 2024-05-08T21:10:06.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 9066 10.11 MB/sec warmup 64 sec latency 102.525 ms 2024-05-08T21:10:07.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 9230 10.00 MB/sec warmup 65 sec latency 92.473 ms 2024-05-08T21:10:08.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 9390 9.95 MB/sec warmup 66 sec latency 102.408 ms 2024-05-08T21:10:09.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 9512 9.91 MB/sec warmup 67 sec latency 95.583 ms 2024-05-08T21:10:10.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 9628 9.85 MB/sec warmup 68 sec latency 118.606 ms 2024-05-08T21:10:11.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 9810 9.96 MB/sec warmup 69 sec latency 99.915 ms 2024-05-08T21:10:12.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10092 10.23 MB/sec warmup 70 sec latency 91.131 ms 2024-05-08T21:10:13.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10298 10.26 MB/sec warmup 71 sec latency 145.169 ms 2024-05-08T21:10:14.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10400 10.22 MB/sec warmup 72 sec latency 113.064 ms 2024-05-08T21:10:15.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10427 10.08 MB/sec warmup 73 sec latency 90.017 ms 2024-05-08T21:10:16.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10519 10.08 MB/sec warmup 74 sec latency 93.838 ms 2024-05-08T21:10:17.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10717 10.28 MB/sec warmup 75 sec latency 102.750 ms 2024-05-08T21:10:18.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10842 10.20 MB/sec warmup 76 sec latency 122.434 ms 2024-05-08T21:10:19.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 10940 10.14 MB/sec warmup 77 sec latency 171.885 ms 2024-05-08T21:10:20.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11025 10.03 MB/sec warmup 78 sec latency 133.476 ms 2024-05-08T21:10:21.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11110 9.91 MB/sec warmup 79 sec latency 108.468 ms 2024-05-08T21:10:22.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11208 9.79 MB/sec warmup 80 sec latency 148.200 ms 2024-05-08T21:10:23.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11327 9.69 MB/sec warmup 81 sec latency 147.263 ms 2024-05-08T21:10:24.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11431 9.60 MB/sec warmup 82 sec latency 196.074 ms 2024-05-08T21:10:25.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11551 9.52 MB/sec warmup 83 sec latency 196.188 ms 2024-05-08T21:10:26.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11664 9.49 MB/sec warmup 84 sec latency 136.465 ms 2024-05-08T21:10:27.857 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11805 9.45 MB/sec warmup 85 sec latency 105.225 ms 2024-05-08T21:10:28.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 11968 9.52 MB/sec warmup 86 sec latency 100.257 ms 2024-05-08T21:10:29.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 12137 9.59 MB/sec warmup 87 sec latency 116.026 ms 2024-05-08T21:10:30.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 12285 9.49 MB/sec warmup 88 sec latency 100.186 ms 2024-05-08T21:10:31.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 12433 9.40 MB/sec warmup 89 sec latency 86.455 ms 2024-05-08T21:10:32.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 12603 9.31 MB/sec warmup 90 sec latency 89.633 ms 2024-05-08T21:10:33.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 12755 9.23 MB/sec warmup 91 sec latency 109.981 ms 2024-05-08T21:10:34.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 12891 9.20 MB/sec warmup 92 sec latency 139.324 ms 2024-05-08T21:10:35.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13027 9.18 MB/sec warmup 93 sec latency 104.128 ms 2024-05-08T21:10:36.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13137 9.13 MB/sec warmup 94 sec latency 102.475 ms 2024-05-08T21:10:37.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13305 9.21 MB/sec warmup 95 sec latency 89.850 ms 2024-05-08T21:10:38.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13517 9.33 MB/sec warmup 96 sec latency 106.429 ms 2024-05-08T21:10:39.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13772 9.46 MB/sec warmup 97 sec latency 116.465 ms 2024-05-08T21:10:40.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13926 9.44 MB/sec warmup 98 sec latency 143.076 ms 2024-05-08T21:10:41.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13961 9.37 MB/sec warmup 99 sec latency 88.159 ms 2024-05-08T21:10:42.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 13997 9.28 MB/sec warmup 100 sec latency 108.672 ms 2024-05-08T21:10:43.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14140 9.34 MB/sec warmup 101 sec latency 106.210 ms 2024-05-08T21:10:44.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14322 9.46 MB/sec warmup 102 sec latency 115.577 ms 2024-05-08T21:10:45.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14441 9.41 MB/sec warmup 103 sec latency 110.612 ms 2024-05-08T21:10:46.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14537 9.35 MB/sec warmup 104 sec latency 157.516 ms 2024-05-08T21:10:47.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14623 9.28 MB/sec warmup 105 sec latency 159.147 ms 2024-05-08T21:10:48.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14716 9.19 MB/sec warmup 106 sec latency 132.622 ms 2024-05-08T21:10:49.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14805 9.12 MB/sec warmup 107 sec latency 166.168 ms 2024-05-08T21:10:50.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 14934 9.05 MB/sec warmup 108 sec latency 126.569 ms 2024-05-08T21:10:51.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 15051 8.99 MB/sec warmup 109 sec latency 139.311 ms 2024-05-08T21:10:52.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 15178 8.98 MB/sec warmup 110 sec latency 172.759 ms 2024-05-08T21:10:53.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 15311 8.94 MB/sec warmup 111 sec latency 104.957 ms 2024-05-08T21:10:54.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 15471 9.02 MB/sec warmup 112 sec latency 99.867 ms 2024-05-08T21:10:55.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 15595 8.95 MB/sec warmup 113 sec latency 150.874 ms 2024-05-08T21:10:56.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 15766 9.00 MB/sec warmup 114 sec latency 88.563 ms 2024-05-08T21:10:57.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 15918 8.93 MB/sec warmup 115 sec latency 102.795 ms 2024-05-08T21:10:58.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 16088 8.87 MB/sec warmup 116 sec latency 84.635 ms 2024-05-08T21:10:59.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 16229 8.81 MB/sec warmup 117 sec latency 106.778 ms 2024-05-08T21:11:00.858 INFO:tasks.workunit.client.0.smithi135.stdout: 10 16400 8.79 MB/sec warmup 118 sec latency 102.461 ms 2024-05-08T21:11:01.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 16543 8.76 MB/sec warmup 119 sec latency 78.050 ms 2024-05-08T21:11:03.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 16815 16.74 MB/sec execute 1 sec latency 99.081 ms 2024-05-08T21:11:04.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 16986 14.34 MB/sec execute 2 sec latency 122.218 ms 2024-05-08T21:11:05.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 17276 18.78 MB/sec execute 3 sec latency 162.475 ms 2024-05-08T21:11:06.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 17415 15.95 MB/sec execute 4 sec latency 136.399 ms 2024-05-08T21:11:07.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 17498 13.89 MB/sec execute 5 sec latency 100.484 ms 2024-05-08T21:11:08.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 17534 11.66 MB/sec execute 6 sec latency 94.958 ms 2024-05-08T21:11:09.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 17654 12.20 MB/sec execute 7 sec latency 137.255 ms 2024-05-08T21:11:10.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 17796 12.34 MB/sec execute 8 sec latency 173.772 ms 2024-05-08T21:11:11.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 17943 12.02 MB/sec execute 9 sec latency 130.958 ms 2024-05-08T21:11:12.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18053 11.50 MB/sec execute 10 sec latency 117.541 ms 2024-05-08T21:11:13.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18142 10.54 MB/sec execute 11 sec latency 115.946 ms 2024-05-08T21:11:14.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18235 9.72 MB/sec execute 12 sec latency 130.867 ms 2024-05-08T21:11:15.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18322 9.03 MB/sec execute 13 sec latency 166.964 ms 2024-05-08T21:11:16.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18449 8.51 MB/sec execute 14 sec latency 189.463 ms 2024-05-08T21:11:17.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18570 8.14 MB/sec execute 15 sec latency 162.291 ms 2024-05-08T21:11:18.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18699 8.02 MB/sec execute 16 sec latency 183.062 ms 2024-05-08T21:11:19.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18831 7.88 MB/sec execute 17 sec latency 118.781 ms 2024-05-08T21:11:20.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 18997 8.29 MB/sec execute 18 sec latency 93.690 ms 2024-05-08T21:11:21.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 19140 8.20 MB/sec execute 19 sec latency 118.349 ms 2024-05-08T21:11:22.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 19305 8.41 MB/sec execute 20 sec latency 83.160 ms 2024-05-08T21:11:23.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 19466 8.07 MB/sec execute 21 sec latency 93.885 ms 2024-05-08T21:11:24.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 19631 7.77 MB/sec execute 22 sec latency 83.334 ms 2024-05-08T21:11:25.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 19780 7.51 MB/sec execute 23 sec latency 130.757 ms 2024-05-08T21:11:26.859 INFO:tasks.workunit.client.0.smithi135.stdout: 10 19971 7.48 MB/sec execute 24 sec latency 92.321 ms 2024-05-08T21:11:27.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 20128 7.39 MB/sec execute 25 sec latency 85.878 ms 2024-05-08T21:11:28.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 20258 7.39 MB/sec execute 26 sec latency 97.790 ms 2024-05-08T21:11:29.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 20412 7.82 MB/sec execute 27 sec latency 105.464 ms 2024-05-08T21:11:30.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 20623 8.19 MB/sec execute 28 sec latency 103.203 ms 2024-05-08T21:11:31.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 20894 8.64 MB/sec execute 29 sec latency 101.244 ms 2024-05-08T21:11:32.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21051 8.63 MB/sec execute 30 sec latency 115.882 ms 2024-05-08T21:11:33.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21092 8.43 MB/sec execute 31 sec latency 118.975 ms 2024-05-08T21:11:34.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21161 8.36 MB/sec execute 32 sec latency 99.678 ms 2024-05-08T21:11:35.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21290 8.43 MB/sec execute 33 sec latency 91.336 ms 2024-05-08T21:11:36.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21456 8.78 MB/sec execute 34 sec latency 154.677 ms 2024-05-08T21:11:37.860 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21586 8.68 MB/sec execute 35 sec latency 115.640 ms 2024-05-08T21:11:38.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21676 8.52 MB/sec execute 36 sec latency 112.975 ms 2024-05-08T21:11:39.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21772 8.33 MB/sec execute 37 sec latency 100.167 ms 2024-05-08T21:11:40.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21873 8.12 MB/sec execute 38 sec latency 144.418 ms 2024-05-08T21:11:41.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 21967 7.95 MB/sec execute 39 sec latency 220.442 ms 2024-05-08T21:11:42.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 22103 7.81 MB/sec execute 40 sec latency 129.848 ms 2024-05-08T21:11:43.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 22233 7.74 MB/sec execute 41 sec latency 132.329 ms 2024-05-08T21:11:44.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 22358 7.68 MB/sec execute 42 sec latency 168.675 ms 2024-05-08T21:11:45.221 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:11:45.237 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:11:45.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 22489 7.65 MB/sec execute 43 sec latency 101.149 ms 2024-05-08T21:11:46.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 22665 7.82 MB/sec execute 44 sec latency 78.466 ms 2024-05-08T21:11:47.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 22826 7.99 MB/sec execute 45 sec latency 105.307 ms 2024-05-08T21:11:48.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 22967 7.84 MB/sec execute 46 sec latency 98.653 ms 2024-05-08T21:11:49.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 23111 7.70 MB/sec execute 47 sec latency 101.142 ms 2024-05-08T21:11:50.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 23277 7.57 MB/sec execute 48 sec latency 122.059 ms 2024-05-08T21:11:51.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 23438 7.48 MB/sec execute 49 sec latency 97.298 ms 2024-05-08T21:11:52.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 23573 7.43 MB/sec execute 50 sec latency 96.064 ms 2024-05-08T21:11:53.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 23722 7.45 MB/sec execute 51 sec latency 91.307 ms 2024-05-08T21:11:54.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 23834 7.39 MB/sec execute 52 sec latency 109.878 ms 2024-05-08T21:11:55.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 24045 7.67 MB/sec execute 53 sec latency 112.187 ms 2024-05-08T21:11:56.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 24296 7.98 MB/sec execute 54 sec latency 92.272 ms 2024-05-08T21:11:57.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 24499 8.08 MB/sec execute 55 sec latency 109.646 ms 2024-05-08T21:11:58.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 24623 8.08 MB/sec execute 56 sec latency 101.724 ms 2024-05-08T21:11:59.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 24654 7.94 MB/sec execute 57 sec latency 93.361 ms 2024-05-08T21:12:00.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 24778 8.07 MB/sec execute 58 sec latency 105.537 ms 2024-05-08T21:12:01.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 24928 8.15 MB/sec execute 59 sec latency 81.096 ms 2024-05-08T21:12:02.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25081 8.20 MB/sec execute 60 sec latency 85.558 ms 2024-05-08T21:12:03.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25195 8.16 MB/sec execute 61 sec latency 115.584 ms 2024-05-08T21:12:04.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25279 8.05 MB/sec execute 62 sec latency 154.046 ms 2024-05-08T21:12:05.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25383 7.93 MB/sec execute 63 sec latency 90.335 ms 2024-05-08T21:12:06.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25477 7.82 MB/sec execute 64 sec latency 210.855 ms 2024-05-08T21:12:07.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25611 7.73 MB/sec execute 65 sec latency 142.595 ms 2024-05-08T21:12:08.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25738 7.66 MB/sec execute 66 sec latency 132.966 ms 2024-05-08T21:12:09.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 25866 7.66 MB/sec execute 67 sec latency 187.522 ms 2024-05-08T21:12:10.861 INFO:tasks.workunit.client.0.smithi135.stdout: 10 26001 7.62 MB/sec execute 68 sec latency 92.739 ms 2024-05-08T21:12:11.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 26164 7.76 MB/sec execute 69 sec latency 96.979 ms 2024-05-08T21:12:12.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 26329 7.78 MB/sec execute 70 sec latency 87.239 ms 2024-05-08T21:12:13.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 26486 7.77 MB/sec execute 71 sec latency 93.408 ms 2024-05-08T21:12:14.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 26633 7.68 MB/sec execute 72 sec latency 118.976 ms 2024-05-08T21:12:15.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:12:15.560 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:12:15.600 INFO:tasks.ceph.mds.b.smithi183.stderr:2024-05-08T21:12:15.597+0000 7f45113a8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53819) UID: 0 2024-05-08T21:12:15.600 INFO:tasks.ceph.mds.f.smithi183.stderr:2024-05-08T21:12:15.597+0000 7f1bb1cae700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53819) UID: 0 2024-05-08T21:12:15.600 INFO:tasks.ceph.mds.d.smithi183.stderr:2024-05-08T21:12:15.597+0000 7f4edd07a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53819) UID: 0 2024-05-08T21:12:15.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 26810 7.60 MB/sec execute 73 sec latency 91.253 ms 2024-05-08T21:12:16.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 26954 7.52 MB/sec execute 74 sec latency 82.485 ms 2024-05-08T21:12:17.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 27113 7.50 MB/sec execute 75 sec latency 97.464 ms 2024-05-08T21:12:18.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 27241 7.48 MB/sec execute 76 sec latency 102.613 ms 2024-05-08T21:12:19.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 27370 7.47 MB/sec execute 77 sec latency 91.474 ms 2024-05-08T21:12:20.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 27556 7.63 MB/sec execute 78 sec latency 102.973 ms 2024-05-08T21:12:21.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 27783 7.77 MB/sec execute 79 sec latency 99.683 ms 2024-05-08T21:12:22.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28014 7.94 MB/sec execute 80 sec latency 118.248 ms 2024-05-08T21:12:23.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28152 7.92 MB/sec execute 81 sec latency 118.418 ms 2024-05-08T21:12:24.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28188 7.85 MB/sec execute 82 sec latency 91.890 ms 2024-05-08T21:12:25.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28270 7.87 MB/sec execute 83 sec latency 120.957 ms 2024-05-08T21:12:26.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28398 7.90 MB/sec execute 84 sec latency 90.040 ms 2024-05-08T21:12:27.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28564 8.02 MB/sec execute 85 sec latency 112.153 ms 2024-05-08T21:12:28.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28676 7.98 MB/sec execute 86 sec latency 139.154 ms 2024-05-08T21:12:29.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28769 7.92 MB/sec execute 87 sec latency 91.971 ms 2024-05-08T21:12:30.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28851 7.85 MB/sec execute 88 sec latency 115.263 ms 2024-05-08T21:12:31.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 28946 7.76 MB/sec execute 89 sec latency 164.163 ms 2024-05-08T21:12:32.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29052 7.69 MB/sec execute 90 sec latency 137.986 ms 2024-05-08T21:12:33.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29164 7.63 MB/sec execute 91 sec latency 222.244 ms 2024-05-08T21:12:34.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29278 7.58 MB/sec execute 92 sec latency 161.905 ms 2024-05-08T21:12:35.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29391 7.57 MB/sec execute 93 sec latency 209.531 ms 2024-05-08T21:12:36.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29526 7.54 MB/sec execute 94 sec latency 90.723 ms 2024-05-08T21:12:37.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29698 7.65 MB/sec execute 95 sec latency 109.455 ms 2024-05-08T21:12:38.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29837 7.64 MB/sec execute 96 sec latency 135.534 ms 2024-05-08T21:12:39.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 29985 7.65 MB/sec execute 97 sec latency 103.414 ms 2024-05-08T21:12:40.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 30128 7.59 MB/sec execute 98 sec latency 110.879 ms 2024-05-08T21:12:41.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 30279 7.53 MB/sec execute 99 sec latency 85.284 ms 2024-05-08T21:12:42.862 INFO:tasks.workunit.client.0.smithi135.stdout: 10 30426 7.47 MB/sec execute 100 sec latency 96.456 ms 2024-05-08T21:12:43.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 30593 7.44 MB/sec execute 101 sec latency 106.050 ms 2024-05-08T21:12:44.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 30738 7.43 MB/sec execute 102 sec latency 100.021 ms 2024-05-08T21:12:45.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 30850 7.42 MB/sec execute 103 sec latency 107.961 ms 2024-05-08T21:12:46.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 30976 7.42 MB/sec execute 104 sec latency 86.924 ms 2024-05-08T21:12:47.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 31187 7.57 MB/sec execute 105 sec latency 113.094 ms 2024-05-08T21:12:48.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 31449 7.71 MB/sec execute 106 sec latency 121.173 ms 2024-05-08T21:12:49.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 31620 7.75 MB/sec execute 107 sec latency 159.614 ms 2024-05-08T21:12:50.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 31715 7.73 MB/sec execute 108 sec latency 162.624 ms 2024-05-08T21:12:51.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 31737 7.66 MB/sec execute 109 sec latency 125.437 ms 2024-05-08T21:12:52.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 31834 7.70 MB/sec execute 110 sec latency 103.494 ms 2024-05-08T21:12:53.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 31970 7.74 MB/sec execute 111 sec latency 118.102 ms 2024-05-08T21:12:54.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32123 7.79 MB/sec execute 112 sec latency 117.102 ms 2024-05-08T21:12:55.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32235 7.77 MB/sec execute 113 sec latency 188.185 ms 2024-05-08T21:12:56.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32331 7.73 MB/sec execute 114 sec latency 106.775 ms 2024-05-08T21:12:57.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32413 7.67 MB/sec execute 115 sec latency 196.358 ms 2024-05-08T21:12:58.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32517 7.61 MB/sec execute 116 sec latency 137.945 ms 2024-05-08T21:12:59.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32626 7.55 MB/sec execute 117 sec latency 148.489 ms 2024-05-08T21:13:00.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32727 7.51 MB/sec execute 118 sec latency 201.857 ms 2024-05-08T21:13:01.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32849 7.48 MB/sec execute 119 sec latency 190.257 ms 2024-05-08T21:13:02.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 32973 7.46 MB/sec execute 120 sec latency 137.080 ms 2024-05-08T21:13:03.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 33099 7.44 MB/sec execute 121 sec latency 95.579 ms 2024-05-08T21:13:04.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 33267 7.52 MB/sec execute 122 sec latency 94.777 ms 2024-05-08T21:13:05.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 33423 7.54 MB/sec execute 123 sec latency 120.714 ms 2024-05-08T21:13:06.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 33575 7.53 MB/sec execute 124 sec latency 108.188 ms 2024-05-08T21:13:07.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 33724 7.48 MB/sec execute 125 sec latency 123.138 ms 2024-05-08T21:13:08.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 33894 7.44 MB/sec execute 126 sec latency 90.241 ms 2024-05-08T21:13:09.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 34046 7.39 MB/sec execute 127 sec latency 93.181 ms 2024-05-08T21:13:10.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 34207 7.38 MB/sec execute 128 sec latency 98.861 ms 2024-05-08T21:13:11.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 34340 7.38 MB/sec execute 129 sec latency 103.338 ms 2024-05-08T21:13:12.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 34459 7.37 MB/sec execute 130 sec latency 115.474 ms 2024-05-08T21:13:13.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 34612 7.46 MB/sec execute 131 sec latency 140.402 ms 2024-05-08T21:13:14.863 INFO:tasks.workunit.client.0.smithi135.stdout: 10 34824 7.54 MB/sec execute 132 sec latency 98.921 ms 2024-05-08T21:13:15.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35078 7.63 MB/sec execute 133 sec latency 110.325 ms 2024-05-08T21:13:16.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35234 7.64 MB/sec execute 134 sec latency 129.469 ms 2024-05-08T21:13:17.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35277 7.60 MB/sec execute 135 sec latency 107.169 ms 2024-05-08T21:13:18.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35338 7.59 MB/sec execute 136 sec latency 100.912 ms 2024-05-08T21:13:19.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35456 7.61 MB/sec execute 137 sec latency 108.538 ms 2024-05-08T21:13:20.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35641 7.71 MB/sec execute 138 sec latency 115.580 ms 2024-05-08T21:13:21.865 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35754 7.69 MB/sec execute 139 sec latency 143.842 ms 2024-05-08T21:13:22.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35851 7.65 MB/sec execute 140 sec latency 117.772 ms 2024-05-08T21:13:23.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 35934 7.61 MB/sec execute 141 sec latency 132.951 ms 2024-05-08T21:13:24.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36029 7.56 MB/sec execute 142 sec latency 161.069 ms 2024-05-08T21:13:25.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36128 7.51 MB/sec execute 143 sec latency 209.872 ms 2024-05-08T21:13:26.864 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36240 7.47 MB/sec execute 144 sec latency 229.369 ms 2024-05-08T21:13:27.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36357 7.44 MB/sec execute 145 sec latency 229.737 ms 2024-05-08T21:13:28.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36486 7.44 MB/sec execute 146 sec latency 165.804 ms 2024-05-08T21:13:29.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36613 7.42 MB/sec execute 147 sec latency 110.023 ms 2024-05-08T21:13:30.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36747 7.43 MB/sec execute 148 sec latency 126.278 ms 2024-05-08T21:13:31.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 36908 7.48 MB/sec execute 149 sec latency 114.230 ms 2024-05-08T21:13:32.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 37058 7.50 MB/sec execute 150 sec latency 110.984 ms 2024-05-08T21:13:33.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 37190 7.46 MB/sec execute 151 sec latency 150.929 ms 2024-05-08T21:13:34.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 37344 7.41 MB/sec execute 152 sec latency 103.840 ms 2024-05-08T21:13:35.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 37495 7.38 MB/sec execute 153 sec latency 155.507 ms 2024-05-08T21:13:36.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 37647 7.35 MB/sec execute 154 sec latency 110.377 ms 2024-05-08T21:13:37.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 37797 7.35 MB/sec execute 155 sec latency 99.844 ms 2024-05-08T21:13:38.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 37926 7.34 MB/sec execute 156 sec latency 94.748 ms 2024-05-08T21:13:39.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 38056 7.36 MB/sec execute 157 sec latency 99.239 ms 2024-05-08T21:13:40.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 38262 7.44 MB/sec execute 158 sec latency 106.065 ms 2024-05-08T21:13:41.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 38479 7.52 MB/sec execute 159 sec latency 101.681 ms 2024-05-08T21:13:42.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 38704 7.57 MB/sec execute 160 sec latency 124.617 ms 2024-05-08T21:13:43.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 38806 7.56 MB/sec execute 161 sec latency 108.018 ms 2024-05-08T21:13:44.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 38838 7.52 MB/sec execute 162 sec latency 116.593 ms 2024-05-08T21:13:45.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 38959 7.56 MB/sec execute 163 sec latency 101.358 ms 2024-05-08T21:13:46.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39101 7.59 MB/sec execute 164 sec latency 106.158 ms 2024-05-08T21:13:47.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39238 7.62 MB/sec execute 165 sec latency 157.667 ms 2024-05-08T21:13:48.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39356 7.60 MB/sec execute 166 sec latency 93.215 ms 2024-05-08T21:13:49.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39446 7.57 MB/sec execute 167 sec latency 131.895 ms 2024-05-08T21:13:50.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39536 7.53 MB/sec execute 168 sec latency 163.819 ms 2024-05-08T21:13:51.866 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39633 7.49 MB/sec execute 169 sec latency 188.574 ms 2024-05-08T21:13:52.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39730 7.45 MB/sec execute 170 sec latency 200.455 ms 2024-05-08T21:13:53.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39834 7.42 MB/sec execute 171 sec latency 192.216 ms 2024-05-08T21:13:54.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 39956 7.40 MB/sec execute 172 sec latency 228.738 ms 2024-05-08T21:13:55.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40072 7.39 MB/sec execute 173 sec latency 146.771 ms 2024-05-08T21:13:56.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40206 7.39 MB/sec execute 174 sec latency 110.240 ms 2024-05-08T21:13:57.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40373 7.43 MB/sec execute 175 sec latency 89.951 ms 2024-05-08T21:13:58.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40516 7.44 MB/sec execute 176 sec latency 101.756 ms 2024-05-08T21:13:59.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40672 7.44 MB/sec execute 177 sec latency 121.100 ms 2024-05-08T21:14:00.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40811 7.40 MB/sec execute 178 sec latency 127.414 ms 2024-05-08T21:14:01.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 40973 7.37 MB/sec execute 179 sec latency 101.396 ms 2024-05-08T21:14:02.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 41130 7.34 MB/sec execute 180 sec latency 87.297 ms 2024-05-08T21:14:03.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 41283 7.33 MB/sec execute 181 sec latency 116.707 ms 2024-05-08T21:14:04.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 41411 7.32 MB/sec execute 182 sec latency 109.912 ms 2024-05-08T21:14:05.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 41537 7.32 MB/sec execute 183 sec latency 109.365 ms 2024-05-08T21:14:06.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 41699 7.36 MB/sec execute 184 sec latency 106.113 ms 2024-05-08T21:14:07.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 41936 7.45 MB/sec execute 185 sec latency 94.688 ms 2024-05-08T21:14:08.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42157 7.50 MB/sec execute 186 sec latency 108.259 ms 2024-05-08T21:14:09.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42306 7.51 MB/sec execute 187 sec latency 126.222 ms 2024-05-08T21:14:10.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42365 7.49 MB/sec execute 188 sec latency 128.114 ms 2024-05-08T21:14:11.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42429 7.49 MB/sec execute 189 sec latency 90.349 ms 2024-05-08T21:14:12.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42562 7.52 MB/sec execute 190 sec latency 106.445 ms 2024-05-08T21:14:13.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42711 7.55 MB/sec execute 191 sec latency 103.634 ms 2024-05-08T21:14:14.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42844 7.55 MB/sec execute 192 sec latency 149.603 ms 2024-05-08T21:14:15.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 42949 7.54 MB/sec execute 193 sec latency 131.748 ms 2024-05-08T21:14:16.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43034 7.50 MB/sec execute 194 sec latency 109.289 ms 2024-05-08T21:14:17.867 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43125 7.47 MB/sec execute 195 sec latency 142.401 ms 2024-05-08T21:14:18.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43228 7.43 MB/sec execute 196 sec latency 154.030 ms 2024-05-08T21:14:19.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43346 7.41 MB/sec execute 197 sec latency 179.171 ms 2024-05-08T21:14:20.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43464 7.39 MB/sec execute 198 sec latency 202.260 ms 2024-05-08T21:14:21.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43598 7.37 MB/sec execute 199 sec latency 184.309 ms 2024-05-08T21:14:22.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43749 7.40 MB/sec execute 200 sec latency 121.342 ms 2024-05-08T21:14:23.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 43879 7.39 MB/sec execute 201 sec latency 114.574 ms 2024-05-08T21:14:24.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 44051 7.43 MB/sec execute 202 sec latency 112.133 ms 2024-05-08T21:14:25.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 44209 7.43 MB/sec execute 203 sec latency 112.303 ms 2024-05-08T21:14:26.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 44365 7.40 MB/sec execute 204 sec latency 98.005 ms 2024-05-08T21:14:27.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 44523 7.37 MB/sec execute 205 sec latency 93.577 ms 2024-05-08T21:14:28.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 44691 7.35 MB/sec execute 206 sec latency 76.112 ms 2024-05-08T21:14:29.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 44851 7.34 MB/sec execute 207 sec latency 84.507 ms 2024-05-08T21:14:30.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 44974 7.33 MB/sec execute 208 sec latency 93.193 ms 2024-05-08T21:14:31.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 45102 7.33 MB/sec execute 209 sec latency 89.774 ms 2024-05-08T21:14:32.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 45282 7.39 MB/sec execute 210 sec latency 105.852 ms 2024-05-08T21:14:33.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 45515 7.45 MB/sec execute 211 sec latency 129.857 ms 2024-05-08T21:14:34.868 INFO:tasks.workunit.client.0.smithi135.stdout: 10 45752 7.50 MB/sec execute 212 sec latency 126.837 ms 2024-05-08T21:14:35.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 45883 7.50 MB/sec execute 213 sec latency 116.680 ms 2024-05-08T21:14:36.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 45923 7.48 MB/sec execute 214 sec latency 82.968 ms 2024-05-08T21:14:37.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46010 7.47 MB/sec execute 215 sec latency 98.718 ms 2024-05-08T21:14:38.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46177 7.53 MB/sec execute 216 sec latency 106.495 ms 2024-05-08T21:14:39.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46329 7.56 MB/sec execute 217 sec latency 108.831 ms 2024-05-08T21:14:40.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46441 7.54 MB/sec execute 218 sec latency 135.119 ms 2024-05-08T21:14:41.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46534 7.52 MB/sec execute 219 sec latency 99.122 ms 2024-05-08T21:14:42.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46624 7.48 MB/sec execute 220 sec latency 132.599 ms 2024-05-08T21:14:43.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46717 7.45 MB/sec execute 221 sec latency 189.453 ms 2024-05-08T21:14:44.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46831 7.43 MB/sec execute 222 sec latency 127.475 ms 2024-05-08T21:14:45.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 46954 7.41 MB/sec execute 223 sec latency 168.940 ms 2024-05-08T21:14:46.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47077 7.39 MB/sec execute 224 sec latency 204.624 ms 2024-05-08T21:14:47.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47205 7.39 MB/sec execute 225 sec latency 151.188 ms 2024-05-08T21:14:48.364 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:14:48.367 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:14:48.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47342 7.40 MB/sec execute 226 sec latency 101.868 ms 2024-05-08T21:14:49.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47514 7.44 MB/sec execute 227 sec latency 97.592 ms 2024-05-08T21:14:50.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47659 7.44 MB/sec execute 228 sec latency 103.880 ms 2024-05-08T21:14:51.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47809 7.42 MB/sec execute 229 sec latency 114.930 ms 2024-05-08T21:14:52.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 47978 7.39 MB/sec execute 230 sec latency 109.782 ms 2024-05-08T21:14:53.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 48136 7.37 MB/sec execute 231 sec latency 139.134 ms 2024-05-08T21:14:54.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 48288 7.35 MB/sec execute 232 sec latency 112.810 ms 2024-05-08T21:14:55.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 48442 7.35 MB/sec execute 233 sec latency 109.544 ms 2024-05-08T21:14:56.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 48576 7.35 MB/sec execute 234 sec latency 84.140 ms 2024-05-08T21:14:57.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 48714 7.36 MB/sec execute 235 sec latency 102.694 ms 2024-05-08T21:14:58.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 48871 7.41 MB/sec execute 236 sec latency 113.016 ms 2024-05-08T21:14:59.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49119 7.46 MB/sec execute 237 sec latency 124.496 ms 2024-05-08T21:15:00.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49355 7.50 MB/sec execute 238 sec latency 151.336 ms 2024-05-08T21:15:01.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49445 7.49 MB/sec execute 239 sec latency 154.450 ms 2024-05-08T21:15:02.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49490 7.47 MB/sec execute 240 sec latency 123.953 ms 2024-05-08T21:15:03.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49569 7.46 MB/sec execute 241 sec latency 112.653 ms 2024-05-08T21:15:04.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49734 7.52 MB/sec execute 242 sec latency 112.454 ms 2024-05-08T21:15:05.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49890 7.54 MB/sec execute 243 sec latency 145.274 ms 2024-05-08T21:15:06.869 INFO:tasks.workunit.client.0.smithi135.stdout: 10 49991 7.52 MB/sec execute 244 sec latency 164.943 ms 2024-05-08T21:15:07.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50072 7.50 MB/sec execute 245 sec latency 182.435 ms 2024-05-08T21:15:08.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50171 7.47 MB/sec execute 246 sec latency 96.989 ms 2024-05-08T21:15:09.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50267 7.44 MB/sec execute 247 sec latency 174.634 ms 2024-05-08T21:15:10.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50371 7.42 MB/sec execute 248 sec latency 250.657 ms 2024-05-08T21:15:11.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50494 7.40 MB/sec execute 249 sec latency 164.112 ms 2024-05-08T21:15:12.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50607 7.39 MB/sec execute 250 sec latency 241.676 ms 2024-05-08T21:15:13.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50726 7.38 MB/sec execute 251 sec latency 163.023 ms 2024-05-08T21:15:14.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 50876 7.39 MB/sec execute 252 sec latency 110.248 ms 2024-05-08T21:15:15.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 51036 7.41 MB/sec execute 253 sec latency 96.704 ms 2024-05-08T21:15:16.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 51201 7.43 MB/sec execute 254 sec latency 111.591 ms 2024-05-08T21:15:17.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 51351 7.41 MB/sec execute 255 sec latency 105.821 ms 2024-05-08T21:15:18.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:15:18.762 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:15:18.806 INFO:tasks.ceph.mds.b.smithi183.stderr:2024-05-08T21:15:18.802+0000 7f45113a8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53925) UID: 0 2024-05-08T21:15:18.807 INFO:tasks.ceph.mds.f.smithi183.stderr:2024-05-08T21:15:18.802+0000 7f1bb1cae700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53925) UID: 0 2024-05-08T21:15:18.807 INFO:tasks.ceph.mds.d.smithi183.stderr:2024-05-08T21:15:18.802+0000 7f4edd07a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53925) UID: 0 2024-05-08T21:15:18.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 51522 7.39 MB/sec execute 256 sec latency 100.521 ms 2024-05-08T21:15:19.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 51674 7.37 MB/sec execute 257 sec latency 100.723 ms 2024-05-08T21:15:20.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 51828 7.35 MB/sec execute 258 sec latency 142.833 ms 2024-05-08T21:15:21.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 51983 7.35 MB/sec execute 259 sec latency 118.502 ms 2024-05-08T21:15:22.870 INFO:tasks.workunit.client.0.smithi135.stdout: 10 52110 7.35 MB/sec execute 260 sec latency 105.982 ms 2024-05-08T21:15:23.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 52217 7.36 MB/sec execute 261 sec latency 132.936 ms 2024-05-08T21:15:24.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 52384 7.38 MB/sec execute 262 sec latency 130.362 ms 2024-05-08T21:15:25.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 52625 7.45 MB/sec execute 263 sec latency 120.021 ms 2024-05-08T21:15:26.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 52841 7.47 MB/sec execute 264 sec latency 106.797 ms 2024-05-08T21:15:27.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 52971 7.47 MB/sec execute 265 sec latency 181.802 ms 2024-05-08T21:15:28.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53009 7.45 MB/sec execute 266 sec latency 111.037 ms 2024-05-08T21:15:29.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53080 7.45 MB/sec execute 267 sec latency 90.208 ms 2024-05-08T21:15:30.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53216 7.49 MB/sec execute 268 sec latency 125.523 ms 2024-05-08T21:15:31.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53373 7.50 MB/sec execute 269 sec latency 116.859 ms 2024-05-08T21:15:32.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53503 7.50 MB/sec execute 270 sec latency 107.287 ms 2024-05-08T21:15:33.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53590 7.48 MB/sec execute 271 sec latency 170.108 ms 2024-05-08T21:15:34.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53681 7.46 MB/sec execute 272 sec latency 120.777 ms 2024-05-08T21:15:35.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53778 7.43 MB/sec execute 273 sec latency 160.259 ms 2024-05-08T21:15:36.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 53884 7.41 MB/sec execute 274 sec latency 196.718 ms 2024-05-08T21:15:37.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54002 7.39 MB/sec execute 275 sec latency 215.215 ms 2024-05-08T21:15:38.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54071 7.38 MB/sec execute 276 sec latency 398.073 ms 2024-05-08T21:15:39.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54175 7.36 MB/sec execute 277 sec latency 228.948 ms 2024-05-08T21:15:40.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54289 7.36 MB/sec execute 278 sec latency 195.082 ms 2024-05-08T21:15:41.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54437 7.37 MB/sec execute 279 sec latency 104.340 ms 2024-05-08T21:15:42.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54588 7.38 MB/sec execute 280 sec latency 117.339 ms 2024-05-08T21:15:43.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54739 7.39 MB/sec execute 281 sec latency 99.164 ms 2024-05-08T21:15:44.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 54891 7.38 MB/sec execute 282 sec latency 114.697 ms 2024-05-08T21:15:45.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 55051 7.36 MB/sec execute 283 sec latency 124.319 ms 2024-05-08T21:15:46.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 55207 7.34 MB/sec execute 284 sec latency 87.883 ms 2024-05-08T21:15:47.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 55360 7.33 MB/sec execute 285 sec latency 98.028 ms 2024-05-08T21:15:48.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 55502 7.32 MB/sec execute 286 sec latency 87.592 ms 2024-05-08T21:15:49.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 55643 7.32 MB/sec execute 287 sec latency 101.906 ms 2024-05-08T21:15:50.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 55747 7.32 MB/sec execute 288 sec latency 108.836 ms 2024-05-08T21:15:51.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 55928 7.35 MB/sec execute 289 sec latency 88.630 ms 2024-05-08T21:15:52.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 56147 7.40 MB/sec execute 290 sec latency 138.936 ms 2024-05-08T21:15:53.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 56341 7.43 MB/sec execute 291 sec latency 142.479 ms 2024-05-08T21:15:54.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 56501 7.44 MB/sec execute 292 sec latency 150.215 ms 2024-05-08T21:15:55.871 INFO:tasks.workunit.client.0.smithi135.stdout: 10 56549 7.42 MB/sec execute 293 sec latency 115.480 ms 2024-05-08T21:15:56.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 56613 7.41 MB/sec execute 294 sec latency 102.908 ms 2024-05-08T21:15:57.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 56714 7.42 MB/sec execute 295 sec latency 93.989 ms 2024-05-08T21:15:58.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 56878 7.45 MB/sec execute 296 sec latency 124.053 ms 2024-05-08T21:15:59.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57014 7.45 MB/sec execute 297 sec latency 110.823 ms 2024-05-08T21:16:00.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57116 7.44 MB/sec execute 298 sec latency 137.974 ms 2024-05-08T21:16:01.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57207 7.42 MB/sec execute 299 sec latency 136.463 ms 2024-05-08T21:16:02.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57300 7.40 MB/sec execute 300 sec latency 129.768 ms 2024-05-08T21:16:03.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57391 7.38 MB/sec execute 301 sec latency 201.010 ms 2024-05-08T21:16:04.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57480 7.36 MB/sec execute 302 sec latency 205.201 ms 2024-05-08T21:16:05.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57594 7.35 MB/sec execute 303 sec latency 198.976 ms 2024-05-08T21:16:06.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57713 7.33 MB/sec execute 304 sec latency 160.080 ms 2024-05-08T21:16:07.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57816 7.32 MB/sec execute 305 sec latency 243.735 ms 2024-05-08T21:16:08.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 57951 7.34 MB/sec execute 306 sec latency 140.167 ms 2024-05-08T21:16:09.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 58092 7.34 MB/sec execute 307 sec latency 141.854 ms 2024-05-08T21:16:10.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 58253 7.37 MB/sec execute 308 sec latency 146.732 ms 2024-05-08T21:16:11.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 58403 7.35 MB/sec execute 309 sec latency 95.714 ms 2024-05-08T21:16:12.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 58551 7.33 MB/sec execute 310 sec latency 105.933 ms 2024-05-08T21:16:13.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 58709 7.32 MB/sec execute 311 sec latency 107.132 ms 2024-05-08T21:16:14.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 58861 7.30 MB/sec execute 312 sec latency 162.573 ms 2024-05-08T21:16:15.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 59005 7.29 MB/sec execute 313 sec latency 119.337 ms 2024-05-08T21:16:16.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 59162 7.30 MB/sec execute 314 sec latency 87.918 ms 2024-05-08T21:16:17.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 59280 7.30 MB/sec execute 315 sec latency 116.407 ms 2024-05-08T21:16:18.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 59426 7.32 MB/sec execute 316 sec latency 115.699 ms 2024-05-08T21:16:19.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 59622 7.35 MB/sec execute 317 sec latency 125.335 ms 2024-05-08T21:16:20.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 59862 7.40 MB/sec execute 318 sec latency 106.667 ms 2024-05-08T21:16:21.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60034 7.40 MB/sec execute 319 sec latency 127.975 ms 2024-05-08T21:16:22.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60084 7.39 MB/sec execute 320 sec latency 151.700 ms 2024-05-08T21:16:23.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60144 7.38 MB/sec execute 321 sec latency 100.800 ms 2024-05-08T21:16:24.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60235 7.39 MB/sec execute 322 sec latency 98.897 ms 2024-05-08T21:16:25.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60387 7.42 MB/sec execute 323 sec latency 123.550 ms 2024-05-08T21:16:26.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60528 7.42 MB/sec execute 324 sec latency 106.459 ms 2024-05-08T21:16:27.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60640 7.41 MB/sec execute 325 sec latency 116.229 ms 2024-05-08T21:16:28.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60731 7.40 MB/sec execute 326 sec latency 199.347 ms 2024-05-08T21:16:29.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60824 7.38 MB/sec execute 327 sec latency 127.177 ms 2024-05-08T21:16:30.872 INFO:tasks.workunit.client.0.smithi135.stdout: 10 60926 7.36 MB/sec execute 328 sec latency 141.794 ms 2024-05-08T21:16:31.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61029 7.34 MB/sec execute 329 sec latency 238.045 ms 2024-05-08T21:16:32.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61146 7.33 MB/sec execute 330 sec latency 143.958 ms 2024-05-08T21:16:33.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61259 7.31 MB/sec execute 331 sec latency 185.958 ms 2024-05-08T21:16:34.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61356 7.30 MB/sec execute 332 sec latency 231.634 ms 2024-05-08T21:16:35.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61493 7.32 MB/sec execute 333 sec latency 145.984 ms 2024-05-08T21:16:36.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61625 7.31 MB/sec execute 334 sec latency 111.742 ms 2024-05-08T21:16:37.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61780 7.33 MB/sec execute 335 sec latency 114.599 ms 2024-05-08T21:16:38.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 61926 7.33 MB/sec execute 336 sec latency 139.511 ms 2024-05-08T21:16:39.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 62071 7.31 MB/sec execute 337 sec latency 95.801 ms 2024-05-08T21:16:40.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 62238 7.30 MB/sec execute 338 sec latency 95.778 ms 2024-05-08T21:16:41.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 62389 7.29 MB/sec execute 339 sec latency 92.340 ms 2024-05-08T21:16:42.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 62526 7.27 MB/sec execute 340 sec latency 99.874 ms 2024-05-08T21:16:43.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 62685 7.28 MB/sec execute 341 sec latency 113.081 ms 2024-05-08T21:16:44.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 62807 7.28 MB/sec execute 342 sec latency 114.289 ms 2024-05-08T21:16:45.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 62955 7.29 MB/sec execute 343 sec latency 94.246 ms 2024-05-08T21:16:46.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63153 7.32 MB/sec execute 344 sec latency 140.761 ms 2024-05-08T21:16:47.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63385 7.36 MB/sec execute 345 sec latency 99.454 ms 2024-05-08T21:16:48.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63563 7.37 MB/sec execute 346 sec latency 119.997 ms 2024-05-08T21:16:49.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63632 7.36 MB/sec execute 347 sec latency 147.512 ms 2024-05-08T21:16:50.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63697 7.36 MB/sec execute 348 sec latency 109.258 ms 2024-05-08T21:16:51.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63760 7.35 MB/sec execute 349 sec latency 98.230 ms 2024-05-08T21:16:52.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 63898 7.37 MB/sec execute 350 sec latency 112.617 ms 2024-05-08T21:16:53.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64058 7.39 MB/sec execute 351 sec latency 119.837 ms 2024-05-08T21:16:54.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64160 7.38 MB/sec execute 352 sec latency 147.717 ms 2024-05-08T21:16:55.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64249 7.37 MB/sec execute 353 sec latency 150.914 ms 2024-05-08T21:16:56.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64337 7.35 MB/sec execute 354 sec latency 130.031 ms 2024-05-08T21:16:57.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64429 7.33 MB/sec execute 355 sec latency 149.766 ms 2024-05-08T21:16:58.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64525 7.32 MB/sec execute 356 sec latency 257.074 ms 2024-05-08T21:16:59.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64640 7.31 MB/sec execute 357 sec latency 135.837 ms 2024-05-08T21:17:00.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64759 7.29 MB/sec execute 358 sec latency 184.158 ms 2024-05-08T21:17:01.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 64863 7.28 MB/sec execute 359 sec latency 253.853 ms 2024-05-08T21:17:02.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 65002 7.30 MB/sec execute 360 sec latency 151.622 ms 2024-05-08T21:17:03.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 65123 7.28 MB/sec execute 361 sec latency 124.342 ms 2024-05-08T21:17:04.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 65259 7.29 MB/sec execute 362 sec latency 127.413 ms 2024-05-08T21:17:05.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 65428 7.31 MB/sec execute 363 sec latency 108.776 ms 2024-05-08T21:17:06.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 65562 7.30 MB/sec execute 364 sec latency 114.060 ms 2024-05-08T21:17:07.873 INFO:tasks.workunit.client.0.smithi135.stdout: 10 65714 7.28 MB/sec execute 365 sec latency 101.615 ms 2024-05-08T21:17:08.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 65876 7.27 MB/sec execute 366 sec latency 94.227 ms 2024-05-08T21:17:09.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 66016 7.25 MB/sec execute 367 sec latency 106.510 ms 2024-05-08T21:17:10.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 66169 7.25 MB/sec execute 368 sec latency 102.960 ms 2024-05-08T21:17:11.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 66301 7.26 MB/sec execute 369 sec latency 124.774 ms 2024-05-08T21:17:12.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 66430 7.26 MB/sec execute 370 sec latency 113.996 ms 2024-05-08T21:17:13.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 66582 7.26 MB/sec execute 371 sec latency 137.897 ms 2024-05-08T21:17:14.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 66776 7.32 MB/sec execute 372 sec latency 99.201 ms 2024-05-08T21:17:15.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 66943 7.33 MB/sec execute 373 sec latency 113.253 ms 2024-05-08T21:17:16.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67153 7.34 MB/sec execute 374 sec latency 179.171 ms 2024-05-08T21:17:17.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67213 7.34 MB/sec execute 375 sec latency 80.697 ms 2024-05-08T21:17:18.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67265 7.32 MB/sec execute 376 sec latency 96.377 ms 2024-05-08T21:17:19.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67319 7.31 MB/sec execute 377 sec latency 140.423 ms 2024-05-08T21:17:20.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67494 7.36 MB/sec execute 378 sec latency 155.007 ms 2024-05-08T21:17:21.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67632 7.35 MB/sec execute 379 sec latency 118.868 ms 2024-05-08T21:17:22.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67736 7.35 MB/sec execute 380 sec latency 121.367 ms 2024-05-08T21:17:23.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67833 7.33 MB/sec execute 381 sec latency 139.654 ms 2024-05-08T21:17:24.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 67914 7.32 MB/sec execute 382 sec latency 190.816 ms 2024-05-08T21:17:25.874 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68012 7.30 MB/sec execute 383 sec latency 119.651 ms 2024-05-08T21:17:26.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68130 7.28 MB/sec execute 384 sec latency 177.836 ms 2024-05-08T21:17:27.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68251 7.27 MB/sec execute 385 sec latency 144.464 ms 2024-05-08T21:17:28.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68364 7.26 MB/sec execute 386 sec latency 226.148 ms 2024-05-08T21:17:29.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68480 7.27 MB/sec execute 387 sec latency 227.774 ms 2024-05-08T21:17:30.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68620 7.27 MB/sec execute 388 sec latency 103.714 ms 2024-05-08T21:17:31.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68760 7.26 MB/sec execute 389 sec latency 103.336 ms 2024-05-08T21:17:32.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 68947 7.30 MB/sec execute 390 sec latency 99.662 ms 2024-05-08T21:17:33.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 69077 7.28 MB/sec execute 391 sec latency 100.895 ms 2024-05-08T21:17:34.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 69199 7.26 MB/sec execute 392 sec latency 136.357 ms 2024-05-08T21:17:35.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 69376 7.25 MB/sec execute 393 sec latency 92.667 ms 2024-05-08T21:17:36.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 69521 7.24 MB/sec execute 394 sec latency 107.015 ms 2024-05-08T21:17:37.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 69673 7.23 MB/sec execute 395 sec latency 85.228 ms 2024-05-08T21:17:38.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 69847 7.25 MB/sec execute 396 sec latency 90.526 ms 2024-05-08T21:17:39.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 69977 7.25 MB/sec execute 397 sec latency 101.799 ms 2024-05-08T21:17:40.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 70122 7.25 MB/sec execute 398 sec latency 201.147 ms 2024-05-08T21:17:41.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 70317 7.30 MB/sec execute 399 sec latency 116.338 ms 2024-05-08T21:17:42.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 70526 7.31 MB/sec execute 400 sec latency 110.010 ms 2024-05-08T21:17:43.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 70719 7.33 MB/sec execute 401 sec latency 157.253 ms 2024-05-08T21:17:44.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 70794 7.33 MB/sec execute 402 sec latency 94.311 ms 2024-05-08T21:17:45.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 70847 7.31 MB/sec execute 403 sec latency 106.578 ms 2024-05-08T21:17:46.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 70970 7.33 MB/sec execute 404 sec latency 103.998 ms 2024-05-08T21:17:47.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71149 7.35 MB/sec execute 405 sec latency 97.369 ms 2024-05-08T21:17:48.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71271 7.35 MB/sec execute 406 sec latency 108.756 ms 2024-05-08T21:17:49.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71360 7.33 MB/sec execute 407 sec latency 122.892 ms 2024-05-08T21:17:50.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71444 7.32 MB/sec execute 408 sec latency 192.460 ms 2024-05-08T21:17:51.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71535 7.30 MB/sec execute 409 sec latency 198.179 ms 2024-05-08T21:17:52.875 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71642 7.29 MB/sec execute 410 sec latency 128.810 ms 2024-05-08T21:17:53.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71761 7.28 MB/sec execute 411 sec latency 136.684 ms 2024-05-08T21:17:54.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 71905 7.27 MB/sec execute 412 sec latency 152.759 ms 2024-05-08T21:17:55.868 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:17:55.871 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:17:55.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72011 7.27 MB/sec execute 413 sec latency 275.440 ms 2024-05-08T21:17:56.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72152 7.27 MB/sec execute 414 sec latency 92.443 ms 2024-05-08T21:17:57.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72298 7.27 MB/sec execute 415 sec latency 102.400 ms 2024-05-08T21:17:58.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72480 7.30 MB/sec execute 416 sec latency 130.400 ms 2024-05-08T21:17:59.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72629 7.29 MB/sec execute 417 sec latency 94.453 ms 2024-05-08T21:18:00.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72768 7.27 MB/sec execute 418 sec latency 114.673 ms 2024-05-08T21:18:01.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 72943 7.26 MB/sec execute 419 sec latency 98.141 ms 2024-05-08T21:18:02.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 73097 7.25 MB/sec execute 420 sec latency 91.093 ms 2024-05-08T21:18:03.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 73248 7.24 MB/sec execute 421 sec latency 145.381 ms 2024-05-08T21:18:04.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 73444 7.26 MB/sec execute 422 sec latency 72.812 ms 2024-05-08T21:18:05.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 73576 7.26 MB/sec execute 423 sec latency 94.045 ms 2024-05-08T21:18:06.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 73721 7.27 MB/sec execute 424 sec latency 124.641 ms 2024-05-08T21:18:07.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 73909 7.31 MB/sec execute 425 sec latency 83.888 ms 2024-05-08T21:18:08.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74086 7.32 MB/sec execute 426 sec latency 115.013 ms 2024-05-08T21:18:09.876 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74314 7.34 MB/sec execute 427 sec latency 125.966 ms 2024-05-08T21:18:10.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74383 7.33 MB/sec execute 428 sec latency 88.598 ms 2024-05-08T21:18:11.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74428 7.32 MB/sec execute 429 sec latency 91.649 ms 2024-05-08T21:18:12.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74517 7.31 MB/sec execute 430 sec latency 92.712 ms 2024-05-08T21:18:13.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74693 7.34 MB/sec execute 431 sec latency 132.115 ms 2024-05-08T21:18:14.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74842 7.35 MB/sec execute 432 sec latency 106.214 ms 2024-05-08T21:18:15.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 74934 7.33 MB/sec execute 433 sec latency 199.825 ms 2024-05-08T21:18:16.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75036 7.32 MB/sec execute 434 sec latency 102.156 ms 2024-05-08T21:18:17.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75129 7.31 MB/sec execute 435 sec latency 146.902 ms 2024-05-08T21:18:18.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75241 7.30 MB/sec execute 436 sec latency 137.990 ms 2024-05-08T21:18:19.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75347 7.28 MB/sec execute 437 sec latency 172.749 ms 2024-05-08T21:18:20.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75496 7.29 MB/sec execute 438 sec latency 168.703 ms 2024-05-08T21:18:21.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75604 7.28 MB/sec execute 439 sec latency 278.093 ms 2024-05-08T21:18:22.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75742 7.28 MB/sec execute 440 sec latency 92.278 ms 2024-05-08T21:18:23.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 75886 7.27 MB/sec execute 441 sec latency 102.106 ms 2024-05-08T21:18:24.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 76058 7.30 MB/sec execute 442 sec latency 139.444 ms 2024-05-08T21:18:25.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 76202 7.29 MB/sec execute 443 sec latency 86.229 ms 2024-05-08T21:18:26.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:18:26.456 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:18:26.525 INFO:tasks.ceph.mds.b.smithi183.stderr:2024-05-08T21:18:26.523+0000 7f45113a8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54006) UID: 0 2024-05-08T21:18:26.526 INFO:tasks.ceph.mds.d.smithi183.stderr:2024-05-08T21:18:26.523+0000 7f4edd07a700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54006) UID: 0 2024-05-08T21:18:26.526 INFO:tasks.ceph.mds.f.smithi183.stderr:2024-05-08T21:18:26.523+0000 7f1bb1cae700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54006) UID: 0 2024-05-08T21:18:26.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 76331 7.28 MB/sec execute 444 sec latency 122.245 ms 2024-05-08T21:18:27.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 76496 7.27 MB/sec execute 445 sec latency 113.229 ms 2024-05-08T21:18:28.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 76622 7.26 MB/sec execute 446 sec latency 103.767 ms 2024-05-08T21:18:29.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 76766 7.25 MB/sec execute 447 sec latency 103.336 ms 2024-05-08T21:18:30.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 76953 7.26 MB/sec execute 448 sec latency 115.254 ms 2024-05-08T21:18:31.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77074 7.26 MB/sec execute 449 sec latency 168.989 ms 2024-05-08T21:18:32.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77203 7.26 MB/sec execute 450 sec latency 124.911 ms 2024-05-08T21:18:33.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77328 7.27 MB/sec execute 451 sec latency 106.624 ms 2024-05-08T21:18:34.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77529 7.30 MB/sec execute 452 sec latency 100.935 ms 2024-05-08T21:18:35.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77706 7.31 MB/sec execute 453 sec latency 130.315 ms 2024-05-08T21:18:36.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77902 7.33 MB/sec execute 454 sec latency 122.668 ms 2024-05-08T21:18:37.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 77952 7.32 MB/sec execute 455 sec latency 113.991 ms 2024-05-08T21:18:38.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78007 7.31 MB/sec execute 456 sec latency 104.509 ms 2024-05-08T21:18:39.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78095 7.31 MB/sec execute 457 sec latency 117.060 ms 2024-05-08T21:18:40.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78239 7.33 MB/sec execute 458 sec latency 187.225 ms 2024-05-08T21:18:41.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78372 7.32 MB/sec execute 459 sec latency 134.777 ms 2024-05-08T21:18:42.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78482 7.32 MB/sec execute 460 sec latency 106.586 ms 2024-05-08T21:18:43.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78574 7.31 MB/sec execute 461 sec latency 190.869 ms 2024-05-08T21:18:44.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78667 7.30 MB/sec execute 462 sec latency 151.619 ms 2024-05-08T21:18:45.877 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78773 7.28 MB/sec execute 463 sec latency 150.984 ms 2024-05-08T21:18:46.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 78880 7.27 MB/sec execute 464 sec latency 197.158 ms 2024-05-08T21:18:47.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79006 7.27 MB/sec execute 465 sec latency 207.232 ms 2024-05-08T21:18:48.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79111 7.26 MB/sec execute 466 sec latency 256.675 ms 2024-05-08T21:18:49.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79238 7.26 MB/sec execute 467 sec latency 112.785 ms 2024-05-08T21:18:50.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79389 7.26 MB/sec execute 468 sec latency 110.874 ms 2024-05-08T21:18:51.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79538 7.26 MB/sec execute 469 sec latency 109.553 ms 2024-05-08T21:18:52.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79698 7.28 MB/sec execute 470 sec latency 106.663 ms 2024-05-08T21:18:53.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79838 7.27 MB/sec execute 471 sec latency 105.232 ms 2024-05-08T21:18:54.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 79974 7.26 MB/sec execute 472 sec latency 112.813 ms 2024-05-08T21:18:55.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 80126 7.25 MB/sec execute 473 sec latency 105.325 ms 2024-05-08T21:18:56.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 80279 7.24 MB/sec execute 474 sec latency 122.526 ms 2024-05-08T21:18:57.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 80450 7.25 MB/sec execute 475 sec latency 101.289 ms 2024-05-08T21:18:58.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 80613 7.25 MB/sec execute 476 sec latency 117.643 ms 2024-05-08T21:18:59.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 80724 7.25 MB/sec execute 477 sec latency 118.703 ms 2024-05-08T21:19:00.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 80840 7.25 MB/sec execute 478 sec latency 97.541 ms 2024-05-08T21:19:01.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 80997 7.27 MB/sec execute 479 sec latency 138.989 ms 2024-05-08T21:19:02.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 81187 7.29 MB/sec execute 480 sec latency 123.695 ms 2024-05-08T21:19:03.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 81396 7.31 MB/sec execute 481 sec latency 144.577 ms 2024-05-08T21:19:04.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 81479 7.30 MB/sec execute 482 sec latency 131.695 ms 2024-05-08T21:19:05.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 81536 7.30 MB/sec execute 483 sec latency 120.238 ms 2024-05-08T21:19:06.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 81602 7.29 MB/sec execute 484 sec latency 102.534 ms 2024-05-08T21:19:07.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 81729 7.30 MB/sec execute 485 sec latency 122.750 ms 2024-05-08T21:19:08.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 81880 7.31 MB/sec execute 486 sec latency 132.586 ms 2024-05-08T21:19:09.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82006 7.31 MB/sec execute 487 sec latency 160.212 ms 2024-05-08T21:19:10.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82092 7.29 MB/sec execute 488 sec latency 190.058 ms 2024-05-08T21:19:11.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82191 7.28 MB/sec execute 489 sec latency 137.127 ms 2024-05-08T21:19:12.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82281 7.27 MB/sec execute 490 sec latency 124.338 ms 2024-05-08T21:19:13.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82372 7.26 MB/sec execute 491 sec latency 176.958 ms 2024-05-08T21:19:14.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82500 7.26 MB/sec execute 492 sec latency 169.627 ms 2024-05-08T21:19:15.878 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82625 7.25 MB/sec execute 493 sec latency 188.388 ms 2024-05-08T21:19:16.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82729 7.24 MB/sec execute 494 sec latency 227.236 ms 2024-05-08T21:19:17.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 82874 7.25 MB/sec execute 495 sec latency 126.853 ms 2024-05-08T21:19:18.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 83001 7.24 MB/sec execute 496 sec latency 113.740 ms 2024-05-08T21:19:19.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 83163 7.25 MB/sec execute 497 sec latency 99.422 ms 2024-05-08T21:19:20.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 83326 7.25 MB/sec execute 498 sec latency 107.751 ms 2024-05-08T21:19:21.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 83447 7.25 MB/sec execute 499 sec latency 138.183 ms 2024-05-08T21:19:22.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 83598 7.23 MB/sec execute 500 sec latency 108.105 ms 2024-05-08T21:19:23.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 83737 7.23 MB/sec execute 501 sec latency 145.948 ms 2024-05-08T21:19:24.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 83908 7.23 MB/sec execute 502 sec latency 162.271 ms 2024-05-08T21:19:25.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 84053 7.23 MB/sec execute 503 sec latency 99.228 ms 2024-05-08T21:19:26.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 84206 7.23 MB/sec execute 504 sec latency 151.324 ms 2024-05-08T21:19:27.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 84320 7.23 MB/sec execute 505 sec latency 106.042 ms 2024-05-08T21:19:28.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 84452 7.24 MB/sec execute 506 sec latency 102.000 ms 2024-05-08T21:19:29.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 84650 7.27 MB/sec execute 507 sec latency 97.435 ms 2024-05-08T21:19:30.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 84863 7.29 MB/sec execute 508 sec latency 105.208 ms 2024-05-08T21:19:31.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85023 7.29 MB/sec execute 509 sec latency 147.388 ms 2024-05-08T21:19:32.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85080 7.29 MB/sec execute 510 sec latency 112.450 ms 2024-05-08T21:19:33.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85137 7.27 MB/sec execute 511 sec latency 93.117 ms 2024-05-08T21:19:34.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85233 7.27 MB/sec execute 512 sec latency 114.483 ms 2024-05-08T21:19:35.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85400 7.29 MB/sec execute 513 sec latency 130.548 ms 2024-05-08T21:19:36.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85530 7.29 MB/sec execute 514 sec latency 151.449 ms 2024-05-08T21:19:37.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85622 7.28 MB/sec execute 515 sec latency 173.399 ms 2024-05-08T21:19:38.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85719 7.27 MB/sec execute 516 sec latency 132.355 ms 2024-05-08T21:19:39.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85803 7.26 MB/sec execute 517 sec latency 227.684 ms 2024-05-08T21:19:40.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 85916 7.25 MB/sec execute 518 sec latency 133.959 ms 2024-05-08T21:19:41.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 86041 7.25 MB/sec execute 519 sec latency 173.244 ms 2024-05-08T21:19:42.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 86159 7.24 MB/sec execute 520 sec latency 209.939 ms 2024-05-08T21:19:43.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 86263 7.23 MB/sec execute 521 sec latency 240.554 ms 2024-05-08T21:19:44.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 86411 7.24 MB/sec execute 522 sec latency 105.364 ms 2024-05-08T21:19:45.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 86545 7.23 MB/sec execute 523 sec latency 93.530 ms 2024-05-08T21:19:46.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 86696 7.23 MB/sec execute 524 sec latency 128.569 ms 2024-05-08T21:19:47.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 86864 7.24 MB/sec execute 525 sec latency 115.673 ms 2024-05-08T21:19:48.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 87001 7.24 MB/sec execute 526 sec latency 138.964 ms 2024-05-08T21:19:49.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 87146 7.23 MB/sec execute 527 sec latency 112.904 ms 2024-05-08T21:19:50.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 87294 7.22 MB/sec execute 528 sec latency 99.968 ms 2024-05-08T21:19:51.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 87466 7.22 MB/sec execute 529 sec latency 122.164 ms 2024-05-08T21:19:52.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 87615 7.22 MB/sec execute 530 sec latency 120.152 ms 2024-05-08T21:19:53.879 INFO:tasks.workunit.client.0.smithi135.stdout: 10 87772 7.23 MB/sec execute 531 sec latency 122.567 ms 2024-05-08T21:19:54.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 87878 7.23 MB/sec execute 532 sec latency 127.349 ms 2024-05-08T21:19:55.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88032 7.24 MB/sec execute 533 sec latency 95.503 ms 2024-05-08T21:19:56.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88226 7.26 MB/sec execute 534 sec latency 121.702 ms 2024-05-08T21:19:57.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88448 7.28 MB/sec execute 535 sec latency 123.391 ms 2024-05-08T21:19:58.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88572 7.28 MB/sec execute 536 sec latency 131.153 ms 2024-05-08T21:19:59.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88630 7.28 MB/sec execute 537 sec latency 141.917 ms 2024-05-08T21:20:00.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88691 7.27 MB/sec execute 538 sec latency 114.922 ms 2024-05-08T21:20:01.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88790 7.26 MB/sec execute 539 sec latency 101.859 ms 2024-05-08T21:20:02.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 88949 7.28 MB/sec execute 540 sec latency 136.905 ms 2024-05-08T21:20:03.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89067 7.28 MB/sec execute 541 sec latency 173.122 ms 2024-05-08T21:20:04.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89163 7.27 MB/sec execute 542 sec latency 182.970 ms 2024-05-08T21:20:05.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89258 7.26 MB/sec execute 543 sec latency 140.626 ms 2024-05-08T21:20:06.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89341 7.25 MB/sec execute 544 sec latency 226.871 ms 2024-05-08T21:20:07.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89442 7.24 MB/sec execute 545 sec latency 255.639 ms 2024-05-08T21:20:08.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89566 7.24 MB/sec execute 546 sec latency 173.274 ms 2024-05-08T21:20:09.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89668 7.23 MB/sec execute 547 sec latency 216.291 ms 2024-05-08T21:20:10.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89774 7.22 MB/sec execute 548 sec latency 228.191 ms 2024-05-08T21:20:11.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 89898 7.22 MB/sec execute 549 sec latency 249.434 ms 2024-05-08T21:20:12.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 90026 7.22 MB/sec execute 550 sec latency 141.422 ms 2024-05-08T21:20:13.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 90178 7.22 MB/sec execute 551 sec latency 105.876 ms 2024-05-08T21:20:14.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 90334 7.23 MB/sec execute 552 sec latency 108.924 ms 2024-05-08T21:20:15.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 90486 7.23 MB/sec execute 553 sec latency 106.780 ms 2024-05-08T21:20:16.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 90612 7.22 MB/sec execute 554 sec latency 113.088 ms 2024-05-08T21:20:17.880 INFO:tasks.workunit.client.0.smithi135.stdout: 10 90775 7.21 MB/sec execute 555 sec latency 105.368 ms 2024-05-08T21:20:18.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 90918 7.21 MB/sec execute 556 sec latency 106.038 ms 2024-05-08T21:20:19.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 91084 7.21 MB/sec execute 557 sec latency 136.676 ms 2024-05-08T21:20:20.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 91258 7.21 MB/sec execute 558 sec latency 104.781 ms 2024-05-08T21:20:21.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 91364 7.22 MB/sec execute 559 sec latency 164.747 ms 2024-05-08T21:20:22.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 91476 7.21 MB/sec execute 560 sec latency 116.470 ms 2024-05-08T21:20:23.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 91623 7.22 MB/sec execute 561 sec latency 105.462 ms 2024-05-08T21:20:24.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 91849 7.25 MB/sec execute 562 sec latency 110.191 ms 2024-05-08T21:20:25.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 91999 7.26 MB/sec execute 563 sec latency 143.153 ms 2024-05-08T21:20:26.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92129 7.26 MB/sec execute 564 sec latency 154.519 ms 2024-05-08T21:20:27.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92195 7.25 MB/sec execute 565 sec latency 105.262 ms 2024-05-08T21:20:28.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92262 7.25 MB/sec execute 566 sec latency 119.010 ms 2024-05-08T21:20:29.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92369 7.25 MB/sec execute 567 sec latency 134.141 ms 2024-05-08T21:20:30.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92517 7.26 MB/sec execute 568 sec latency 125.829 ms 2024-05-08T21:20:31.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92630 7.26 MB/sec execute 569 sec latency 203.450 ms 2024-05-08T21:20:32.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92734 7.25 MB/sec execute 570 sec latency 150.847 ms 2024-05-08T21:20:33.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92836 7.25 MB/sec execute 571 sec latency 116.264 ms 2024-05-08T21:20:34.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 92934 7.23 MB/sec execute 572 sec latency 207.788 ms 2024-05-08T21:20:35.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 93057 7.23 MB/sec execute 573 sec latency 180.568 ms 2024-05-08T21:20:36.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 93167 7.22 MB/sec execute 574 sec latency 196.879 ms 2024-05-08T21:20:37.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 93288 7.22 MB/sec execute 575 sec latency 211.039 ms 2024-05-08T21:20:38.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 93406 7.22 MB/sec execute 576 sec latency 239.266 ms 2024-05-08T21:20:39.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 93543 7.21 MB/sec execute 577 sec latency 198.589 ms 2024-05-08T21:20:40.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 93705 7.21 MB/sec execute 578 sec latency 94.294 ms 2024-05-08T21:20:41.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 93861 7.21 MB/sec execute 579 sec latency 95.085 ms 2024-05-08T21:20:42.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94025 7.22 MB/sec execute 580 sec latency 116.116 ms 2024-05-08T21:20:43.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94157 7.21 MB/sec execute 581 sec latency 110.148 ms 2024-05-08T21:20:44.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94331 7.21 MB/sec execute 582 sec latency 91.319 ms 2024-05-08T21:20:45.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94503 7.21 MB/sec execute 583 sec latency 123.449 ms 2024-05-08T21:20:46.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94681 7.21 MB/sec execute 584 sec latency 95.684 ms 2024-05-08T21:20:47.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94835 7.21 MB/sec execute 585 sec latency 97.720 ms 2024-05-08T21:20:48.881 INFO:tasks.workunit.client.0.smithi135.stdout: 10 94941 7.21 MB/sec execute 586 sec latency 116.269 ms 2024-05-08T21:20:49.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 95074 7.22 MB/sec execute 587 sec latency 112.476 ms 2024-05-08T21:20:50.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 95210 7.22 MB/sec execute 588 sec latency 103.145 ms 2024-05-08T21:20:51.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 95470 7.26 MB/sec execute 589 sec latency 97.066 ms 2024-05-08T21:20:52.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 95639 7.26 MB/sec execute 590 sec latency 126.072 ms 2024-05-08T21:20:53.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 95723 7.26 MB/sec execute 591 sec latency 123.989 ms 2024-05-08T21:20:54.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 95775 7.25 MB/sec execute 592 sec latency 181.072 ms 2024-05-08T21:20:55.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 95867 7.25 MB/sec execute 593 sec latency 137.923 ms 2024-05-08T21:20:56.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 96022 7.26 MB/sec execute 594 sec latency 107.276 ms 2024-05-08T21:20:57.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 96143 7.26 MB/sec execute 595 sec latency 180.621 ms 2024-05-08T21:20:58.882 INFO:tasks.workunit.client.0.smithi135.stdout: 10 96262 7.26 MB/sec execute 596 sec latency 181.541 ms 2024-05-08T21:20:59.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 96349 7.25 MB/sec execute 597 sec latency 223.671 ms 2024-05-08T21:21:00.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 96451 7.24 MB/sec execute 598 sec latency 246.868 ms 2024-05-08T21:21:01.802 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:21:01.809 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:21:01.883 INFO:tasks.workunit.client.0.smithi135.stdout: 10 96559 7.23 MB/sec execute 599 sec latency 171.906 ms 2024-05-08T21:21:02.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 600 sec 2024-05-08T21:21:03.885 INFO:tasks.workunit.client.0.smithi135.stdout: 10 cleanup 601 sec 2024-05-08T21:21:04.441 INFO:tasks.workunit.client.0.smithi135.stdout: 0 cleanup 602 sec 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Operation Count AvgLat MaxLat 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: ---------------------------------------- 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: NTCreateX 138301 10.186 195.919 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Close 101227 0.159 10.126 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Rename 5870 23.367 261.235 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Unlink 28206 8.338 115.761 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Qpathinfo 125083 5.580 164.661 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Qfileinfo 21783 0.268 8.217 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Qfsinfo 23182 0.664 34.503 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Sfileinfo 11168 1.963 52.231 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: Find 48505 67.892 398.066 2024-05-08T21:21:04.442 INFO:tasks.workunit.client.0.smithi135.stdout: WriteX 68181 0.514 61.899 2024-05-08T21:21:04.443 INFO:tasks.workunit.client.0.smithi135.stdout: ReadX 218185 0.007 6.346 2024-05-08T21:21:04.443 INFO:tasks.workunit.client.0.smithi135.stdout: LockX 460 3.458 36.794 2024-05-08T21:21:04.443 INFO:tasks.workunit.client.0.smithi135.stdout: UnlockX 460 3.176 33.303 2024-05-08T21:21:04.443 INFO:tasks.workunit.client.0.smithi135.stdout: Flush 9667 13.185 291.871 2024-05-08T21:21:04.443 INFO:tasks.workunit.client.0.smithi135.stdout: 2024-05-08T21:21:04.443 INFO:tasks.workunit.client.0.smithi135.stdout:Throughput 7.23287 MB/sec 10 clients 10 procs max_latency=398.073 ms 2024-05-08T21:21:04.459 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T21:21:04.459 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T21:21:05.962 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-05-08T21:21:05.962 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T21:21:06.220 DEBUG:teuthology.parallel:result is None 2024-05-08T21:21:06.221 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T21:21:06.256 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T21:21:06.256 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-08T21:21:06.268 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-08T21:21:06.268 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T21:21:06.268 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:21:06.314 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T21:21:06.314 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:21:06.373 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:21:06.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.898+0000 7f9034ca9700 1 Processor -- start 2024-05-08T21:21:06.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.898+0000 7f9034ca9700 1 -- start start 2024-05-08T21:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.900+0000 7f9034ca9700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9030150400 0x7f90300c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f9034ca9700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9030156630 con 0x7f9030150020 2024-05-08T21:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f9034ca9700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90300713a0 con 0x7f90300c4b40 2024-05-08T21:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f9034ca9700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9030071be0 con 0x7f9030150400 2024-05-08T21:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f902dd9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9030150400 0x7f90300c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f902dd9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9030150400 0x7f90300c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34738/0 (socket says 172.21.15.135:34738) 2024-05-08T21:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f902dd9b700 1 -- 172.21.15.135:0/3649770737 learned_addr learned my addr 172.21.15.135:0/3649770737 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:06.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f902dd9b700 1 -- 172.21.15.135:0/3649770737 >> v1:172.21.15.183:6789/0 conn(0x7f90300c4b40 legacy=0x7f90300c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:06.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f902dd9b700 1 -- 172.21.15.135:0/3649770737 >> v1:172.21.15.135:6789/0 conn(0x7f9030150020 legacy=0x7f9030155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:06.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f902dd9b700 1 -- 172.21.15.135:0/3649770737 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90300c1f70 con 0x7f9030150400 2024-05-08T21:21:06.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.901+0000 7f902dd9b700 1 --2- 172.21.15.135:0/3649770737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300c7d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90240098f0 tx=0x7f9024009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf93992e081036b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:06.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.905+0000 7f902d59a700 1 -- 172.21.15.135:0/3649770737 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400f8a0 con 0x7f9030150400 2024-05-08T21:21:06.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.905+0000 7f902d59a700 1 -- 172.21.15.135:0/3649770737 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902400fa00 con 0x7f9030150400 2024-05-08T21:21:06.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.905+0000 7f902d59a700 1 -- 172.21.15.135:0/3649770737 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400fd90 con 0x7f9030150400 2024-05-08T21:21:06.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.906+0000 7f9034ca9700 1 -- 172.21.15.135:0/3649770737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 msgr2=0x7f90300c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:06.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.906+0000 7f9034ca9700 1 --2- 172.21.15.135:0/3649770737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300c7d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90240098f0 tx=0x7f9024009c00 comp rx=0 tx=0).stop 2024-05-08T21:21:06.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.907+0000 7f9034ca9700 1 -- 172.21.15.135:0/3649770737 shutdown_connections 2024-05-08T21:21:06.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.907+0000 7f9034ca9700 1 --2- 172.21.15.135:0/3649770737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300c7d00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:06.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.907+0000 7f9034ca9700 1 -- 172.21.15.135:0/3649770737 >> 172.21.15.135:0/3649770737 conn(0x7f903006a960 msgr2=0x7f903006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:06.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.908+0000 7f9034ca9700 1 -- 172.21.15.135:0/3649770737 shutdown_connections 2024-05-08T21:21:06.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.908+0000 7f9034ca9700 1 -- 172.21.15.135:0/3649770737 wait complete. 2024-05-08T21:21:06.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.909+0000 7f9034ca9700 1 Processor -- start 2024-05-08T21:21:06.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.909+0000 7f9034ca9700 1 -- start start 2024-05-08T21:21:06.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f9034ca9700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90300c4b40 0x7f90300ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:06.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f9034ca9700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9030150020 0x7f9030144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:06.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f9034ca9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:06.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f9034ca9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9030144030 con 0x7f9030150400 2024-05-08T21:21:06.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f9034ca9700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90301444d0 con 0x7f9030150020 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f9034ca9700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9030144a90 con 0x7f90300c4b40 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f902ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f902ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34740/0 (socket says 172.21.15.135:34740) 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.910+0000 7f902ed9d700 1 -- 172.21.15.135:0/1340129234 learned_addr learned my addr 172.21.15.135:0/1340129234 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f902ed9d700 1 -- 172.21.15.135:0/1340129234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90300c4b40 msgr2=0x7f90300ca130 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f902ed9d700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90300c4b40 0x7f90300ca130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f902ed9d700 1 -- 172.21.15.135:0/1340129234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9030150020 msgr2=0x7f9030144f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f902ed9d700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9030150020 0x7f9030144f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f902ed9d700 1 -- 172.21.15.135:0/1340129234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024009550 con 0x7f9030150400 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f902ed9d700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300caec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f902800cc80 tx=0x7f902800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f901effd700 1 -- 172.21.15.135:0/1340129234 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800ad40 con 0x7f9030150400 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f901effd700 1 -- 172.21.15.135:0/1340129234 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902800ce80 con 0x7f9030150400 2024-05-08T21:21:06.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9030146300 con 0x7f9030150400 2024-05-08T21:21:06.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f901effd700 1 -- 172.21.15.135:0/1340129234 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800aea0 con 0x7f9030150400 2024-05-08T21:21:06.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.911+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9030155d90 con 0x7f9030150400 2024-05-08T21:21:06.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.912+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9030067890 con 0x7f9030150400 2024-05-08T21:21:06.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.913+0000 7f901effd700 1 -- 172.21.15.135:0/1340129234 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9028003c20 con 0x7f9030150400 2024-05-08T21:21:06.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.914+0000 7f901effd700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f901006ac90 0x7f901006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:06.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.914+0000 7f901effd700 1 -- 172.21.15.135:0/1340129234 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9028089800 con 0x7f9030150400 2024-05-08T21:21:06.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.919+0000 7f902e59c700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f901006ac90 0x7f901006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:06.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.920+0000 7f901effd700 1 -- 172.21.15.135:0/1340129234 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9028054620 con 0x7f9030150400 2024-05-08T21:21:06.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:06.938+0000 7f902e59c700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f901006ac90 0x7f901006d150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9020001580 tx=0x7f9020007a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.121+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90300c7ef0 con 0x7f9030150400 2024-05-08T21:21:07.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.122+0000 7f901effd700 1 -- 172.21.15.135:0/1340129234 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18313 (secure 0 0 0) 0x7f9028057c40 con 0x7f9030150400 2024-05-08T21:21:07.125 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:07.125 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:41.588092+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f901006ac90 msgr2=0x7f901006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f901006ac90 0x7f901006d150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9020001580 tx=0x7f9020007a20 comp rx=0 tx=0).stop 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 msgr2=0x7f90300caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300caec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f902800cc80 tx=0x7f902800a340 comp rx=0 tx=0).stop 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 shutdown_connections 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f901006ac90 0x7f901006d150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9030150400 0x7f90300caec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f90300c4b40 0x7f90300ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 --2- 172.21.15.135:0/1340129234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9030150020 0x7f9030144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 >> 172.21.15.135:0/1340129234 conn(0x7f903006a960 msgr2=0x7f903014e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 shutdown_connections 2024-05-08T21:21:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.124+0000 7f9034ca9700 1 -- 172.21.15.135:0/1340129234 wait complete. 2024-05-08T21:21:07.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:54:57.947571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:54:58.988583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T20:55:02.098509+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:21:07.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:21:07.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.262+0000 7fbace5c1700 1 Processor -- start 2024-05-08T21:21:07.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.262+0000 7fbace5c1700 1 -- start start 2024-05-08T21:21:07.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbace5c1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac81530e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbace5c1700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbac8072770 0x7fbac8153620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbace5c1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbac815ced0 0x7fbac815d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbace5c1700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac815d8a0 con 0x7fbac8072770 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbace5c1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac815c9f0 con 0x7fbac815ced0 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbace5c1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80cbf50 con 0x7fbac8072390 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbac8072770 0x7fbac8153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fbac8072770 0x7fbac8153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34748/0 (socket says 172.21.15.135:34748) 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 -- 172.21.15.135:0/3881479435 learned_addr learned my addr 172.21.15.135:0/3881479435 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbaccb5e700 1 --2- 172.21.15.135:0/3881479435 >> v2:172.21.15.183:3300/0 conn(0x7fbac815ced0 0x7fbac815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac7fff700 1 --2- 172.21.15.135:0/3881479435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac81530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 -- 172.21.15.135:0/3881479435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 msgr2=0x7fbac81530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 --2- 172.21.15.135:0/3881479435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac81530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 -- 172.21.15.135:0/3881479435 >> v2:172.21.15.183:3300/0 conn(0x7fbac815ced0 msgr2=0x7fbac815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 --2- 172.21.15.135:0/3881479435 >> v2:172.21.15.183:3300/0 conn(0x7fbac815ced0 0x7fbac815d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 -- 172.21.15.135:0/3881479435 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80c2090 con 0x7fbac8072770 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac7fff700 1 --2- 172.21.15.135:0/3881479435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac81530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbaccb5e700 1 --2- 172.21.15.135:0/3881479435 >> v2:172.21.15.183:3300/0 conn(0x7fbac815ced0 0x7fbac815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.263+0000 7fbac77fe700 1 --2- 172.21.15.135:0/3881479435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8072770 0x7fbac8153620 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbac80b1de0 tx=0x7fbab8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d8bb84649ece10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbac6ffd700 1 -- 172.21.15.135:0/3881479435 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab800b870 con 0x7fbac8072770 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbac6ffd700 1 -- 172.21.15.135:0/3881479435 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab800b9d0 con 0x7fbac8072770 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbac6ffd700 1 -- 172.21.15.135:0/3881479435 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab800bd60 con 0x7fbac8072770 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 -- 172.21.15.135:0/3881479435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8072770 msgr2=0x7fbac8153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 --2- 172.21.15.135:0/3881479435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8072770 0x7fbac8153620 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbac80b1de0 tx=0x7fbab8009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 -- 172.21.15.135:0/3881479435 shutdown_connections 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 --2- 172.21.15.135:0/3881479435 >> v2:172.21.15.183:3300/0 conn(0x7fbac815ced0 0x7fbac815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 --2- 172.21.15.135:0/3881479435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac81530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 --2- 172.21.15.135:0/3881479435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac8072770 0x7fbac8153620 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 -- 172.21.15.135:0/3881479435 >> 172.21.15.135:0/3881479435 conn(0x7fbac806ec40 msgr2=0x7fbac806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 -- 172.21.15.135:0/3881479435 shutdown_connections 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.264+0000 7fbace5c1700 1 -- 172.21.15.135:0/3881479435 wait complete. 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.265+0000 7fbace5c1700 1 Processor -- start 2024-05-08T21:21:07.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.265+0000 7fbace5c1700 1 -- start start 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbace5c1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbace5c1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbac8072770 0x7fbac80cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbace5c1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac815ced0 0x7fbac814a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbace5c1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80cbd10 con 0x7fbac815ced0 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbace5c1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac814f4e0 con 0x7fbac8072770 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbace5c1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8159370 con 0x7fbac8072390 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbaccb5e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac815ced0 0x7fbac814a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbaccb5e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac815ced0 0x7fbac814a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34754/0 (socket says 172.21.15.135:34754) 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbaccb5e700 1 -- 172.21.15.135:0/2215618910 learned_addr learned my addr 172.21.15.135:0/2215618910 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbac7fff700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.266+0000 7fbac77fe700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbac8072770 0x7fbac80cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbaccb5e700 1 -- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 msgr2=0x7fbac814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbaccb5e700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbaccb5e700 1 -- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbac8072770 msgr2=0x7fbac80cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbaccb5e700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbac8072770 0x7fbac80cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbaccb5e700 1 -- 172.21.15.135:0/2215618910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8009550 con 0x7fbac815ced0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbaccb5e700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac815ced0 0x7fbac814a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbac000cef0 tx=0x7fbac000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbac4ff9700 1 -- 172.21.15.135:0/2215618910 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000ae50 con 0x7fbac815ced0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbac4ff9700 1 -- 172.21.15.135:0/2215618910 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0015440 con 0x7fbac815ced0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac8159650 con 0x7fbac815ced0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbac4ff9700 1 -- 172.21.15.135:0/2215618910 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00157f0 con 0x7fbac815ced0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.267+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac8159070 con 0x7fbac815ced0 2024-05-08T21:21:07.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.268+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac8067fa0 con 0x7fbac815ced0 2024-05-08T21:21:07.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.268+0000 7fbac4ff9700 1 -- 172.21.15.135:0/2215618910 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbac000d430 con 0x7fbac815ced0 2024-05-08T21:21:07.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.269+0000 7fbac4ff9700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fbab406ac90 0x7fbab406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.269+0000 7fbac4ff9700 1 -- 172.21.15.135:0/2215618910 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbac0089c90 con 0x7fbac815ced0 2024-05-08T21:21:07.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.269+0000 7fbac7fff700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fbab406ac90 0x7fbab406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.269+0000 7fbac7fff700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fbab406ac90 0x7fbab406d150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006fd0 tx=0x7fbabc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.273+0000 7fbac4ff9700 1 -- 172.21.15.135:0/2215618910 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbac0054ab0 con 0x7fbac815ced0 2024-05-08T21:21:07.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.469+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbac80c64f0 con 0x7fbac815ced0 2024-05-08T21:21:07.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.470+0000 7fbac4ff9700 1 -- 172.21.15.135:0/2215618910 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbac001a020 con 0x7fbac815ced0 2024-05-08T21:21:07.472 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T21:21:07.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fbab406ac90 msgr2=0x7fbab406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fbab406ac90 0x7fbab406d150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006fd0 tx=0x7fbabc008040 comp rx=0 tx=0).stop 2024-05-08T21:21:07.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac815ced0 msgr2=0x7fbac814a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac815ced0 0x7fbac814a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbac000cef0 tx=0x7fbac000a340 comp rx=0 tx=0).stop 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 shutdown_connections 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fbab406ac90 0x7fbab406d150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbac815ced0 0x7fbac814a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbac8072390 0x7fbac814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 --2- 172.21.15.135:0/2215618910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbac8072770 0x7fbac80cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 >> 172.21.15.135:0/2215618910 conn(0x7fbac806ec40 msgr2=0x7fbac80c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 shutdown_connections 2024-05-08T21:21:07.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.472+0000 7fbace5c1700 1 -- 172.21.15.135:0/2215618910 wait complete. 2024-05-08T21:21:07.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:21:07.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.609+0000 7f8dc413c700 1 Processor -- start 2024-05-08T21:21:07.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.609+0000 7f8dc413c700 1 -- start start 2024-05-08T21:21:07.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc413c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8dbc153650 0x7f8dbc0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc413c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8dbc0c9da0 0x7f8dbc15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc413c700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc159570 con 0x7f8dbc153270 2024-05-08T21:21:07.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc413c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc15a160 con 0x7f8dbc0c9da0 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc413c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc1597c0 con 0x7f8dbc153650 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc26d9700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8dbc0c9da0 0x7f8dbc15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc1ed8700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f8dbc153270 0x7f8dbc070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53264/0 (socket says 172.21.15.135:53264) 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.610+0000 7f8dc1ed8700 1 -- 172.21.15.135:0/2381735546 learned_addr learned my addr 172.21.15.135:0/2381735546 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc16d7700 1 --2- 172.21.15.135:0/2381735546 >> v2:172.21.15.183:3300/0 conn(0x7f8dbc153650 0x7f8dbc0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc26d9700 1 -- 172.21.15.135:0/2381735546 >> v2:172.21.15.183:3300/0 conn(0x7f8dbc153650 msgr2=0x7f8dbc0c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc26d9700 1 --2- 172.21.15.135:0/2381735546 >> v2:172.21.15.183:3300/0 conn(0x7f8dbc153650 0x7f8dbc0c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc26d9700 1 -- 172.21.15.135:0/2381735546 >> v1:172.21.15.135:6789/0 conn(0x7f8dbc153270 legacy=0x7f8dbc070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc26d9700 1 -- 172.21.15.135:0/2381735546 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc159aa0 con 0x7f8dbc0c9da0 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc0ed6700 1 -- 172.21.15.135:0/2381735546 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104045492 0 0) 0x7f8dbc159570 con 0x7f8dbc153270 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc26d9700 1 --2- 172.21.15.135:0/2381735546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0c9da0 0x7f8dbc15ca50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0c7c90 tx=0x7f8db400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6124e1c5f432ff7a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc0ed6700 1 -- 172.21.15.135:0/2381735546 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400e070 con 0x7f8dbc0c9da0 2024-05-08T21:21:07.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc0ed6700 1 -- 172.21.15.135:0/2381735546 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400bbd0 con 0x7f8dbc0c9da0 2024-05-08T21:21:07.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.611+0000 7f8dc0ed6700 1 -- 172.21.15.135:0/2381735546 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4012430 con 0x7f8dbc0c9da0 2024-05-08T21:21:07.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 -- 172.21.15.135:0/2381735546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0c9da0 msgr2=0x7f8dbc15ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 --2- 172.21.15.135:0/2381735546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0c9da0 0x7f8dbc15ca50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0c7c90 tx=0x7f8db400b330 comp rx=0 tx=0).stop 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 -- 172.21.15.135:0/2381735546 shutdown_connections 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 --2- 172.21.15.135:0/2381735546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc0c9da0 0x7f8dbc15ca50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 --2- 172.21.15.135:0/2381735546 >> v2:172.21.15.183:3300/0 conn(0x7f8dbc153650 0x7f8dbc0c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 -- 172.21.15.135:0/2381735546 >> 172.21.15.135:0/2381735546 conn(0x7f8dbc066d70 msgr2=0x7f8dbc06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 -- 172.21.15.135:0/2381735546 shutdown_connections 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.612+0000 7f8dc413c700 1 -- 172.21.15.135:0/2381735546 wait complete. 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.613+0000 7f8dc413c700 1 Processor -- start 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.613+0000 7f8dc413c700 1 -- start start 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dbc0c9da0 0x7f8dbc158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc153270 0x7f8dbc13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc153650 0x7f8dbc140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0cb1f0 con 0x7f8dbc153270 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0cb490 con 0x7f8dbc153650 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0cb770 con 0x7f8dbc0c9da0 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc153270 0x7f8dbc13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc153270 0x7f8dbc13ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34772/0 (socket says 172.21.15.135:34772) 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 -- 172.21.15.135:0/134518721 learned_addr learned my addr 172.21.15.135:0/134518721 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc26d9700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc153650 0x7f8dbc140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc1ed8700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dbc0c9da0 0x7f8dbc158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 -- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dbc0c9da0 msgr2=0x7f8dbc158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dbc0c9da0 0x7f8dbc158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 -- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc153650 msgr2=0x7f8dbc140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc153650 0x7f8dbc140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 -- 172.21.15.135:0/134518721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4009a70 con 0x7f8dbc153270 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc16d7700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc153270 0x7f8dbc13ff10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00d800 tx=0x7f8dac00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8db27fc700 1 -- 172.21.15.135:0/134518721 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac004240 con 0x7f8dbc153270 2024-05-08T21:21:07.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8db27fc700 1 -- 172.21.15.135:0/134518721 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac0043a0 con 0x7f8dbc153270 2024-05-08T21:21:07.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc0cba50 con 0x7f8dbc153270 2024-05-08T21:21:07.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8db27fc700 1 -- 172.21.15.135:0/134518721 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0036a0 con 0x7f8dbc153270 2024-05-08T21:21:07.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.614+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc0cc010 con 0x7f8dbc153270 2024-05-08T21:21:07.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.615+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc067fa0 con 0x7f8dbc153270 2024-05-08T21:21:07.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.617+0000 7f8db27fc700 1 -- 172.21.15.135:0/134518721 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8dac003800 con 0x7f8dbc153270 2024-05-08T21:21:07.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.617+0000 7f8db27fc700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8da006ac90 0x7f8da006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.617+0000 7f8db27fc700 1 -- 172.21.15.135:0/134518721 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8dac089dd0 con 0x7f8dbc153270 2024-05-08T21:21:07.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.617+0000 7f8dc1ed8700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8da006ac90 0x7f8da006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.617+0000 7f8dc1ed8700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8da006ac90 0x7f8da006d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8db8000f60 tx=0x7f8db8007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.620+0000 7f8db27fc700 1 -- 172.21.15.135:0/134518721 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8dac054d60 con 0x7f8dbc153270 2024-05-08T21:21:07.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.826+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8dbc148c10 con 0x7f8dbc153270 2024-05-08T21:21:07.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.827+0000 7f8db27fc700 1 -- 172.21.15.135:0/134518721 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8dac058380 con 0x7f8dbc153270 2024-05-08T21:21:07.829 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8da006ac90 msgr2=0x7f8da006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8da006ac90 0x7f8da006d150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8db8000f60 tx=0x7f8db8007be0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc153270 msgr2=0x7f8dbc13ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc153270 0x7f8dbc13ff10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00d800 tx=0x7f8dac00db10 comp rx=0 tx=0).stop 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 shutdown_connections 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8da006ac90 0x7f8da006d150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dbc153650 0x7f8dbc140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dbc0c9da0 0x7f8dbc158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 --2- 172.21.15.135:0/134518721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc153270 0x7f8dbc13ff10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 >> 172.21.15.135:0/134518721 conn(0x7f8dbc066d70 msgr2=0x7f8dbc1480e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:07.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 shutdown_connections 2024-05-08T21:21:07.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.829+0000 7f8dc413c700 1 -- 172.21.15.135:0/134518721 wait complete. 2024-05-08T21:21:07.845 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:21:07.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.968+0000 7f5834046700 1 Processor -- start 2024-05-08T21:21:07.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.968+0000 7f5834046700 1 -- start start 2024-05-08T21:21:07.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5834046700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f582c0c6600 0x7f582c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5834046700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c1508a0 con 0x7f582c1504c0 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5834046700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c072e40 con 0x7f582c0c51e0 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5834046700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0c2de0 con 0x7f582c0c6600 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f58325e3700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f582c0c6600 0x7f582c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5831de2700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f582c1504c0 0x7f582c159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53278/0 (socket says 172.21.15.135:53278) 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5831de2700 1 -- 172.21.15.135:0/2611935050 learned_addr learned my addr 172.21.15.135:0/2611935050 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f58325e3700 1 -- 172.21.15.135:0/2611935050 >> v1:172.21.15.183:6789/0 conn(0x7f582c0c51e0 legacy=0x7f582c072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f58325e3700 1 -- 172.21.15.135:0/2611935050 >> v1:172.21.15.135:6789/0 conn(0x7f582c1504c0 legacy=0x7f582c159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f58325e3700 1 -- 172.21.15.135:0/2611935050 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0c5940 con 0x7f582c0c6600 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5830de0700 1 -- 172.21.15.135:0/2611935050 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103666376 0 0) 0x7f582c1508a0 con 0x7f582c1504c0 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f58325e3700 1 --2- 172.21.15.135:0/2611935050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c6600 0x7f582c0c6a30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5824009d90 tx=0x7f582400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9803119a82e78da1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5830de0700 1 -- 172.21.15.135:0/2611935050 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582400e070 con 0x7f582c0c6600 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.969+0000 7f5830de0700 1 -- 172.21.15.135:0/2611935050 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582400bb90 con 0x7f582c0c6600 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5830de0700 1 -- 172.21.15.135:0/2611935050 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824003a20 con 0x7f582c0c6600 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5834046700 1 -- 172.21.15.135:0/2611935050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c6600 msgr2=0x7f582c0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5834046700 1 --2- 172.21.15.135:0/2611935050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c6600 0x7f582c0c6a30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5824009d90 tx=0x7f582400b330 comp rx=0 tx=0).stop 2024-05-08T21:21:07.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5834046700 1 -- 172.21.15.135:0/2611935050 shutdown_connections 2024-05-08T21:21:07.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5834046700 1 --2- 172.21.15.135:0/2611935050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c6600 0x7f582c0c6a30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5834046700 1 -- 172.21.15.135:0/2611935050 >> 172.21.15.135:0/2611935050 conn(0x7f582c06daf0 msgr2=0x7f582c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:07.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5834046700 1 -- 172.21.15.135:0/2611935050 shutdown_connections 2024-05-08T21:21:07.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.970+0000 7f5834046700 1 -- 172.21.15.135:0/2611935050 wait complete. 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.971+0000 7f5834046700 1 Processor -- start 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.971+0000 7f5834046700 1 -- start start 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5834046700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c51e0 0x7f582c1f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5834046700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f582c0c6600 0x7f582c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5834046700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582c1504c0 0x7f582c13f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5834046700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1f14f0 con 0x7f582c0c51e0 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5834046700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c13c9b0 con 0x7f582c1504c0 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5834046700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c13efb0 con 0x7f582c0c6600 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5831de2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c51e0 0x7f582c1f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5831de2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c51e0 0x7f582c1f0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34792/0 (socket says 172.21.15.135:34792) 2024-05-08T21:21:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5831de2700 1 -- 172.21.15.135:0/1926309001 learned_addr learned my addr 172.21.15.135:0/1926309001 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f58325e3700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582c1504c0 0x7f582c13f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f58315e1700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f582c0c6600 0x7f582c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5831de2700 1 -- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f582c0c6600 msgr2=0x7f582c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5831de2700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f582c0c6600 0x7f582c0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5831de2700 1 -- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582c1504c0 msgr2=0x7f582c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.972+0000 7f5831de2700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582c1504c0 0x7f582c13f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.973+0000 7f5831de2700 1 -- 172.21.15.135:0/1926309001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824009a70 con 0x7f582c0c51e0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.973+0000 7f5831de2700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c51e0 0x7f582c1f0fb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f582800c550 tx=0x7f582800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.973+0000 7f58227fc700 1 -- 172.21.15.135:0/1926309001 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828004c80 con 0x7f582c0c51e0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.973+0000 7f58227fc700 1 -- 172.21.15.135:0/1926309001 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828004e00 con 0x7f582c0c51e0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.973+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c13d780 con 0x7f582c0c51e0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.973+0000 7f58227fc700 1 -- 172.21.15.135:0/1926309001 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828007310 con 0x7f582c0c51e0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.973+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c13bed0 con 0x7f582c0c51e0 2024-05-08T21:21:07.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.974+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c1441d0 con 0x7f582c0c51e0 2024-05-08T21:21:07.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.974+0000 7f58227fc700 1 -- 172.21.15.135:0/1926309001 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5828007470 con 0x7f582c0c51e0 2024-05-08T21:21:07.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.975+0000 7f58227fc700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f581006ac90 0x7f581006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:07.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.975+0000 7f58227fc700 1 -- 172.21.15.135:0/1926309001 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f58280894f0 con 0x7f582c0c51e0 2024-05-08T21:21:07.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.975+0000 7f58315e1700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f581006ac90 0x7f581006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:07.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.975+0000 7f58315e1700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f581006ac90 0x7f581006d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c8250 tx=0x7f581c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:07.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:07.979+0000 7f58227fc700 1 -- 172.21.15.135:0/1926309001 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f58280541e0 con 0x7f582c0c51e0 2024-05-08T21:21:08.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.178+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f582c0c27d0 con 0x7f582c0c51e0 2024-05-08T21:21:08.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.179+0000 7f58227fc700 1 -- 172.21.15.135:0/1926309001 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5828057800 con 0x7f582c0c51e0 2024-05-08T21:21:08.181 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T21:21:08.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f581006ac90 msgr2=0x7f581006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f581006ac90 0x7f581006d150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c8250 tx=0x7f581c009040 comp rx=0 tx=0).stop 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c51e0 msgr2=0x7f582c1f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c51e0 0x7f582c1f0fb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f582800c550 tx=0x7f582800c910 comp rx=0 tx=0).stop 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 shutdown_connections 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f581006ac90 0x7f581006d150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582c1504c0 0x7f582c13f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f582c0c51e0 0x7f582c1f0fb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 --2- 172.21.15.135:0/1926309001 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f582c0c6600 0x7f582c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 >> 172.21.15.135:0/1926309001 conn(0x7f582c06daf0 msgr2=0x7f582c06ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 shutdown_connections 2024-05-08T21:21:08.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.181+0000 7f5834046700 1 -- 172.21.15.135:0/1926309001 wait complete. 2024-05-08T21:21:08.195 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.320+0000 7f9738a00700 1 Processor -- start 2024-05-08T21:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.321+0000 7f9738a00700 1 -- start start 2024-05-08T21:21:08.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.321+0000 7f9738a00700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f97341536d0 0x7f97340c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.321+0000 7f9738a00700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f97340c8650 0x7f9734159b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.321+0000 7f9738a00700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97340c84a0 con 0x7f973415a070 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.321+0000 7f9738a00700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9734159400 con 0x7f97341536d0 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f9738a00700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973415ce30 con 0x7f97340c8650 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f97341536d0 0x7f97340c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f97341536d0 0x7f97340c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34800/0 (socket says 172.21.15.135:34800) 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 -- 172.21.15.135:0/3289418460 learned_addr learned my addr 172.21.15.135:0/3289418460 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f9731d9b700 1 --2- 172.21.15.135:0/3289418460 >> v2:172.21.15.183:3300/0 conn(0x7f97340c8650 0x7f9734159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 -- 172.21.15.135:0/3289418460 >> v2:172.21.15.183:3300/0 conn(0x7f97340c8650 msgr2=0x7f9734159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 --2- 172.21.15.135:0/3289418460 >> v2:172.21.15.183:3300/0 conn(0x7f97340c8650 0x7f9734159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 -- 172.21.15.135:0/3289418460 >> v1:172.21.15.183:6789/0 conn(0x7f973415a070 legacy=0x7f97340c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 -- 172.21.15.135:0/3289418460 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973415d9b0 con 0x7f97341536d0 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f9731d9b700 1 --2- 172.21.15.135:0/3289418460 >> v2:172.21.15.183:3300/0 conn(0x7f97340c8650 0x7f9734159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:08.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973259c700 1 --2- 172.21.15.135:0/3289418460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f97340c8e50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9734072cd0 tx=0x7f9724009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68528085df9f6bfd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973159a700 1 -- 172.21.15.135:0/3289418460 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400b870 con 0x7f97341536d0 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973159a700 1 -- 172.21.15.135:0/3289418460 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972400b9d0 con 0x7f97341536d0 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.322+0000 7f973159a700 1 -- 172.21.15.135:0/3289418460 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400bd60 con 0x7f97341536d0 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 -- 172.21.15.135:0/3289418460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 msgr2=0x7f97340c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 --2- 172.21.15.135:0/3289418460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f97340c8e50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9734072cd0 tx=0x7f9724009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 -- 172.21.15.135:0/3289418460 shutdown_connections 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 --2- 172.21.15.135:0/3289418460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f97340c8e50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 --2- 172.21.15.135:0/3289418460 >> v2:172.21.15.183:3300/0 conn(0x7f97340c8650 0x7f9734159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 -- 172.21.15.135:0/3289418460 >> 172.21.15.135:0/3289418460 conn(0x7f973406a960 msgr2=0x7f973406ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 -- 172.21.15.135:0/3289418460 shutdown_connections 2024-05-08T21:21:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.323+0000 7f9738a00700 1 -- 172.21.15.135:0/3289418460 wait complete. 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.325+0000 7f9738a00700 1 Processor -- start 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.325+0000 7f9738a00700 1 -- start start 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97340c8650 0x7f9734151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f973415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973415a070 0x7f97341e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97341efba0 con 0x7f97341536d0 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97340af300 con 0x7f97340c8650 2024-05-08T21:21:08.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973415ae00 con 0x7f973415a070 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f973415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f973415b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34804/0 (socket says 172.21.15.135:34804) 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 -- 172.21.15.135:0/601657777 learned_addr learned my addr 172.21.15.135:0/601657777 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f973259c700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97340c8650 0x7f9734151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9732d9d700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973415a070 0x7f97341e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 -- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973415a070 msgr2=0x7f97341e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973415a070 0x7f97341e3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 -- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97340c8650 msgr2=0x7f9734151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97340c8650 0x7f9734151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 -- 172.21.15.135:0/601657777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9724009550 con 0x7f97341536d0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9731d9b700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f973415b720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f972800e840 tx=0x7f972800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9722ffd700 1 -- 172.21.15.135:0/601657777 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800c020 con 0x7f97341536d0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9722ffd700 1 -- 172.21.15.135:0/601657777 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728004230 con 0x7f97341536d0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973415b290 con 0x7f97341536d0 2024-05-08T21:21:08.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9722ffd700 1 -- 172.21.15.135:0/601657777 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280036a0 con 0x7f97341536d0 2024-05-08T21:21:08.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.326+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97341f0070 con 0x7f97341536d0 2024-05-08T21:21:08.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.327+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973415abd0 con 0x7f97341536d0 2024-05-08T21:21:08.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.328+0000 7f9722ffd700 1 -- 172.21.15.135:0/601657777 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9728003800 con 0x7f97341536d0 2024-05-08T21:21:08.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.328+0000 7f9722ffd700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f971406ac90 0x7f971406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.328+0000 7f9722ffd700 1 -- 172.21.15.135:0/601657777 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f97280892c0 con 0x7f97341536d0 2024-05-08T21:21:08.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.328+0000 7f973259c700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f971406ac90 0x7f971406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.329+0000 7f973259c700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f971406ac90 0x7f971406d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9724000c00 tx=0x7f9724008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:08.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.332+0000 7f9722ffd700 1 -- 172.21.15.135:0/601657777 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f973415abd0 con 0x7f97341536d0 2024-05-08T21:21:08.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.529+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f97340671d0 con 0x7f97341536d0 2024-05-08T21:21:08.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.529+0000 7f9722ffd700 1 -- 172.21.15.135:0/601657777 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9728054170 con 0x7f97341536d0 2024-05-08T21:21:08.532 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f971406ac90 msgr2=0x7f971406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f971406ac90 0x7f971406d150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9724000c00 tx=0x7f9724008030 comp rx=0 tx=0).stop 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 msgr2=0x7f973415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f973415b720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f972800e840 tx=0x7f972800eb50 comp rx=0 tx=0).stop 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 shutdown_connections 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f971406ac90 0x7f971406d150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97340c8650 0x7f9734151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973415a070 0x7f97341e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 --2- 172.21.15.135:0/601657777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97341536d0 0x7f973415b720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.531+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 >> 172.21.15.135:0/601657777 conn(0x7f973406a960 msgr2=0x7f9734157b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:08.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.532+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 shutdown_connections 2024-05-08T21:21:08.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.532+0000 7f9738a00700 1 -- 172.21.15.135:0/601657777 wait complete. 2024-05-08T21:21:08.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:21:08.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.666+0000 7f395ee22700 1 Processor -- start 2024-05-08T21:21:08.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.666+0000 7f395ee22700 1 -- start start 2024-05-08T21:21:08.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395ee22700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3958153270 0x7f39580c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395ee22700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3958153650 0x7f3958070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395ee22700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3958159570 con 0x7f39580c9da0 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395ee22700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395815a160 con 0x7f3958153270 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395ee22700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39581597c0 con 0x7f3958153650 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395cbbe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f3958153270 0x7f39580c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395d3bf700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f39580c9da0 0x7f395815ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53288/0 (socket says 172.21.15.135:53288) 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395d3bf700 1 -- 172.21.15.135:0/1786070700 learned_addr learned my addr 172.21.15.135:0/1786070700 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f3957fff700 1 --2- 172.21.15.135:0/1786070700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3958153650 0x7f3958070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f39577fe700 1 -- 172.21.15.135:0/1786070700 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980714776 0 0) 0x7f3958159570 con 0x7f39580c9da0 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f39577fe700 1 -- 172.21.15.135:0/1786070700 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39480035b0 con 0x7f39580c9da0 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395cbbe700 1 -- 172.21.15.135:0/1786070700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3958153650 msgr2=0x7f3958070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395cbbe700 1 --2- 172.21.15.135:0/1786070700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3958153650 0x7f3958070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395cbbe700 1 -- 172.21.15.135:0/1786070700 >> v1:172.21.15.135:6789/0 conn(0x7f39580c9da0 legacy=0x7f395815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f395cbbe700 1 -- 172.21.15.135:0/1786070700 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958159aa0 con 0x7f3958153270 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.667+0000 7f3957fff700 1 --2- 172.21.15.135:0/1786070700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3958153650 0x7f3958070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395cbbe700 1 --2- 172.21.15.135:0/1786070700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153270 0x7f39580c9080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f394c009840 tx=0x7f394c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d7858a7ba644d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f39577fe700 1 -- 172.21.15.135:0/1786070700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c011830 con 0x7f3958153270 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f39577fe700 1 -- 172.21.15.135:0/1786070700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c011990 con 0x7f3958153270 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f39577fe700 1 -- 172.21.15.135:0/1786070700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c011d20 con 0x7f3958153270 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 -- 172.21.15.135:0/1786070700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153270 msgr2=0x7f39580c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 --2- 172.21.15.135:0/1786070700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153270 0x7f39580c9080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f394c009840 tx=0x7f394c009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 -- 172.21.15.135:0/1786070700 shutdown_connections 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 --2- 172.21.15.135:0/1786070700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153270 0x7f39580c9080 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 --2- 172.21.15.135:0/1786070700 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3958153650 0x7f3958070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 -- 172.21.15.135:0/1786070700 >> 172.21.15.135:0/1786070700 conn(0x7f3958066d70 msgr2=0x7f395806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 -- 172.21.15.135:0/1786070700 shutdown_connections 2024-05-08T21:21:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.668+0000 7f395ee22700 1 -- 172.21.15.135:0/1786070700 wait complete. 2024-05-08T21:21:08.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.669+0000 7f395ee22700 1 Processor -- start 2024-05-08T21:21:08.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.669+0000 7f395ee22700 1 -- start start 2024-05-08T21:21:08.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395ee22700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580c9da0 0x7f39581483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395ee22700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3958153270 0x7f39581f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395ee22700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153650 0x7f3958158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395ee22700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958156830 con 0x7f3958153650 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395ee22700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958154be0 con 0x7f3958153270 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395ee22700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3958156c50 con 0x7f39580c9da0 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395d3bf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153650 0x7f3958158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395d3bf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153650 0x7f3958158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34816/0 (socket says 172.21.15.135:34816) 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.670+0000 7f395d3bf700 1 -- 172.21.15.135:0/3011907458 learned_addr learned my addr 172.21.15.135:0/3011907458 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395cbbe700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580c9da0 0x7f39581483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395d3bf700 1 -- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580c9da0 msgr2=0x7f39581483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f3957fff700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3958153270 0x7f39581f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395d3bf700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580c9da0 0x7f39581483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395d3bf700 1 -- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3958153270 msgr2=0x7f39581f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395d3bf700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3958153270 0x7f39581f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395d3bf700 1 -- 172.21.15.135:0/3011907458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0094a0 con 0x7f3958153650 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395cbbe700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580c9da0 0x7f39581483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395d3bf700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153650 0x7f3958158160 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f395000cb70 tx=0x7f395000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f39557fa700 1 -- 172.21.15.135:0/3011907458 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395000ab10 con 0x7f3958153650 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f39557fa700 1 -- 172.21.15.135:0/3011907458 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395000ac70 con 0x7f3958153650 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395814e870 con 0x7f3958153650 2024-05-08T21:21:08.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f39557fa700 1 -- 172.21.15.135:0/3011907458 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950012400 con 0x7f3958153650 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.671+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395814e590 con 0x7f3958153650 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.672+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3958156970 con 0x7f3958153650 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.672+0000 7f39557fa700 1 -- 172.21.15.135:0/3011907458 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f39500113a0 con 0x7f3958153650 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.673+0000 7f39557fa700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f393c06ac90 0x7f393c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.673+0000 7f39557fa700 1 -- 172.21.15.135:0/3011907458 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39500894b0 con 0x7f3958153650 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.673+0000 7f395cbbe700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f393c06ac90 0x7f393c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.673+0000 7f395cbbe700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f393c06ac90 0x7f393c06d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f394c0090b0 tx=0x7f394c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:08.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.677+0000 7f39557fa700 1 -- 172.21.15.135:0/3011907458 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3958156970 con 0x7f3958153650 2024-05-08T21:21:08.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.887+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3958156970 con 0x7f3958153650 2024-05-08T21:21:08.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.887+0000 7f39557fa700 1 -- 172.21.15.135:0/3011907458 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3958156970 con 0x7f3958153650 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f393c06ac90 msgr2=0x7f393c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f393c06ac90 0x7f393c06d150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f394c0090b0 tx=0x7f394c008030 comp rx=0 tx=0).stop 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153650 msgr2=0x7f3958158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153650 0x7f3958158160 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f395000cb70 tx=0x7f395000cf30 comp rx=0 tx=0).stop 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 shutdown_connections 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f393c06ac90 0x7f393c06d150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3958153650 0x7f3958158160 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39580c9da0 0x7f39581483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 --2- 172.21.15.135:0/3011907458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3958153270 0x7f39581f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:08.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.889+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 >> 172.21.15.135:0/3011907458 conn(0x7f3958066d70 msgr2=0x7f3958152350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:08.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.890+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 shutdown_connections 2024-05-08T21:21:08.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:08.890+0000 7f395ee22700 1 -- 172.21.15.135:0/3011907458 wait complete. 2024-05-08T21:21:08.893 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-08T21:21:08.904 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-05-08T21:21:08.904 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:21:08.921 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:21:09.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.082+0000 7fd8e32ca700 1 Processor -- start 2024-05-08T21:21:09.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.082+0000 7fd8e32ca700 1 -- start start 2024-05-08T21:21:09.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e32ca700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd8dc0c63f0 0x7fd8dc159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e32ca700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc06a960 con 0x7fd8dc1535a0 2024-05-08T21:21:09.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e32ca700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc06b7c0 con 0x7fd8dc06bc50 2024-05-08T21:21:09.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e32ca700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c6840 con 0x7fd8dc0c63f0 2024-05-08T21:21:09.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e1066700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd8dc1535a0 0x7fd8dc06dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53296/0 (socket says 172.21.15.135:53296) 2024-05-08T21:21:09.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e1066700 1 -- 172.21.15.135:0/3104134998 learned_addr learned my addr 172.21.15.135:0/3104134998 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:09.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e1867700 1 --2- 172.21.15.135:0/3104134998 >> v2:172.21.15.183:3300/0 conn(0x7fd8dc0c63f0 0x7fd8dc159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8d3fff700 1 -- 172.21.15.135:0/3104134998 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38646268 0 0) 0x7fd8dc06a960 con 0x7fd8dc1535a0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8d3fff700 1 -- 172.21.15.135:0/3104134998 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c80035b0 con 0x7fd8dc1535a0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e1867700 1 -- 172.21.15.135:0/3104134998 >> v1:172.21.15.183:6789/0 conn(0x7fd8dc06bc50 legacy=0x7fd8dc159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e1867700 1 -- 172.21.15.135:0/3104134998 >> v1:172.21.15.135:6789/0 conn(0x7fd8dc1535a0 legacy=0x7fd8dc06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8d3fff700 1 -- 172.21.15.135:0/3104134998 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762632381 0 0) 0x7fd8c80035b0 con 0x7fd8dc1535a0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.083+0000 7fd8e1867700 1 -- 172.21.15.135:0/3104134998 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc06e700 con 0x7fd8dc0c63f0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e1867700 1 --2- 172.21.15.135:0/3104134998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc159aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009d90 tx=0x7fd8d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14c0bac81f4aacc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8d3fff700 1 -- 172.21.15.135:0/3104134998 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d400e070 con 0x7fd8dc0c63f0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8d3fff700 1 -- 172.21.15.135:0/3104134998 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4003a20 con 0x7fd8dc0c63f0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8d3fff700 1 -- 172.21.15.135:0/3104134998 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8001670 con 0x7fd8dc0c63f0 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e32ca700 1 -- 172.21.15.135:0/3104134998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 msgr2=0x7fd8dc159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/3104134998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc159aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009d90 tx=0x7fd8d400b330 comp rx=0 tx=0).stop 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e32ca700 1 -- 172.21.15.135:0/3104134998 shutdown_connections 2024-05-08T21:21:09.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/3104134998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc159aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e32ca700 1 -- 172.21.15.135:0/3104134998 >> 172.21.15.135:0/3104134998 conn(0x7fd8dc0cb200 msgr2=0x7fd8dc0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e32ca700 1 -- 172.21.15.135:0/3104134998 shutdown_connections 2024-05-08T21:21:09.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.084+0000 7fd8e32ca700 1 -- 172.21.15.135:0/3104134998 wait complete. 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 Processor -- start 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 -- start start 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8dc06bc50 0x7fd8dc14c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc14a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc1535a0 0x7fd8dc14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc14b4c0 con 0x7fd8dc1535a0 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc1409f0 con 0x7fd8dc0c63f0 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e32ca700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc140cb0 con 0x7fd8dc06bc50 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e1867700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc1535a0 0x7fd8dc14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e1867700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc1535a0 0x7fd8dc14a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34830/0 (socket says 172.21.15.135:34830) 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.086+0000 7fd8e1867700 1 -- 172.21.15.135:0/1212845992 learned_addr learned my addr 172.21.15.135:0/1212845992 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e0865700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc14a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e1066700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8dc06bc50 0x7fd8dc14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e1867700 1 -- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8dc06bc50 msgr2=0x7fd8dc14c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e1867700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8dc06bc50 0x7fd8dc14c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e1867700 1 -- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 msgr2=0x7fd8dc14a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e1867700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc14a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e1867700 1 -- 172.21.15.135:0/1212845992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009a70 con 0x7fd8dc1535a0 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e0865700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc14a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e1867700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc1535a0 0x7fd8dc14a860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc071080 tx=0x7fd8d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8d1ffb700 1 -- 172.21.15.135:0/1212845992 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4004640 con 0x7fd8dc1535a0 2024-05-08T21:21:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8d1ffb700 1 -- 172.21.15.135:0/1212845992 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d40047a0 con 0x7fd8dc1535a0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc14b760 con 0x7fd8dc1535a0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8d1ffb700 1 -- 172.21.15.135:0/1212845992 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d401d670 con 0x7fd8dc1535a0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.087+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc140f90 con 0x7fd8dc1535a0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.088+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc14bc80 con 0x7fd8dc1535a0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.089+0000 7fd8d1ffb700 1 -- 172.21.15.135:0/1212845992 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8d401d7d0 con 0x7fd8dc1535a0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.089+0000 7fd8d1ffb700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8c006acc0 0x7fd8c006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.089+0000 7fd8d1ffb700 1 -- 172.21.15.135:0/1212845992 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd8d408ace0 con 0x7fd8dc1535a0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.089+0000 7fd8e1066700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8c006acc0 0x7fd8c006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.089+0000 7fd8e1066700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8c006acc0 0x7fd8c006d180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001eb0 tx=0x7fd8d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.094+0000 7fd8d1ffb700 1 -- 172.21.15.135:0/1212845992 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd8dc14bc80 con 0x7fd8dc1535a0 2024-05-08T21:21:09.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.291+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8dc14bc80 con 0x7fd8dc1535a0 2024-05-08T21:21:09.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.292+0000 7fd8d1ffb700 1 -- 172.21.15.135:0/1212845992 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18313 (secure 0 0 0) 0x7fd8dc14bc80 con 0x7fd8dc1535a0 2024-05-08T21:21:09.294 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:09.295 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:41.588092+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8c006acc0 msgr2=0x7fd8c006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8c006acc0 0x7fd8c006d180 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8001eb0 tx=0x7fd8d8009040 comp rx=0 tx=0).stop 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc1535a0 msgr2=0x7fd8dc14a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc1535a0 0x7fd8dc14a860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc071080 tx=0x7fd8d4004ad0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 shutdown_connections 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd8c006acc0 0x7fd8c006d180 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8dc1535a0 0x7fd8dc14a860 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8dc06bc50 0x7fd8dc14c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 --2- 172.21.15.135:0/1212845992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8dc0c63f0 0x7fd8dc14a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 >> 172.21.15.135:0/1212845992 conn(0x7fd8dc0cb200 msgr2=0x7fd8dc1517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 shutdown_connections 2024-05-08T21:21:09.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.294+0000 7fd8e32ca700 1 -- 172.21.15.135:0/1212845992 wait complete. 2024-05-08T21:21:09.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:54:48.495563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:54:57.947571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:54:58.988583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T20:55:02.098509+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T21:21:09.309 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:21:09.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.431+0000 7f7d59d25700 1 Processor -- start 2024-05-08T21:21:09.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.431+0000 7f7d59d25700 1 -- start start 2024-05-08T21:21:09.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d59d25700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d540c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d59d25700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d5406bc50 0x7f7d5406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d59d25700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7d5406e530 0x7f7d54159390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d59d25700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5406a960 con 0x7f7d5406bc50 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d59d25700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5406b7c0 con 0x7f7d5406e530 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d59d25700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5406abb0 con 0x7f7d541535a0 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d5406bc50 0x7f7d5406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7d5406bc50 0x7f7d5406dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34832/0 (socket says 172.21.15.135:34832) 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 -- 172.21.15.135:0/2034410042 learned_addr learned my addr 172.21.15.135:0/2034410042 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d53fff700 1 --2- 172.21.15.135:0/2034410042 >> v2:172.21.15.183:3300/0 conn(0x7f7d5406e530 0x7f7d54159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d537fe700 1 --2- 172.21.15.135:0/2034410042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d540c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 -- 172.21.15.135:0/2034410042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 msgr2=0x7f7d540c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 --2- 172.21.15.135:0/2034410042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d540c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 -- 172.21.15.135:0/2034410042 >> v2:172.21.15.183:3300/0 conn(0x7f7d5406e530 msgr2=0x7f7d54159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 --2- 172.21.15.135:0/2034410042 >> v2:172.21.15.183:3300/0 conn(0x7f7d5406e530 0x7f7d54159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d52ffd700 1 -- 172.21.15.135:0/2034410042 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5406ae90 con 0x7f7d5406bc50 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.432+0000 7f7d53fff700 1 --2- 172.21.15.135:0/2034410042 >> v2:172.21.15.183:3300/0 conn(0x7f7d5406e530 0x7f7d54159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d52ffd700 1 --2- 172.21.15.135:0/2034410042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406bc50 0x7f7d5406dff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d540c33d0 tx=0x7f7d44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94771902dc3c27b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d527fc700 1 -- 172.21.15.135:0/2034410042 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400b870 con 0x7f7d5406bc50 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d527fc700 1 -- 172.21.15.135:0/2034410042 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400b9d0 con 0x7f7d5406bc50 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d527fc700 1 -- 172.21.15.135:0/2034410042 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400bd60 con 0x7f7d5406bc50 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 -- 172.21.15.135:0/2034410042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406bc50 msgr2=0x7f7d5406dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 --2- 172.21.15.135:0/2034410042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406bc50 0x7f7d5406dff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7d540c33d0 tx=0x7f7d44009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 -- 172.21.15.135:0/2034410042 shutdown_connections 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 --2- 172.21.15.135:0/2034410042 >> v2:172.21.15.183:3300/0 conn(0x7f7d5406e530 0x7f7d54159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 --2- 172.21.15.135:0/2034410042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d540c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 --2- 172.21.15.135:0/2034410042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406bc50 0x7f7d5406dff0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 -- 172.21.15.135:0/2034410042 >> 172.21.15.135:0/2034410042 conn(0x7f7d540cb200 msgr2=0x7f7d540cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 -- 172.21.15.135:0/2034410042 shutdown_connections 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.433+0000 7f7d59d25700 1 -- 172.21.15.135:0/2034410042 wait complete. 2024-05-08T21:21:09.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.434+0000 7f7d59d25700 1 Processor -- start 2024-05-08T21:21:09.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d59d25700 1 -- start start 2024-05-08T21:21:09.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d59d25700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d5406bc50 0x7f7d54157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d59d25700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406e530 0x7f7d541ef510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d59d25700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d541efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d59d25700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d541580d0 con 0x7f7d5406e530 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d59d25700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5414c2f0 con 0x7f7d5406bc50 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d59d25700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d541ef010 con 0x7f7d541535a0 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.435+0000 7f7d52ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406e530 0x7f7d541ef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406e530 0x7f7d541ef510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34848/0 (socket says 172.21.15.135:34848) 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 -- 172.21.15.135:0/1993168165 learned_addr learned my addr 172.21.15.135:0/1993168165 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d537fe700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d5406bc50 0x7f7d54157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d53fff700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d541efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 -- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 msgr2=0x7f7d541efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d541efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 -- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d5406bc50 msgr2=0x7f7d54157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d5406bc50 0x7f7d54157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 -- 172.21.15.135:0/1993168165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d44009550 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d52ffd700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406e530 0x7f7d541ef510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d44000c00 tx=0x7f7d44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d3bfff700 1 -- 172.21.15.135:0/1993168165 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44004480 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d3bfff700 1 -- 172.21.15.135:0/1993168165 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440045e0 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5414b230 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d3bfff700 1 -- 172.21.15.135:0/1993168165 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440038e0 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.436+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5414c590 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.437+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54067fa0 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.438+0000 7f7d3bfff700 1 -- 172.21.15.135:0/1993168165 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d44021070 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.438+0000 7f7d3bfff700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7d4006ac90 0x7f7d4006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.438+0000 7f7d3bfff700 1 -- 172.21.15.135:0/1993168165 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d4408afd0 con 0x7f7d5406e530 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.438+0000 7f7d537fe700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7d4006ac90 0x7f7d4006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.438+0000 7f7d537fe700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7d4006ac90 0x7f7d4006d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d48006b20 tx=0x7f7d48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.442+0000 7f7d3bfff700 1 -- 172.21.15.135:0/1993168165 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7d44055e80 con 0x7f7d5406e530 2024-05-08T21:21:09.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.638+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d5406c170 con 0x7f7d5406e530 2024-05-08T21:21:09.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.639+0000 7f7d3bfff700 1 -- 172.21.15.135:0/1993168165 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d44015020 con 0x7f7d5406e530 2024-05-08T21:21:09.641 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7d4006ac90 msgr2=0x7f7d4006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7d4006ac90 0x7f7d4006d150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d48006b20 tx=0x7f7d48008040 comp rx=0 tx=0).stop 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406e530 msgr2=0x7f7d541ef510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406e530 0x7f7d541ef510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d44000c00 tx=0x7f7d44004750 comp rx=0 tx=0).stop 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 shutdown_connections 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7d4006ac90 0x7f7d4006d150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d5406bc50 0x7f7d54157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d541535a0 0x7f7d541efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 --2- 172.21.15.135:0/1993168165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d5406e530 0x7f7d541ef510 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 >> 172.21.15.135:0/1993168165 conn(0x7f7d540cb200 msgr2=0x7f7d540c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 shutdown_connections 2024-05-08T21:21:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.641+0000 7f7d59d25700 1 -- 172.21.15.135:0/1993168165 wait complete. 2024-05-08T21:21:09.656 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:21:09.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.777+0000 7f8017db5700 1 Processor -- start 2024-05-08T21:21:09.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.778+0000 7f8017db5700 1 -- start start 2024-05-08T21:21:09.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.778+0000 7f8017db5700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8010153270 0x7f80100c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.778+0000 7f8017db5700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8010153650 0x7f8010070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.778+0000 7f8017db5700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8010159570 con 0x7f80100c9da0 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.778+0000 7f8017db5700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801015a160 con 0x7f8010153650 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8017db5700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80101597c0 con 0x7f8010153270 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8015350700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f8010153650 0x7f8010070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8016352700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f80100c9da0 0x7f801015ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53306/0 (socket says 172.21.15.135:53306) 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8016352700 1 -- 172.21.15.135:0/3296574748 learned_addr learned my addr 172.21.15.135:0/3296574748 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8015b51700 1 --2- 172.21.15.135:0/3296574748 >> v2:172.21.15.183:3300/0 conn(0x7f8010153270 0x7f80100c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8015350700 1 -- 172.21.15.135:0/3296574748 >> v2:172.21.15.183:3300/0 conn(0x7f8010153270 msgr2=0x7f80100c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8015350700 1 --2- 172.21.15.135:0/3296574748 >> v2:172.21.15.183:3300/0 conn(0x7f8010153270 0x7f80100c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8015350700 1 -- 172.21.15.135:0/3296574748 >> v1:172.21.15.135:6789/0 conn(0x7f80100c9da0 legacy=0x7f801015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8014b4f700 1 -- 172.21.15.135:0/3296574748 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882890841 0 0) 0x7f8010159570 con 0x7f80100c9da0 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8015350700 1 -- 172.21.15.135:0/3296574748 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8010159aa0 con 0x7f8010153650 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8015350700 1 --2- 172.21.15.135:0/3296574748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f8010070af0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f801006fbb0 tx=0x7f800c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146853f0c91ced40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8014b4f700 1 -- 172.21.15.135:0/3296574748 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011830 con 0x7f8010153650 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8014b4f700 1 -- 172.21.15.135:0/3296574748 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c011990 con 0x7f8010153650 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.779+0000 7f8014b4f700 1 -- 172.21.15.135:0/3296574748 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c011d20 con 0x7f8010153650 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 -- 172.21.15.135:0/3296574748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 msgr2=0x7f8010070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 --2- 172.21.15.135:0/3296574748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f8010070af0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f801006fbb0 tx=0x7f800c009b20 comp rx=0 tx=0).stop 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 -- 172.21.15.135:0/3296574748 shutdown_connections 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 --2- 172.21.15.135:0/3296574748 >> v2:172.21.15.183:3300/0 conn(0x7f8010153270 0x7f80100c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 --2- 172.21.15.135:0/3296574748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f8010070af0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 -- 172.21.15.135:0/3296574748 >> 172.21.15.135:0/3296574748 conn(0x7f8010066d70 msgr2=0x7f801006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 -- 172.21.15.135:0/3296574748 shutdown_connections 2024-05-08T21:21:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.780+0000 7f8017db5700 1 -- 172.21.15.135:0/3296574748 wait complete. 2024-05-08T21:21:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.781+0000 7f8017db5700 1 Processor -- start 2024-05-08T21:21:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.781+0000 7f8017db5700 1 -- start start 2024-05-08T21:21:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8017db5700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80100c9da0 0x7f8010158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8017db5700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8010153270 0x7f80100cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8017db5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f80101556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8017db5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100caeb0 con 0x7f8010153650 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8017db5700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801014a7c0 con 0x7f8010153270 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8017db5700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8010155240 con 0x7f80100c9da0 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f80101556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f80101556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34874/0 (socket says 172.21.15.135:34874) 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 -- 172.21.15.135:0/720984365 learned_addr learned my addr 172.21.15.135:0/720984365 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8015b51700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80100c9da0 0x7f8010158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8015350700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8010153270 0x7f80100cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 -- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80100c9da0 msgr2=0x7f8010158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80100c9da0 0x7f8010158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 -- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8010153270 msgr2=0x7f80100cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8010153270 0x7f80100cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 -- 172.21.15.135:0/720984365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0094a0 con 0x7f8010153650 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.782+0000 7f8016352700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f80101556d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f800800cba0 tx=0x7f800800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.783+0000 7f80067fc700 1 -- 172.21.15.135:0/720984365 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800ab20 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.783+0000 7f80067fc700 1 -- 172.21.15.135:0/720984365 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800800aca0 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.783+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80100cb980 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.783+0000 7f80067fc700 1 -- 172.21.15.135:0/720984365 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008007310 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.783+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80100cb6a0 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.784+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8010067fa0 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.784+0000 7f80067fc700 1 -- 172.21.15.135:0/720984365 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8008007470 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.784+0000 7f80067fc700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7ff406ac90 0x7f7ff406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.784+0000 7f80067fc700 1 -- 172.21.15.135:0/720984365 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f80080890d0 con 0x7f8010153650 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.785+0000 7f8015b51700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7ff406ac90 0x7f7ff406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:09.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.785+0000 7f8015b51700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7ff406ac90 0x7f7ff406d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8000009930 tx=0x7f8000008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:09.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.789+0000 7f80067fc700 1 -- 172.21.15.135:0/720984365 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8008053f80 con 0x7f8010153650 2024-05-08T21:21:09.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.984+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8010155380 con 0x7f8010153650 2024-05-08T21:21:09.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.985+0000 7f80067fc700 1 -- 172.21.15.135:0/720984365 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8008018020 con 0x7f8010153650 2024-05-08T21:21:09.988 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T21:21:09.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7ff406ac90 msgr2=0x7f7ff406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7ff406ac90 0x7f7ff406d150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8000009930 tx=0x7f8000008040 comp rx=0 tx=0).stop 2024-05-08T21:21:09.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 msgr2=0x7f80101556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f80101556d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f800800cba0 tx=0x7f800800cf60 comp rx=0 tx=0).stop 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 shutdown_connections 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7ff406ac90 0x7f7ff406d150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8010153650 0x7f80101556d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80100c9da0 0x7f8010158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 --2- 172.21.15.135:0/720984365 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8010153270 0x7f80100cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 >> 172.21.15.135:0/720984365 conn(0x7f8010066d70 msgr2=0x7f80100708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 shutdown_connections 2024-05-08T21:21:09.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:09.988+0000 7f8017db5700 1 -- 172.21.15.135:0/720984365 wait complete. 2024-05-08T21:21:10.002 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:21:10.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.124+0000 7ff9ec892700 1 Processor -- start 2024-05-08T21:21:10.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.124+0000 7ff9ec892700 1 -- start start 2024-05-08T21:21:10.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.125+0000 7ff9ec892700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff9e80cbf50 0x7ff9e80c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.125+0000 7ff9ec892700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff9e8072ae0 0x7ff9e80c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.125+0000 7ff9ec892700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e815c990 con 0x7ff9e81535a0 2024-05-08T21:21:10.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.125+0000 7ff9ec892700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e815cbc0 con 0x7ff9e8072ae0 2024-05-08T21:21:10.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.125+0000 7ff9ec892700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e815ce60 con 0x7ff9e80cbf50 2024-05-08T21:21:10.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e6d9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff9e8072ae0 0x7ff9e80c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e659c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7ff9e81535a0 0x7ff9e806a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53308/0 (socket says 172.21.15.135:53308) 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e659c700 1 -- 172.21.15.135:0/4250231056 learned_addr learned my addr 172.21.15.135:0/4250231056 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e5d9b700 1 --2- 172.21.15.135:0/4250231056 >> v2:172.21.15.183:3300/0 conn(0x7ff9e80cbf50 0x7ff9e80c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e6d9d700 1 -- 172.21.15.135:0/4250231056 >> v2:172.21.15.183:3300/0 conn(0x7ff9e80cbf50 msgr2=0x7ff9e80c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e6d9d700 1 --2- 172.21.15.135:0/4250231056 >> v2:172.21.15.183:3300/0 conn(0x7ff9e80cbf50 0x7ff9e80c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e6d9d700 1 -- 172.21.15.135:0/4250231056 >> v1:172.21.15.135:6789/0 conn(0x7ff9e81535a0 legacy=0x7ff9e806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e6d9d700 1 -- 172.21.15.135:0/4250231056 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e815d140 con 0x7ff9e8072ae0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e559a700 1 -- 172.21.15.135:0/4250231056 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071813926 0 0) 0x7ff9e815c990 con 0x7ff9e81535a0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e6d9d700 1 --2- 172.21.15.135:0/4250231056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e8072ae0 0x7ff9e80c45f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80c9350 tx=0x7ff9e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b484acae15fec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e559a700 1 -- 172.21.15.135:0/4250231056 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e000e070 con 0x7ff9e8072ae0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e559a700 1 -- 172.21.15.135:0/4250231056 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e000bb20 con 0x7ff9e8072ae0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.126+0000 7ff9e559a700 1 -- 172.21.15.135:0/4250231056 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0012430 con 0x7ff9e8072ae0 2024-05-08T21:21:10.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 -- 172.21.15.135:0/4250231056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e8072ae0 msgr2=0x7ff9e80c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 --2- 172.21.15.135:0/4250231056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e8072ae0 0x7ff9e80c45f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80c9350 tx=0x7ff9e000b330 comp rx=0 tx=0).stop 2024-05-08T21:21:10.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 -- 172.21.15.135:0/4250231056 shutdown_connections 2024-05-08T21:21:10.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 --2- 172.21.15.135:0/4250231056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e8072ae0 0x7ff9e80c45f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 --2- 172.21.15.135:0/4250231056 >> v2:172.21.15.183:3300/0 conn(0x7ff9e80cbf50 0x7ff9e80c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 -- 172.21.15.135:0/4250231056 >> 172.21.15.135:0/4250231056 conn(0x7ff9e806daf0 msgr2=0x7ff9e806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:10.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 -- 172.21.15.135:0/4250231056 shutdown_connections 2024-05-08T21:21:10.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.127+0000 7ff9ec892700 1 -- 172.21.15.135:0/4250231056 wait complete. 2024-05-08T21:21:10.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.128+0000 7ff9ec892700 1 Processor -- start 2024-05-08T21:21:10.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.128+0000 7ff9ec892700 1 -- start start 2024-05-08T21:21:10.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9ec892700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8072ae0 0x7ff9e8153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9ec892700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e80cbf50 0x7ff9e814c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9ec892700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e81535a0 0x7ff9e814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9ec892700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8154970 con 0x7ff9e81535a0 2024-05-08T21:21:10.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9ec892700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81f2250 con 0x7ff9e8072ae0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9ec892700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8154190 con 0x7ff9e80cbf50 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e81535a0 0x7ff9e814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e81535a0 0x7ff9e814cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34896/0 (socket says 172.21.15.135:34896) 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 -- 172.21.15.135:0/3113411105 learned_addr learned my addr 172.21.15.135:0/3113411105 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e5d9b700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e80cbf50 0x7ff9e814c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e659c700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8072ae0 0x7ff9e8153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 -- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e80cbf50 msgr2=0x7ff9e814c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e80cbf50 0x7ff9e814c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 -- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8072ae0 msgr2=0x7ff9e8153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8072ae0 0x7ff9e8153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 -- 172.21.15.135:0/3113411105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e0009a70 con 0x7ff9e81535a0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.129+0000 7ff9e6d9d700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e81535a0 0x7ff9e814cf40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000b680 tx=0x7ff9e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.130+0000 7ff9d6ffd700 1 -- 172.21.15.135:0/3113411105 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0012430 con 0x7ff9e81535a0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.130+0000 7ff9d6ffd700 1 -- 172.21.15.135:0/3113411105 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0020070 con 0x7ff9e81535a0 2024-05-08T21:21:10.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.130+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e814c650 con 0x7ff9e81535a0 2024-05-08T21:21:10.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.130+0000 7ff9d6ffd700 1 -- 172.21.15.135:0/3113411105 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0004280 con 0x7ff9e81535a0 2024-05-08T21:21:10.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.130+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e8154690 con 0x7ff9e81535a0 2024-05-08T21:21:10.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.131+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e80c33c0 con 0x7ff9e81535a0 2024-05-08T21:21:10.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.131+0000 7ff9d6ffd700 1 -- 172.21.15.135:0/3113411105 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff9e00043e0 con 0x7ff9e81535a0 2024-05-08T21:21:10.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.131+0000 7ff9d6ffd700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff9c806ac90 0x7ff9c806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.132+0000 7ff9d6ffd700 1 -- 172.21.15.135:0/3113411105 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff9e0022070 con 0x7ff9e81535a0 2024-05-08T21:21:10.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.132+0000 7ff9e659c700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff9c806ac90 0x7ff9c806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.132+0000 7ff9e659c700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff9c806ac90 0x7ff9c806d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc000f60 tx=0x7ff9dc007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.136+0000 7ff9d6ffd700 1 -- 172.21.15.135:0/3113411105 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff9e0056310 con 0x7ff9e81535a0 2024-05-08T21:21:10.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.333+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9e81f2c60 con 0x7ff9e81535a0 2024-05-08T21:21:10.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.333+0000 7ff9d6ffd700 1 -- 172.21.15.135:0/3113411105 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9e81f2c60 con 0x7ff9e81535a0 2024-05-08T21:21:10.335 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff9c806ac90 msgr2=0x7ff9c806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff9c806ac90 0x7ff9c806d150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc000f60 tx=0x7ff9dc007e70 comp rx=0 tx=0).stop 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e81535a0 msgr2=0x7ff9e814cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e81535a0 0x7ff9e814cf40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000b680 tx=0x7ff9e0004ad0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 shutdown_connections 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff9c806ac90 0x7ff9c806d150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9e8072ae0 0x7ff9e8153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e81535a0 0x7ff9e814cf40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 --2- 172.21.15.135:0/3113411105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9e80cbf50 0x7ff9e814c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 >> 172.21.15.135:0/3113411105 conn(0x7ff9e806daf0 msgr2=0x7ff9e80c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 shutdown_connections 2024-05-08T21:21:10.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.335+0000 7ff9ec892700 1 -- 172.21.15.135:0/3113411105 wait complete. 2024-05-08T21:21:10.350 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T21:21:10.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.471+0000 7fc51cf7d700 1 Processor -- start 2024-05-08T21:21:10.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.471+0000 7fc51cf7d700 1 -- start start 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.472+0000 7fc51cf7d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc5180cbf50 0x7fc5180c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.472+0000 7fc51cf7d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc518072ae0 0x7fc5180c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.472+0000 7fc51cf7d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51815c990 con 0x7fc5181535a0 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.472+0000 7fc51cf7d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51815cbc0 con 0x7fc5180cbf50 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.472+0000 7fc51cf7d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815ce60 con 0x7fc518072ae0 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc516d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc518072ae0 0x7fc5180c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc515d9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc5180cbf50 0x7fc5180c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc516d9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc518072ae0 0x7fc5180c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:39858/0 (socket says 172.21.15.135:39858) 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc516d9d700 1 -- 172.21.15.135:0/947007921 learned_addr learned my addr 172.21.15.135:0/947007921 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc515d9b700 1 -- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc518072ae0 msgr2=0x7fc5180c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc515d9b700 1 --2- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc518072ae0 0x7fc5180c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc515d9b700 1 -- 172.21.15.135:0/947007921 >> v1:172.21.15.183:6789/0 conn(0x7fc5181535a0 legacy=0x7fc51806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc515d9b700 1 -- 172.21.15.135:0/947007921 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51815d140 con 0x7fc5180cbf50 2024-05-08T21:21:10.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc516d9d700 1 --2- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc518072ae0 0x7fc5180c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:10.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc515d9b700 1 --2- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5180cbf50 0x7fc5180c40b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc508009840 tx=0x7fc508009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58fe0e6d3ad39609 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc51559a700 1 -- 172.21.15.135:0/947007921 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508011830 con 0x7fc5180cbf50 2024-05-08T21:21:10.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc51559a700 1 -- 172.21.15.135:0/947007921 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508011990 con 0x7fc5180cbf50 2024-05-08T21:21:10.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.473+0000 7fc51559a700 1 -- 172.21.15.135:0/947007921 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508011d20 con 0x7fc5180cbf50 2024-05-08T21:21:10.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 -- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5180cbf50 msgr2=0x7fc5180c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5180cbf50 0x7fc5180c40b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc508009840 tx=0x7fc508009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:10.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 -- 172.21.15.135:0/947007921 shutdown_connections 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc518072ae0 0x7fc5180c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/947007921 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5180cbf50 0x7fc5180c40b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 -- 172.21.15.135:0/947007921 >> 172.21.15.135:0/947007921 conn(0x7fc51806daf0 msgr2=0x7fc51806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 -- 172.21.15.135:0/947007921 shutdown_connections 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.474+0000 7fc51cf7d700 1 -- 172.21.15.135:0/947007921 wait complete. 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.475+0000 7fc51cf7d700 1 Processor -- start 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.475+0000 7fc51cf7d700 1 -- start start 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc51cf7d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc518072ae0 0x7fc518152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc51cf7d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5180cbf50 0x7fc51815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc51cf7d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5181535a0 0x7fc5181f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc51cf7d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815b330 con 0x7fc5181535a0 2024-05-08T21:21:10.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc51cf7d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815b610 con 0x7fc518072ae0 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc51cf7d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51815b8f0 con 0x7fc5180cbf50 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc516d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5181535a0 0x7fc5181f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc516d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5181535a0 0x7fc5181f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34904/0 (socket says 172.21.15.135:34904) 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc516d9d700 1 -- 172.21.15.135:0/3677351754 learned_addr learned my addr 172.21.15.135:0/3677351754 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc515d9b700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5180cbf50 0x7fc51815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc51659c700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc518072ae0 0x7fc518152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc516d9d700 1 -- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5180cbf50 msgr2=0x7fc51815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc516d9d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5180cbf50 0x7fc51815a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.476+0000 7fc516d9d700 1 -- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc518072ae0 msgr2=0x7fc518152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc516d9d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc518072ae0 0x7fc518152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc516d9d700 1 -- 172.21.15.135:0/3677351754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510009b30 con 0x7fc5181535a0 2024-05-08T21:21:10.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc516d9d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5181535a0 0x7fc5181f2370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc51000efc0 tx=0x7fc51000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc506ffd700 1 -- 172.21.15.135:0/3677351754 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510018070 con 0x7fc5181535a0 2024-05-08T21:21:10.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc506ffd700 1 -- 172.21.15.135:0/3677351754 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51000f040 con 0x7fc5181535a0 2024-05-08T21:21:10.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc506ffd700 1 -- 172.21.15.135:0/3677351754 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc510003c20 con 0x7fc5181535a0 2024-05-08T21:21:10.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5080094a0 con 0x7fc5181535a0 2024-05-08T21:21:10.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.477+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51815beb0 con 0x7fc5181535a0 2024-05-08T21:21:10.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.478+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5180c33c0 con 0x7fc5181535a0 2024-05-08T21:21:10.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.478+0000 7fc506ffd700 1 -- 172.21.15.135:0/3677351754 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc51000c880 con 0x7fc5181535a0 2024-05-08T21:21:10.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.479+0000 7fc506ffd700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc4f806acc0 0x7fc4f806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.479+0000 7fc506ffd700 1 -- 172.21.15.135:0/3677351754 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc510089900 con 0x7fc5181535a0 2024-05-08T21:21:10.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.479+0000 7fc51659c700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc4f806acc0 0x7fc4f806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.479+0000 7fc51659c700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc4f806acc0 0x7fc4f806d180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc50c007fd0 tx=0x7fc50c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.483+0000 7fc506ffd700 1 -- 172.21.15.135:0/3677351754 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc510054680 con 0x7fc5181535a0 2024-05-08T21:21:10.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.677+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc518067fa0 con 0x7fc5181535a0 2024-05-08T21:21:10.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.677+0000 7fc506ffd700 1 -- 172.21.15.135:0/3677351754 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc510057ca0 con 0x7fc5181535a0 2024-05-08T21:21:10.680 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-05-08T21:21:10.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc4f806acc0 msgr2=0x7fc4f806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc4f806acc0 0x7fc4f806d180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc50c007fd0 tx=0x7fc50c009040 comp rx=0 tx=0).stop 2024-05-08T21:21:10.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5181535a0 msgr2=0x7fc5181f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5181535a0 0x7fc5181f2370 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc51000efc0 tx=0x7fc51000c3a0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 shutdown_connections 2024-05-08T21:21:10.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc4f806acc0 0x7fc4f806d180 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc518072ae0 0x7fc518152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5181535a0 0x7fc5181f2370 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 --2- 172.21.15.135:0/3677351754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5180cbf50 0x7fc51815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.679+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 >> 172.21.15.135:0/3677351754 conn(0x7fc51806daf0 msgr2=0x7fc51806b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:10.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.680+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 shutdown_connections 2024-05-08T21:21:10.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.680+0000 7fc51cf7d700 1 -- 172.21.15.135:0/3677351754 wait complete. 2024-05-08T21:21:10.694 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:21:10.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc34657b700 1 Processor -- start 2024-05-08T21:21:10.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc34657b700 1 -- start start 2024-05-08T21:21:10.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc34657b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3401504c0 0x7fc3400c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc34657b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc340159ae0 0x7fc3400c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc34657b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3401508a0 con 0x7fc340159670 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc34657b700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400c2de0 con 0x7fc3401504c0 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc34657b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c5720 con 0x7fc340159ae0 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.815+0000 7fc33f7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fc340159670 0x7fc340072730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:53314/0 (socket says 172.21.15.135:53314) 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33f7fe700 1 -- 172.21.15.135:0/2137133506 learned_addr learned my addr 172.21.15.135:0/2137133506 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33ffff700 1 --2- 172.21.15.135:0/2137133506 >> v2:172.21.15.183:3300/0 conn(0x7fc3401504c0 0x7fc3400c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc344b18700 1 --2- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc340159ae0 0x7fc3400c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33effd700 1 -- 172.21.15.135:0/2137133506 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680649415 0 0) 0x7fc3401508a0 con 0x7fc340159670 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33effd700 1 -- 172.21.15.135:0/2137133506 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3280035b0 con 0x7fc340159670 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33ffff700 1 -- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc340159ae0 msgr2=0x7fc3400c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33ffff700 1 --2- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc340159ae0 0x7fc3400c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33ffff700 1 -- 172.21.15.135:0/2137133506 >> v1:172.21.15.135:6789/0 conn(0x7fc340159670 legacy=0x7fc340072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33ffff700 1 -- 172.21.15.135:0/2137133506 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340072e40 con 0x7fc3401504c0 2024-05-08T21:21:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc344b18700 1 --2- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc340159ae0 0x7fc3400c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33ffff700 1 --2- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3401504c0 0x7fc3400c51e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc330009840 tx=0x7fc330009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17d49188a9eedc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33effd700 1 -- 172.21.15.135:0/2137133506 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330011830 con 0x7fc3401504c0 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33effd700 1 -- 172.21.15.135:0/2137133506 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc330011990 con 0x7fc3401504c0 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.816+0000 7fc33effd700 1 -- 172.21.15.135:0/2137133506 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330011d20 con 0x7fc3401504c0 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 -- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3401504c0 msgr2=0x7fc3400c51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 --2- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3401504c0 0x7fc3400c51e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc330009840 tx=0x7fc330009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 -- 172.21.15.135:0/2137133506 shutdown_connections 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 --2- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc340159ae0 0x7fc3400c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 --2- 172.21.15.135:0/2137133506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3401504c0 0x7fc3400c51e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 -- 172.21.15.135:0/2137133506 >> 172.21.15.135:0/2137133506 conn(0x7fc34006daf0 msgr2=0x7fc34006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 -- 172.21.15.135:0/2137133506 shutdown_connections 2024-05-08T21:21:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.817+0000 7fc34657b700 1 -- 172.21.15.135:0/2137133506 wait complete. 2024-05-08T21:21:10.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.818+0000 7fc34657b700 1 Processor -- start 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.818+0000 7fc34657b700 1 -- start start 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc34657b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3401504c0 0x7fc3401eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc34657b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc340159670 0x7fc34014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc34657b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc340159ae0 0x7fc34014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc34657b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401ef400 con 0x7fc340159ae0 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc34657b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401f2b90 con 0x7fc340159670 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc34657b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34006b130 con 0x7fc3401504c0 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc340159ae0 0x7fc34014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc340159ae0 0x7fc34014da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:34918/0 (socket says 172.21.15.135:34918) 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 -- 172.21.15.135:0/184025870 learned_addr learned my addr 172.21.15.135:0/184025870 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc33ffff700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3401504c0 0x7fc3401eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc33f7fe700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc340159670 0x7fc34014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 -- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3401504c0 msgr2=0x7fc3401eeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3401504c0 0x7fc3401eeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 -- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc340159670 msgr2=0x7fc34014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc340159670 0x7fc34014b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.819+0000 7fc344b18700 1 -- 172.21.15.135:0/184025870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338009a70 con 0x7fc340159ae0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.820+0000 7fc344b18700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc340159ae0 0x7fc34014da50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e00 tx=0x7fc33800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.820+0000 7fc33cff9700 1 -- 172.21.15.135:0/184025870 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33800cc90 con 0x7fc340159ae0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.820+0000 7fc33cff9700 1 -- 172.21.15.135:0/184025870 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33800f040 con 0x7fc340159ae0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.820+0000 7fc33cff9700 1 -- 172.21.15.135:0/184025870 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338014480 con 0x7fc340159ae0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.820+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3300094a0 con 0x7fc340159ae0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.820+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34006ae50 con 0x7fc340159ae0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.821+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc340067fa0 con 0x7fc340159ae0 2024-05-08T21:21:10.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.822+0000 7fc33cff9700 1 -- 172.21.15.135:0/184025870 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3380145e0 con 0x7fc340159ae0 2024-05-08T21:21:10.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.822+0000 7fc33cff9700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc32c06ac90 0x7fc32c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:10.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.822+0000 7fc33cff9700 1 -- 172.21.15.135:0/184025870 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc33808a910 con 0x7fc340159ae0 2024-05-08T21:21:10.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.822+0000 7fc33ffff700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc32c06ac90 0x7fc32c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:10.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.822+0000 7fc33ffff700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc32c06ac90 0x7fc32c06d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc330000c00 tx=0x7fc330008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:10.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:10.826+0000 7fc33cff9700 1 -- 172.21.15.135:0/184025870 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc338055680 con 0x7fc340159ae0 2024-05-08T21:21:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.038+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc34006f750 con 0x7fc340159ae0 2024-05-08T21:21:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.038+0000 7fc33cff9700 1 -- 172.21.15.135:0/184025870 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc34006f750 con 0x7fc340159ae0 2024-05-08T21:21:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc32c06ac90 msgr2=0x7fc32c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc32c06ac90 0x7fc32c06d150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc330000c00 tx=0x7fc330008030 comp rx=0 tx=0).stop 2024-05-08T21:21:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc340159ae0 msgr2=0x7fc34014da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc340159ae0 0x7fc34014da50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc338009e00 tx=0x7fc33800c3a0 comp rx=0 tx=0).stop 2024-05-08T21:21:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 shutdown_connections 2024-05-08T21:21:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fc32c06ac90 0x7fc32c06d150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:11.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc340159ae0 0x7fc34014da50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3401504c0 0x7fc3401eeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 --2- 172.21.15.135:0/184025870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc340159670 0x7fc34014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 >> 172.21.15.135:0/184025870 conn(0x7fc34006daf0 msgr2=0x7fc34006ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 shutdown_connections 2024-05-08T21:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:11.041+0000 7fc34657b700 1 -- 172.21.15.135:0/184025870 wait complete. 2024-05-08T21:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:listed 0 entries 2024-05-08T21:21:11.055 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2024-05-08T21:21:11.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:21:11.055 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T21:21:11.098 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:21:11.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi135.stderr:ceph-fuse[59034]: fuse finished with error 0 and tester_r 0 2024-05-08T21:21:17.200 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T21:21:17.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:21:17.200 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T21:21:17.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:21:17.235 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-05-08T21:21:17.319 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T21:21:17.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:21:17.319 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T21:21:17.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:21:17.365 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-05-08T21:21:17.452 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T21:21:17.463 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T21:21:17.463 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:21:17.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.590+0000 7f2585c95700 1 Processor -- start 2024-05-08T21:21:17.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.590+0000 7f2585c95700 1 -- start start 2024-05-08T21:21:17.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.590+0000 7f2585c95700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801570d0 0x7f25800c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.590+0000 7f2585c95700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25800c7f00 0x7f25800c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.590+0000 7f2585c95700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800c2a80 con 0x7f25801512c0 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.590+0000 7f2585c95700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800c7530 con 0x7f25800c7f00 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.590+0000 7f2585c95700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2580157560 con 0x7f25801570d0 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25800c7f00 0x7f25800c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f25800c7f00 0x7f25800c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47694/0 (socket says 172.21.15.135:47694) 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 -- 172.21.15.135:0/911244345 learned_addr learned my addr 172.21.15.135:0/911244345 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257effd700 1 --2- 172.21.15.135:0/911244345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801570d0 0x7f25800c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 -- 172.21.15.135:0/911244345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801570d0 msgr2=0x7f25800c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 --2- 172.21.15.135:0/911244345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801570d0 0x7f25800c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 -- 172.21.15.135:0/911244345 >> v1:172.21.15.183:6789/0 conn(0x7f25801512c0 legacy=0x7f25800c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 -- 172.21.15.135:0/911244345 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580157840 con 0x7f25800c7f00 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257ffff700 1 --2- 172.21.15.135:0/911244345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c6630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2578009e50 tx=0x7f257800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dfba42eefcca84 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.591+0000 7f257e7fc700 1 -- 172.21.15.135:0/911244345 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257800e070 con 0x7f25800c7f00 2024-05-08T21:21:17.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f257e7fc700 1 -- 172.21.15.135:0/911244345 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257800b9c0 con 0x7f25800c7f00 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f257e7fc700 1 -- 172.21.15.135:0/911244345 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257800bd70 con 0x7f25800c7f00 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 -- 172.21.15.135:0/911244345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 msgr2=0x7f25800c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 --2- 172.21.15.135:0/911244345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c6630 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2578009e50 tx=0x7f257800b330 comp rx=0 tx=0).stop 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 -- 172.21.15.135:0/911244345 shutdown_connections 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 --2- 172.21.15.135:0/911244345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c6630 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 --2- 172.21.15.135:0/911244345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801570d0 0x7f25800c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 -- 172.21.15.135:0/911244345 >> 172.21.15.135:0/911244345 conn(0x7f258006a960 msgr2=0x7f258006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 -- 172.21.15.135:0/911244345 shutdown_connections 2024-05-08T21:21:17.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.592+0000 7f2585c95700 1 -- 172.21.15.135:0/911244345 wait complete. 2024-05-08T21:21:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.594+0000 7f2585c95700 1 Processor -- start 2024-05-08T21:21:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.594+0000 7f2585c95700 1 -- start start 2024-05-08T21:21:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.594+0000 7f2585c95700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2585c95700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801512c0 0x7f2580152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2585c95700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25801efe20 0x7f2580152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2585c95700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258015a160 con 0x7f25800c7f00 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2585c95700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580159df0 con 0x7f25801efe20 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2585c95700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258015aff0 con 0x7f25801512c0 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47706/0 (socket says 172.21.15.135:47706) 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 -- 172.21.15.135:0/839486529 learned_addr learned my addr 172.21.15.135:0/839486529 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257effd700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801512c0 0x7f2580152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257ffff700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25801efe20 0x7f2580152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 -- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801512c0 msgr2=0x7f2580152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801512c0 0x7f2580152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 -- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25801efe20 msgr2=0x7f2580152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25801efe20 0x7f2580152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 -- 172.21.15.135:0/839486529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578009b30 con 0x7f25800c7f00 2024-05-08T21:21:17.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f257f7fe700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c68a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f257000c510 tx=0x7f257000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2567fff700 1 -- 172.21.15.135:0/839486529 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700052d0 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2567fff700 1 -- 172.21.15.135:0/839486529 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570005430 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2580158a70 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2567fff700 1 -- 172.21.15.135:0/839486529 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25700038c0 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.595+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580159030 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.596+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25800cb830 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.597+0000 7f2567fff700 1 -- 172.21.15.135:0/839486529 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2570003a20 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.597+0000 7f2567fff700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f256c06ac90 0x7f256c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.597+0000 7f2567fff700 1 -- 172.21.15.135:0/839486529 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2570088af0 con 0x7f25800c7f00 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.597+0000 7f257effd700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f256c06ac90 0x7f256c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.597+0000 7f257effd700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f256c06ac90 0x7f256c06d150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2580155b70 tx=0x7f2574008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:17.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.601+0000 7f2567fff700 1 -- 172.21.15.135:0/839486529 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2570053910 con 0x7f25800c7f00 2024-05-08T21:21:17.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.797+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25800c4d40 con 0x7f256c06ac90 2024-05-08T21:21:17.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.808+0000 7f2567fff700 1 -- 172.21.15.135:0/839486529 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371722 (secure 0 0 0) 0x7f25800c4d40 con 0x7f256c06ac90 2024-05-08T21:21:17.815 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f256c06ac90 msgr2=0x7f256c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f256c06ac90 0x7f256c06d150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2580155b70 tx=0x7f2574008040 comp rx=0 tx=0).stop 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 msgr2=0x7f25800c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c68a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f257000c510 tx=0x7f257000c8d0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 shutdown_connections 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f256c06ac90 0x7f256c06d150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25801efe20 0x7f2580152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25800c7f00 0x7f25800c68a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 --2- 172.21.15.135:0/839486529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f25801512c0 0x7f2580152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 >> 172.21.15.135:0/839486529 conn(0x7f258006a960 msgr2=0x7f258006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:17.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 shutdown_connections 2024-05-08T21:21:17.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.812+0000 7f2585c95700 1 -- 172.21.15.135:0/839486529 wait complete. 2024-05-08T21:21:17.820 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:21:17.827 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":815,"stamp":"2024-05-08T21:21:16.811318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244154016,"num_objects":84,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":3046,"num_read_kb":7629,"num_write":179634,"num_write_kb":3998160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256972,"ondisk_log_size":256972,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3864680,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3385395,"kb_avail":751110040,"statfs":{"total":773094113280,"available":769136680960,"internally_reserved":0,"allocated":490708992,"data_stored":489263520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3466645049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-232700295,"num_objects":-1457,"num_object_clones":0,"num_object_copies":-4484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1457,"num_whiteouts":0,"num_read":14,"num_read_kb":114,"num_write":1718,"num_write_kb":3651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004858"},"pg_stats":[{"pgid":"3.3f","version":"27'766","reported_seq":794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.653284+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T21:21:05.653284+0000","last_peered":"2024-05-08T21:21:05.653284+0000","last_clean":"2024-05-08T21:21:05.653284+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:21:05.653284+0000","last_undegraded":"2024-05-08T21:21:05.653284+0000","last_fullsized":"2024-05-08T21:21:05.653284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'768","reported_seq":795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.903622+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T21:21:06.903622+0000","last_peered":"2024-05-08T21:21:06.903622+0000","last_clean":"2024-05-08T21:21:06.903622+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:06.903622+0000","last_undegraded":"2024-05-08T21:21:06.903622+0000","last_fullsized":"2024-05-08T21:21:06.903622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'855","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.677757+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T21:21:05.677757+0000","last_peered":"2024-05-08T21:21:05.677757+0000","last_clean":"2024-05-08T21:21:05.677757+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:05.677757+0000","last_undegraded":"2024-05-08T21:21:05.677757+0000","last_fullsized":"2024-05-08T21:21:05.677757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'815","reported_seq":843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905285+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T21:21:06.905285+0000","last_peered":"2024-05-08T21:21:06.905285+0000","last_clean":"2024-05-08T21:21:06.905285+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:06.905285+0000","last_undegraded":"2024-05-08T21:21:06.905285+0000","last_fullsized":"2024-05-08T21:21:06.905285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'856","reported_seq":882,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.854816+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T21:21:06.854816+0000","last_peered":"2024-05-08T21:21:06.854816+0000","last_clean":"2024-05-08T21:21:06.854816+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:21:06.854816+0000","last_undegraded":"2024-05-08T21:21:06.854816+0000","last_fullsized":"2024-05-08T21:21:06.854816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'761","reported_seq":786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.542541+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T21:21:05.542541+0000","last_peered":"2024-05-08T21:21:05.542541+0000","last_clean":"2024-05-08T21:21:05.542541+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:21:05.542541+0000","last_undegraded":"2024-05-08T21:21:05.542541+0000","last_fullsized":"2024-05-08T21:21:05.542541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'806","reported_seq":832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.801733+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T21:21:06.801733+0000","last_peered":"2024-05-08T21:21:06.801733+0000","last_clean":"2024-05-08T21:21:06.801733+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:06.801733+0000","last_undegraded":"2024-05-08T21:21:06.801733+0000","last_fullsized":"2024-05-08T21:21:06.801733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'779","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.721659+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T21:21:05.721659+0000","last_peered":"2024-05-08T21:21:05.721659+0000","last_clean":"2024-05-08T21:21:05.721659+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:05.721659+0000","last_undegraded":"2024-05-08T21:21:05.721659+0000","last_fullsized":"2024-05-08T21:21:05.721659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'835","reported_seq":861,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.801044+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T21:21:06.801044+0000","last_peered":"2024-05-08T21:21:06.801044+0000","last_clean":"2024-05-08T21:21:06.801044+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:21:06.801044+0000","last_undegraded":"2024-05-08T21:21:06.801044+0000","last_fullsized":"2024-05-08T21:21:06.801044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'792","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.665982+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T21:21:05.665982+0000","last_peered":"2024-05-08T21:21:05.665982+0000","last_clean":"2024-05-08T21:21:05.665982+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:05.665982+0000","last_undegraded":"2024-05-08T21:21:05.665982+0000","last_fullsized":"2024-05-08T21:21:05.665982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'813","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889805+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T21:21:06.889805+0000","last_peered":"2024-05-08T21:21:06.889805+0000","last_clean":"2024-05-08T21:21:06.889805+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:06.889805+0000","last_undegraded":"2024-05-08T21:21:06.889805+0000","last_fullsized":"2024-05-08T21:21:06.889805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'787","reported_seq":813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.177960+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T21:21:05.177960+0000","last_peered":"2024-05-08T21:21:05.177960+0000","last_clean":"2024-05-08T21:21:05.177960+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:05.177960+0000","last_undegraded":"2024-05-08T21:21:05.177960+0000","last_fullsized":"2024-05-08T21:21:05.177960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'803","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714883+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T21:21:05.714883+0000","last_peered":"2024-05-08T21:21:05.714883+0000","last_clean":"2024-05-08T21:21:05.714883+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:05.714883+0000","last_undegraded":"2024-05-08T21:21:05.714883+0000","last_fullsized":"2024-05-08T21:21:05.714883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'795","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.721613+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T21:21:05.721613+0000","last_peered":"2024-05-08T21:21:05.721613+0000","last_clean":"2024-05-08T21:21:05.721613+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:05.721613+0000","last_undegraded":"2024-05-08T21:21:05.721613+0000","last_fullsized":"2024-05-08T21:21:05.721613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'846","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.802398+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T21:21:06.802398+0000","last_peered":"2024-05-08T21:21:06.802398+0000","last_clean":"2024-05-08T21:21:06.802398+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:06.802398+0000","last_undegraded":"2024-05-08T21:21:06.802398+0000","last_fullsized":"2024-05-08T21:21:06.802398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'800","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.446971+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T21:21:05.446971+0000","last_peered":"2024-05-08T21:21:05.446971+0000","last_clean":"2024-05-08T21:21:05.446971+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:05.446971+0000","last_undegraded":"2024-05-08T21:21:05.446971+0000","last_fullsized":"2024-05-08T21:21:05.446971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'862","reported_seq":888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.792238+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T21:21:06.792238+0000","last_peered":"2024-05-08T21:21:06.792238+0000","last_clean":"2024-05-08T21:21:06.792238+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:06.792238+0000","last_undegraded":"2024-05-08T21:21:06.792238+0000","last_fullsized":"2024-05-08T21:21:06.792238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'779","reported_seq":806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.303249+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T21:21:05.303249+0000","last_peered":"2024-05-08T21:21:05.303249+0000","last_clean":"2024-05-08T21:21:05.303249+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:05.303249+0000","last_undegraded":"2024-05-08T21:21:05.303249+0000","last_fullsized":"2024-05-08T21:21:05.303249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'832","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.698055+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T21:21:05.698055+0000","last_peered":"2024-05-08T21:21:05.698055+0000","last_clean":"2024-05-08T21:21:05.698055+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:21:05.698055+0000","last_undegraded":"2024-05-08T21:21:05.698055+0000","last_fullsized":"2024-05-08T21:21:05.698055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.802125+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T21:21:06.802125+0000","last_peered":"2024-05-08T21:21:06.802125+0000","last_clean":"2024-05-08T21:21:06.802125+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:21:06.802125+0000","last_undegraded":"2024-05-08T21:21:06.802125+0000","last_fullsized":"2024-05-08T21:21:06.802125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:53.835534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1868","reported_seq":1897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.875447+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T21:21:06.875447+0000","last_peered":"2024-05-08T21:21:06.875447+0000","last_clean":"2024-05-08T21:21:06.875447+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:06.875447+0000","last_undegraded":"2024-05-08T21:21:06.875447+0000","last_fullsized":"2024-05-08T21:21:06.875447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'804","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.814873+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T21:21:06.814873+0000","last_peered":"2024-05-08T21:21:06.814873+0000","last_clean":"2024-05-08T21:21:06.814873+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:06.814873+0000","last_undegraded":"2024-05-08T21:21:06.814873+0000","last_fullsized":"2024-05-08T21:21:06.814873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.798727+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T21:21:06.798727+0000","last_peered":"2024-05-08T21:21:06.798727+0000","last_clean":"2024-05-08T21:21:06.798727+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:06.798727+0000","last_undegraded":"2024-05-08T21:21:06.798727+0000","last_fullsized":"2024-05-08T21:21:06.798727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4025","reported_seq":4055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.638275+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T21:21:07.638275+0000","last_peered":"2024-05-08T21:21:07.638275+0000","last_clean":"2024-05-08T21:21:07.638275+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:07.638275+0000","last_undegraded":"2024-05-08T21:21:07.638275+0000","last_fullsized":"2024-05-08T21:21:07.638275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'773","reported_seq":801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.798371+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T21:21:06.798371+0000","last_peered":"2024-05-08T21:21:06.798371+0000","last_clean":"2024-05-08T21:21:06.798371+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:06.798371+0000","last_undegraded":"2024-05-08T21:21:06.798371+0000","last_fullsized":"2024-05-08T21:21:06.798371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.904663+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T21:21:06.904663+0000","last_peered":"2024-05-08T21:21:06.904663+0000","last_clean":"2024-05-08T21:21:06.904663+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:21:06.904663+0000","last_undegraded":"2024-05-08T21:21:06.904663+0000","last_fullsized":"2024-05-08T21:21:06.904663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:49.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4862","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795131+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T21:21:07.795131+0000","last_peered":"2024-05-08T21:21:07.795131+0000","last_clean":"2024-05-08T21:21:07.795131+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:07.795131+0000","last_undegraded":"2024-05-08T21:21:07.795131+0000","last_fullsized":"2024-05-08T21:21:07.795131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4862,"log_dups_size":0,"ondisk_log_size":4862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'852","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.820407+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T21:21:06.820407+0000","last_peered":"2024-05-08T21:21:06.820407+0000","last_clean":"2024-05-08T21:21:06.820407+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:21:06.820407+0000","last_undegraded":"2024-05-08T21:21:06.820407+0000","last_fullsized":"2024-05-08T21:21:06.820407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.807673+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T21:21:06.807673+0000","last_peered":"2024-05-08T21:21:06.807673+0000","last_clean":"2024-05-08T21:21:06.807673+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:06.807673+0000","last_undegraded":"2024-05-08T21:21:06.807673+0000","last_fullsized":"2024-05-08T21:21:06.807673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1175","reported_seq":1202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.868441+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T21:21:06.868441+0000","last_peered":"2024-05-08T21:21:06.868441+0000","last_clean":"2024-05-08T21:21:06.868441+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:06.868441+0000","last_undegraded":"2024-05-08T21:21:06.868441+0000","last_fullsized":"2024-05-08T21:21:06.868441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'819","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.541985+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T21:21:05.541985+0000","last_peered":"2024-05-08T21:21:05.541985+0000","last_clean":"2024-05-08T21:21:05.541985+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:21:05.541985+0000","last_undegraded":"2024-05-08T21:21:05.541985+0000","last_fullsized":"2024-05-08T21:21:05.541985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.692949+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T21:21:05.692949+0000","last_peered":"2024-05-08T21:21:05.692949+0000","last_clean":"2024-05-08T21:21:05.692949+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:21:05.692949+0000","last_undegraded":"2024-05-08T21:21:05.692949+0000","last_fullsized":"2024-05-08T21:21:05.692949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:15.767597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2315","reported_seq":2342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.892014+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T21:21:06.892014+0000","last_peered":"2024-05-08T21:21:06.892014+0000","last_clean":"2024-05-08T21:21:06.892014+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:06.892014+0000","last_undegraded":"2024-05-08T21:21:06.892014+0000","last_fullsized":"2024-05-08T21:21:06.892014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'822","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.687112+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T21:21:05.687112+0000","last_peered":"2024-05-08T21:21:05.687112+0000","last_clean":"2024-05-08T21:21:05.687112+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:05.687112+0000","last_undegraded":"2024-05-08T21:21:05.687112+0000","last_fullsized":"2024-05-08T21:21:05.687112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:00.135628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905860+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T21:21:06.905860+0000","last_peered":"2024-05-08T21:21:06.905860+0000","last_clean":"2024-05-08T21:21:06.905860+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:06.905860+0000","last_undegraded":"2024-05-08T21:21:06.905860+0000","last_fullsized":"2024-05-08T21:21:06.905860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:52.925278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4376","reported_seq":4402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.789539+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T21:21:07.789539+0000","last_peered":"2024-05-08T21:21:07.789539+0000","last_clean":"2024-05-08T21:21:07.789539+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:07.789539+0000","last_undegraded":"2024-05-08T21:21:07.789539+0000","last_fullsized":"2024-05-08T21:21:07.789539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4376,"log_dups_size":0,"ondisk_log_size":4376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'810","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.891188+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T21:21:06.891188+0000","last_peered":"2024-05-08T21:21:06.891188+0000","last_clean":"2024-05-08T21:21:06.891188+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:06.891188+0000","last_undegraded":"2024-05-08T21:21:06.891188+0000","last_fullsized":"2024-05-08T21:21:06.891188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.796652+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T21:21:06.796652+0000","last_peered":"2024-05-08T21:21:06.796652+0000","last_clean":"2024-05-08T21:21:06.796652+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:21:06.796652+0000","last_undegraded":"2024-05-08T21:21:06.796652+0000","last_fullsized":"2024-05-08T21:21:06.796652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1715","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.791537+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T21:21:07.791537+0000","last_peered":"2024-05-08T21:21:07.791537+0000","last_clean":"2024-05-08T21:21:07.791537+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:07.791537+0000","last_undegraded":"2024-05-08T21:21:07.791537+0000","last_fullsized":"2024-05-08T21:21:07.791537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'873","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.712934+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T21:21:05.712934+0000","last_peered":"2024-05-08T21:21:05.712934+0000","last_clean":"2024-05-08T21:21:05.712934+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:05.712934+0000","last_undegraded":"2024-05-08T21:21:05.712934+0000","last_fullsized":"2024-05-08T21:21:05.712934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.914439+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T21:21:06.914439+0000","last_peered":"2024-05-08T21:21:06.914439+0000","last_clean":"2024-05-08T21:21:06.914439+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:06.914439+0000","last_undegraded":"2024-05-08T21:21:06.914439+0000","last_fullsized":"2024-05-08T21:21:06.914439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5269","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.598466+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T21:19:12.598466+0000","last_peered":"2024-05-08T21:19:12.598466+0000","last_clean":"2024-05-08T21:19:12.598466+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:19:12.598466+0000","last_undegraded":"2024-05-08T21:19:12.598466+0000","last_fullsized":"2024-05-08T21:19:12.598466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5269,"log_dups_size":0,"ondisk_log_size":5269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'816","reported_seq":841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.631162+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T21:21:05.631162+0000","last_peered":"2024-05-08T21:21:05.631162+0000","last_clean":"2024-05-08T21:21:05.631162+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:05.631162+0000","last_undegraded":"2024-05-08T21:21:05.631162+0000","last_fullsized":"2024-05-08T21:21:05.631162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855319+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T21:21:06.855319+0000","last_peered":"2024-05-08T21:21:06.855319+0000","last_clean":"2024-05-08T21:21:06.855319+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:21:06.855319+0000","last_undegraded":"2024-05-08T21:21:06.855319+0000","last_fullsized":"2024-05-08T21:21:06.855319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:25.005036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2689","reported_seq":3285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795020+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T21:21:07.795020+0000","last_peered":"2024-05-08T21:21:07.795020+0000","last_clean":"2024-05-08T21:21:07.795020+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:07.795020+0000","last_undegraded":"2024-05-08T21:21:07.795020+0000","last_fullsized":"2024-05-08T21:21:07.795020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1794,"num_write":2690,"num_write_kb":19158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'802","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.352224+0000","last_change":"2024-05-08T20:55:41.598425+0000","last_active":"2024-05-08T21:21:05.352224+0000","last_peered":"2024-05-08T21:21:05.352224+0000","last_clean":"2024-05-08T21:21:05.352224+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:05.352224+0000","last_undegraded":"2024-05-08T21:21:05.352224+0000","last_fullsized":"2024-05-08T21:21:05.352224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:54.987104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.631431+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T21:21:05.631431+0000","last_peered":"2024-05-08T21:21:05.631431+0000","last_clean":"2024-05-08T21:21:05.631431+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:05.631431+0000","last_undegraded":"2024-05-08T21:21:05.631431+0000","last_fullsized":"2024-05-08T21:21:05.631431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3354","reported_seq":3380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.826855+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T21:21:06.826855+0000","last_peered":"2024-05-08T21:21:06.826855+0000","last_clean":"2024-05-08T21:21:06.826855+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:06.826855+0000","last_undegraded":"2024-05-08T21:21:06.826855+0000","last_fullsized":"2024-05-08T21:21:06.826855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3354,"log_dups_size":0,"ondisk_log_size":3354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'816","reported_seq":842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.656934+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T21:21:05.656934+0000","last_peered":"2024-05-08T21:21:05.656934+0000","last_clean":"2024-05-08T21:21:05.656934+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:05.656934+0000","last_undegraded":"2024-05-08T21:21:05.656934+0000","last_fullsized":"2024-05-08T21:21:05.656934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4040,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714358+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T21:21:05.714358+0000","last_peered":"2024-05-08T21:21:05.714358+0000","last_clean":"2024-05-08T21:21:05.714358+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:21:05.714358+0000","last_undegraded":"2024-05-08T21:21:05.714358+0000","last_fullsized":"2024-05-08T21:21:05.714358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4046","reported_seq":4072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.793921+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T21:21:07.793921+0000","last_peered":"2024-05-08T21:21:07.793921+0000","last_clean":"2024-05-08T21:21:07.793921+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:07.793921+0000","last_undegraded":"2024-05-08T21:21:07.793921+0000","last_fullsized":"2024-05-08T21:21:07.793921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4046,"log_dups_size":0,"ondisk_log_size":4046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4055,"num_write_kb":23094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'822","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.439153+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T21:21:05.439153+0000","last_peered":"2024-05-08T21:21:05.439153+0000","last_clean":"2024-05-08T21:21:05.439153+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:05.439153+0000","last_undegraded":"2024-05-08T21:21:05.439153+0000","last_fullsized":"2024-05-08T21:21:05.439153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.727219+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T21:21:05.727219+0000","last_peered":"2024-05-08T21:21:05.727219+0000","last_clean":"2024-05-08T21:21:05.727219+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:21:05.727219+0000","last_undegraded":"2024-05-08T21:21:05.727219+0000","last_fullsized":"2024-05-08T21:21:05.727219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4547","reported_seq":4574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.852319+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T21:21:06.852319+0000","last_peered":"2024-05-08T21:21:06.852319+0000","last_clean":"2024-05-08T21:21:06.852319+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:06.852319+0000","last_undegraded":"2024-05-08T21:21:06.852319+0000","last_fullsized":"2024-05-08T21:21:06.852319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'799","reported_seq":825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.712819+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T21:21:05.712819+0000","last_peered":"2024-05-08T21:21:05.712819+0000","last_clean":"2024-05-08T21:21:05.712819+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:21:05.712819+0000","last_undegraded":"2024-05-08T21:21:05.712819+0000","last_fullsized":"2024-05-08T21:21:05.712819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.897454+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T21:21:06.897454+0000","last_peered":"2024-05-08T21:21:06.897454+0000","last_clean":"2024-05-08T21:21:06.897454+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:21:06.897454+0000","last_undegraded":"2024-05-08T21:21:06.897454+0000","last_fullsized":"2024-05-08T21:21:06.897454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2508","reported_seq":2536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.874597+0000","last_change":"2024-05-08T20:54:59.629962+0000","last_active":"2024-05-08T21:21:06.874597+0000","last_peered":"2024-05-08T21:21:06.874597+0000","last_clean":"2024-05-08T21:21:06.874597+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:06.874597+0000","last_undegraded":"2024-05-08T21:21:06.874597+0000","last_fullsized":"2024-05-08T21:21:06.874597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2508,"log_dups_size":0,"ondisk_log_size":2508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'791","reported_seq":811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.654638+0000","last_change":"2024-05-08T20:55:41.595254+0000","last_active":"2024-05-08T21:21:05.654638+0000","last_peered":"2024-05-08T21:21:05.654638+0000","last_clean":"2024-05-08T21:21:05.654638+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:05.654638+0000","last_undegraded":"2024-05-08T21:21:05.654638+0000","last_fullsized":"2024-05-08T21:21:05.654638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:41.183338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.547382+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T21:21:05.547382+0000","last_peered":"2024-05-08T21:21:05.547382+0000","last_clean":"2024-05-08T21:21:05.547382+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:21:05.547382+0000","last_undegraded":"2024-05-08T21:21:05.547382+0000","last_fullsized":"2024-05-08T21:21:05.547382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.959849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788155+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T21:21:07.788155+0000","last_peered":"2024-05-08T21:21:07.788155+0000","last_clean":"2024-05-08T21:21:07.788155+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:07.788155+0000","last_undegraded":"2024-05-08T21:21:07.788155+0000","last_fullsized":"2024-05-08T21:21:07.788155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'819","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.651411+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T21:21:05.651411+0000","last_peered":"2024-05-08T21:21:05.651411+0000","last_clean":"2024-05-08T21:21:05.651411+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:05.651411+0000","last_undegraded":"2024-05-08T21:21:05.651411+0000","last_fullsized":"2024-05-08T21:21:05.651411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.827287+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T21:21:06.827287+0000","last_peered":"2024-05-08T21:21:06.827287+0000","last_clean":"2024-05-08T21:21:06.827287+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:21:06.827287+0000","last_undegraded":"2024-05-08T21:21:06.827287+0000","last_fullsized":"2024-05-08T21:21:06.827287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:34.555272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1099","reported_seq":1126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794753+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T21:21:07.794753+0000","last_peered":"2024-05-08T21:21:07.794753+0000","last_clean":"2024-05-08T21:21:07.794753+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:07.794753+0000","last_undegraded":"2024-05-08T21:21:07.794753+0000","last_fullsized":"2024-05-08T21:21:07.794753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'813","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.412989+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T21:21:05.412989+0000","last_peered":"2024-05-08T21:21:05.412989+0000","last_clean":"2024-05-08T21:21:05.412989+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:05.412989+0000","last_undegraded":"2024-05-08T21:21:05.412989+0000","last_fullsized":"2024-05-08T21:21:05.412989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.715442+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T21:21:05.715442+0000","last_peered":"2024-05-08T21:21:05.715442+0000","last_clean":"2024-05-08T21:21:05.715442+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:21:05.715442+0000","last_undegraded":"2024-05-08T21:21:05.715442+0000","last_fullsized":"2024-05-08T21:21:05.715442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1824","reported_seq":1852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.790327+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T21:21:07.790327+0000","last_peered":"2024-05-08T21:21:07.790327+0000","last_clean":"2024-05-08T21:21:07.790327+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:07.790327+0000","last_undegraded":"2024-05-08T21:21:07.790327+0000","last_fullsized":"2024-05-08T21:21:07.790327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'852","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.816819+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T21:21:06.816819+0000","last_peered":"2024-05-08T21:21:06.816819+0000","last_clean":"2024-05-08T21:21:06.816819+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:06.816819+0000","last_undegraded":"2024-05-08T21:21:06.816819+0000","last_fullsized":"2024-05-08T21:21:06.816819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.903427+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T21:21:06.903427+0000","last_peered":"2024-05-08T21:21:06.903427+0000","last_clean":"2024-05-08T21:21:06.903427+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:21:06.903427+0000","last_undegraded":"2024-05-08T21:21:06.903427+0000","last_fullsized":"2024-05-08T21:21:06.903427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1830","reported_seq":1858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.877172+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T21:21:06.877172+0000","last_peered":"2024-05-08T21:21:06.877172+0000","last_clean":"2024-05-08T21:21:06.877172+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:06.877172+0000","last_undegraded":"2024-05-08T21:21:06.877172+0000","last_fullsized":"2024-05-08T21:21:06.877172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:17.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860634+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T21:21:06.860634+0000","last_peered":"2024-05-08T21:21:06.860634+0000","last_clean":"2024-05-08T21:21:06.860634+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:06.860634+0000","last_undegraded":"2024-05-08T21:21:06.860634+0000","last_fullsized":"2024-05-08T21:21:06.860634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.816432+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T21:21:06.816432+0000","last_peered":"2024-05-08T21:21:06.816432+0000","last_clean":"2024-05-08T21:21:06.816432+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:06.816432+0000","last_undegraded":"2024-05-08T21:21:06.816432+0000","last_fullsized":"2024-05-08T21:21:06.816432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1214","reported_seq":1242,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786415+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T21:21:07.786415+0000","last_peered":"2024-05-08T21:21:07.786415+0000","last_clean":"2024-05-08T21:21:07.786415+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:07.786415+0000","last_undegraded":"2024-05-08T21:21:07.786415+0000","last_fullsized":"2024-05-08T21:21:07.786415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'818","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.666674+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T21:21:05.666674+0000","last_peered":"2024-05-08T21:21:05.666674+0000","last_clean":"2024-05-08T21:21:05.666674+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:05.666674+0000","last_undegraded":"2024-05-08T21:21:05.666674+0000","last_fullsized":"2024-05-08T21:21:05.666674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.878575+0000","last_change":"2024-05-08T20:55:41.599810+0000","last_active":"2024-05-08T21:21:06.878575+0000","last_peered":"2024-05-08T21:21:06.878575+0000","last_clean":"2024-05-08T21:21:06.878575+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:21:06.878575+0000","last_undegraded":"2024-05-08T21:21:06.878575+0000","last_fullsized":"2024-05-08T21:21:06.878575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:59.058826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5314","reported_seq":5342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:08.308765+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T21:21:08.308765+0000","last_peered":"2024-05-08T21:21:08.308765+0000","last_clean":"2024-05-08T21:21:08.308765+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:08.308765+0000","last_undegraded":"2024-05-08T21:21:08.308765+0000","last_fullsized":"2024-05-08T21:21:08.308765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5314,"log_dups_size":0,"ondisk_log_size":5314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24002075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5312,"num_write_kb":42290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'808","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.408322+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T21:21:05.408322+0000","last_peered":"2024-05-08T21:21:05.408322+0000","last_clean":"2024-05-08T21:21:05.408322+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:05.408322+0000","last_undegraded":"2024-05-08T21:21:05.408322+0000","last_fullsized":"2024-05-08T21:21:05.408322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:30.883278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3417","reported_seq":3443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905261+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T21:21:06.905261+0000","last_peered":"2024-05-08T21:21:06.905261+0000","last_clean":"2024-05-08T21:21:06.905261+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:21:06.905261+0000","last_undegraded":"2024-05-08T21:21:06.905261+0000","last_fullsized":"2024-05-08T21:21:06.905261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3417,"log_dups_size":0,"ondisk_log_size":3417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2633,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'836","reported_seq":864,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.908775+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T21:21:06.908775+0000","last_peered":"2024-05-08T21:21:06.908775+0000","last_clean":"2024-05-08T21:21:06.908775+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:06.908775+0000","last_undegraded":"2024-05-08T21:21:06.908775+0000","last_fullsized":"2024-05-08T21:21:06.908775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.904083+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T21:21:06.904083+0000","last_peered":"2024-05-08T21:21:06.904083+0000","last_clean":"2024-05-08T21:21:06.904083+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:06.904083+0000","last_undegraded":"2024-05-08T21:21:06.904083+0000","last_fullsized":"2024-05-08T21:21:06.904083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.675819+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T21:21:05.675819+0000","last_peered":"2024-05-08T21:21:05.675819+0000","last_clean":"2024-05-08T21:21:05.675819+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:21:05.675819+0000","last_undegraded":"2024-05-08T21:21:05.675819+0000","last_fullsized":"2024-05-08T21:21:05.675819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'836","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.806709+0000","last_change":"2024-05-08T20:55:41.599436+0000","last_active":"2024-05-08T21:21:06.806709+0000","last_peered":"2024-05-08T21:21:06.806709+0000","last_clean":"2024-05-08T21:21:06.806709+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:06.806709+0000","last_undegraded":"2024-05-08T21:21:06.806709+0000","last_fullsized":"2024-05-08T21:21:06.806709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:12.873685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2354","reported_seq":2382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.817404+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T21:21:06.817404+0000","last_peered":"2024-05-08T21:21:06.817404+0000","last_clean":"2024-05-08T21:21:06.817404+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:06.817404+0000","last_undegraded":"2024-05-08T21:21:06.817404+0000","last_fullsized":"2024-05-08T21:21:06.817404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:18:52.697136+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T21:18:52.697136+0000","last_peered":"2024-05-08T21:18:52.697136+0000","last_clean":"2024-05-08T21:18:52.697136+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:18:52.697136+0000","last_undegraded":"2024-05-08T21:18:52.697136+0000","last_fullsized":"2024-05-08T21:18:52.697136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3603,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853507+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T21:21:06.853507+0000","last_peered":"2024-05-08T21:21:06.853507+0000","last_clean":"2024-05-08T21:21:06.853507+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:21:06.853507+0000","last_undegraded":"2024-05-08T21:21:06.853507+0000","last_fullsized":"2024-05-08T21:21:06.853507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'783","reported_seq":811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.409284+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T21:21:05.409284+0000","last_peered":"2024-05-08T21:21:05.409284+0000","last_clean":"2024-05-08T21:21:05.409284+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:05.409284+0000","last_undegraded":"2024-05-08T21:21:05.409284+0000","last_fullsized":"2024-05-08T21:21:05.409284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:16.831824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4039","reported_seq":4069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.907119+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T21:21:06.907119+0000","last_peered":"2024-05-08T21:21:06.907119+0000","last_clean":"2024-05-08T21:21:06.907119+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:06.907119+0000","last_undegraded":"2024-05-08T21:21:06.907119+0000","last_fullsized":"2024-05-08T21:21:06.907119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4039,"log_dups_size":0,"ondisk_log_size":4039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.657426+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T21:21:05.657426+0000","last_peered":"2024-05-08T21:21:05.657426+0000","last_clean":"2024-05-08T21:21:05.657426+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:21:05.657426+0000","last_undegraded":"2024-05-08T21:21:05.657426+0000","last_fullsized":"2024-05-08T21:21:05.657426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2955","reported_seq":2984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.785687+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T21:21:07.785687+0000","last_peered":"2024-05-08T21:21:07.785687+0000","last_clean":"2024-05-08T21:21:07.785687+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:07.785687+0000","last_undegraded":"2024-05-08T21:21:07.785687+0000","last_fullsized":"2024-05-08T21:21:07.785687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'830","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853241+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T21:21:06.853241+0000","last_peered":"2024-05-08T21:21:06.853241+0000","last_clean":"2024-05-08T21:21:06.853241+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:06.853241+0000","last_undegraded":"2024-05-08T21:21:06.853241+0000","last_fullsized":"2024-05-08T21:21:06.853241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3593,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.910008+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T21:21:06.910008+0000","last_peered":"2024-05-08T21:21:06.910008+0000","last_clean":"2024-05-08T21:21:06.910008+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:06.910008+0000","last_undegraded":"2024-05-08T21:21:06.910008+0000","last_fullsized":"2024-05-08T21:21:06.910008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:18.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2156","reported_seq":2184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.792986+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T21:21:07.792986+0000","last_peered":"2024-05-08T21:21:07.792986+0000","last_clean":"2024-05-08T21:21:07.792986+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:07.792986+0000","last_undegraded":"2024-05-08T21:21:07.792986+0000","last_fullsized":"2024-05-08T21:21:07.792986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2744,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'774","reported_seq":802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.829556+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T21:21:06.829556+0000","last_peered":"2024-05-08T21:21:06.829556+0000","last_clean":"2024-05-08T21:21:06.829556+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:06.829556+0000","last_undegraded":"2024-05-08T21:21:06.829556+0000","last_fullsized":"2024-05-08T21:21:06.829556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.806135+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T21:21:06.806135+0000","last_peered":"2024-05-08T21:21:06.806135+0000","last_clean":"2024-05-08T21:21:06.806135+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:06.806135+0000","last_undegraded":"2024-05-08T21:21:06.806135+0000","last_fullsized":"2024-05-08T21:21:06.806135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:59.610624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1265","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.792632+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T21:21:07.792632+0000","last_peered":"2024-05-08T21:21:07.792632+0000","last_clean":"2024-05-08T21:21:07.792632+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:07.792632+0000","last_undegraded":"2024-05-08T21:21:07.792632+0000","last_fullsized":"2024-05-08T21:21:07.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'812","reported_seq":840,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.656810+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T21:21:05.656810+0000","last_peered":"2024-05-08T21:21:05.656810+0000","last_clean":"2024-05-08T21:21:05.656810+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:05.656810+0000","last_undegraded":"2024-05-08T21:21:05.656810+0000","last_fullsized":"2024-05-08T21:21:05.656810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853943+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T21:21:06.853943+0000","last_peered":"2024-05-08T21:21:06.853943+0000","last_clean":"2024-05-08T21:21:06.853943+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:21:06.853943+0000","last_undegraded":"2024-05-08T21:21:06.853943+0000","last_fullsized":"2024-05-08T21:21:06.853943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1126","reported_seq":1155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788639+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T21:21:07.788639+0000","last_peered":"2024-05-08T21:21:07.788639+0000","last_clean":"2024-05-08T21:21:07.788639+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:07.788639+0000","last_undegraded":"2024-05-08T21:21:07.788639+0000","last_fullsized":"2024-05-08T21:21:07.788639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'838","reported_seq":866,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.817352+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T21:21:06.817352+0000","last_peered":"2024-05-08T21:21:06.817352+0000","last_clean":"2024-05-08T21:21:06.817352+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:06.817352+0000","last_undegraded":"2024-05-08T21:21:06.817352+0000","last_fullsized":"2024-05-08T21:21:06.817352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.899173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.833211+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T21:21:06.833211+0000","last_peered":"2024-05-08T21:21:06.833211+0000","last_clean":"2024-05-08T21:21:06.833211+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:06.833211+0000","last_undegraded":"2024-05-08T21:21:06.833211+0000","last_fullsized":"2024-05-08T21:21:06.833211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2225","reported_seq":2253,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.789335+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T21:21:07.789335+0000","last_peered":"2024-05-08T21:21:07.789335+0000","last_clean":"2024-05-08T21:21:07.789335+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:07.789335+0000","last_undegraded":"2024-05-08T21:21:07.789335+0000","last_fullsized":"2024-05-08T21:21:07.789335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'879","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.831261+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T21:21:06.831261+0000","last_peered":"2024-05-08T21:21:06.831261+0000","last_clean":"2024-05-08T21:21:06.831261+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:06.831261+0000","last_undegraded":"2024-05-08T21:21:06.831261+0000","last_fullsized":"2024-05-08T21:21:06.831261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3781,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.693049+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T21:21:05.693049+0000","last_peered":"2024-05-08T21:21:05.693049+0000","last_clean":"2024-05-08T21:21:05.693049+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:05.693049+0000","last_undegraded":"2024-05-08T21:21:05.693049+0000","last_fullsized":"2024-05-08T21:21:05.693049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:27.059976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3678","reported_seq":3706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.790462+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T21:21:07.790462+0000","last_peered":"2024-05-08T21:21:07.790462+0000","last_clean":"2024-05-08T21:21:07.790462+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:07.790462+0000","last_undegraded":"2024-05-08T21:21:07.790462+0000","last_fullsized":"2024-05-08T21:21:07.790462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.601675+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T21:21:05.601675+0000","last_peered":"2024-05-08T21:21:05.601675+0000","last_clean":"2024-05-08T21:21:05.601675+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:05.601675+0000","last_undegraded":"2024-05-08T21:21:05.601675+0000","last_fullsized":"2024-05-08T21:21:05.601675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3512,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714540+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T21:21:05.714540+0000","last_peered":"2024-05-08T21:21:05.714540+0000","last_clean":"2024-05-08T21:21:05.714540+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:21:05.714540+0000","last_undegraded":"2024-05-08T21:21:05.714540+0000","last_fullsized":"2024-05-08T21:21:05.714540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4106","reported_seq":4134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889069+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T21:21:06.889069+0000","last_peered":"2024-05-08T21:21:06.889069+0000","last_clean":"2024-05-08T21:21:06.889069+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:06.889069+0000","last_undegraded":"2024-05-08T21:21:06.889069+0000","last_fullsized":"2024-05-08T21:21:06.889069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4106,"log_dups_size":0,"ondisk_log_size":4106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'805","reported_seq":832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714591+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T21:21:05.714591+0000","last_peered":"2024-05-08T21:21:05.714591+0000","last_clean":"2024-05-08T21:21:05.714591+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:05.714591+0000","last_undegraded":"2024-05-08T21:21:05.714591+0000","last_fullsized":"2024-05-08T21:21:05.714591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.797861+0000","last_change":"2024-05-08T20:55:41.605046+0000","last_active":"2024-05-08T21:21:06.797861+0000","last_peered":"2024-05-08T21:21:06.797861+0000","last_clean":"2024-05-08T21:21:06.797861+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:21:06.797861+0000","last_undegraded":"2024-05-08T21:21:06.797861+0000","last_fullsized":"2024-05-08T21:21:06.797861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:10.838870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3436","reported_seq":3464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794034+0000","last_change":"2024-05-08T20:54:59.625358+0000","last_active":"2024-05-08T21:21:07.794034+0000","last_peered":"2024-05-08T21:21:07.794034+0000","last_clean":"2024-05-08T21:21:07.794034+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:07.794034+0000","last_undegraded":"2024-05-08T21:21:07.794034+0000","last_fullsized":"2024-05-08T21:21:07.794034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3436,"log_dups_size":0,"ondisk_log_size":3436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'803","reported_seq":830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.557872+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T21:21:05.557872+0000","last_peered":"2024-05-08T21:21:05.557872+0000","last_clean":"2024-05-08T21:21:05.557872+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:05.557872+0000","last_undegraded":"2024-05-08T21:21:05.557872+0000","last_fullsized":"2024-05-08T21:21:05.557872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855224+0000","last_change":"2024-05-08T20:55:41.613686+0000","last_active":"2024-05-08T21:21:06.855224+0000","last_peered":"2024-05-08T21:21:06.855224+0000","last_clean":"2024-05-08T21:21:06.855224+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:21:06.855224+0000","last_undegraded":"2024-05-08T21:21:06.855224+0000","last_fullsized":"2024-05-08T21:21:06.855224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:43.286175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3909","reported_seq":3936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786269+0000","last_change":"2024-05-08T20:54:59.618192+0000","last_active":"2024-05-08T21:21:07.786269+0000","last_peered":"2024-05-08T21:21:07.786269+0000","last_clean":"2024-05-08T21:21:07.786269+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:07.786269+0000","last_undegraded":"2024-05-08T21:21:07.786269+0000","last_fullsized":"2024-05-08T21:21:07.786269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'813","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.666784+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T21:21:05.666784+0000","last_peered":"2024-05-08T21:21:05.666784+0000","last_clean":"2024-05-08T21:21:05.666784+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:05.666784+0000","last_undegraded":"2024-05-08T21:21:05.666784+0000","last_fullsized":"2024-05-08T21:21:05.666784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.849896+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T21:21:06.849896+0000","last_peered":"2024-05-08T21:21:06.849896+0000","last_clean":"2024-05-08T21:21:06.849896+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:21:06.849896+0000","last_undegraded":"2024-05-08T21:21:06.849896+0000","last_fullsized":"2024-05-08T21:21:06.849896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1801","reported_seq":1829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855668+0000","last_change":"2024-05-08T20:54:59.623921+0000","last_active":"2024-05-08T21:21:06.855668+0000","last_peered":"2024-05-08T21:21:06.855668+0000","last_clean":"2024-05-08T21:21:06.855668+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:06.855668+0000","last_undegraded":"2024-05-08T21:21:06.855668+0000","last_fullsized":"2024-05-08T21:21:06.855668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'809","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.568249+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T21:21:05.568249+0000","last_peered":"2024-05-08T21:21:05.568249+0000","last_clean":"2024-05-08T21:21:05.568249+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:05.568249+0000","last_undegraded":"2024-05-08T21:21:05.568249+0000","last_fullsized":"2024-05-08T21:21:05.568249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.685344+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T21:21:05.685344+0000","last_peered":"2024-05-08T21:21:05.685344+0000","last_clean":"2024-05-08T21:21:05.685344+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:05.685344+0000","last_undegraded":"2024-05-08T21:21:05.685344+0000","last_fullsized":"2024-05-08T21:21:05.685344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'857","reported_seq":893,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.784291+0000","last_change":"2024-05-08T20:55:42.115166+0000","last_active":"2024-05-08T21:21:06.784291+0000","last_peered":"2024-05-08T21:21:06.784291+0000","last_clean":"2024-05-08T21:21:06.784291+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:06.784291+0000","last_undegraded":"2024-05-08T21:21:06.784291+0000","last_fullsized":"2024-05-08T21:21:06.784291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:55.110706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'809","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.687798+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T21:21:05.687798+0000","last_peered":"2024-05-08T21:21:05.687798+0000","last_clean":"2024-05-08T21:21:05.687798+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:05.687798+0000","last_undegraded":"2024-05-08T21:21:05.687798+0000","last_fullsized":"2024-05-08T21:21:05.687798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'841","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.671360+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T21:21:05.671360+0000","last_peered":"2024-05-08T21:21:05.671360+0000","last_clean":"2024-05-08T21:21:05.671360+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:05.671360+0000","last_undegraded":"2024-05-08T21:21:05.671360+0000","last_fullsized":"2024-05-08T21:21:05.671360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'810","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.592695+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T21:21:05.592695+0000","last_peered":"2024-05-08T21:21:05.592695+0000","last_clean":"2024-05-08T21:21:05.592695+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:05.592695+0000","last_undegraded":"2024-05-08T21:21:05.592695+0000","last_fullsized":"2024-05-08T21:21:05.592695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'812","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.657863+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T21:21:05.657863+0000","last_peered":"2024-05-08T21:21:05.657863+0000","last_clean":"2024-05-08T21:21:05.657863+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:05.657863+0000","last_undegraded":"2024-05-08T21:21:05.657863+0000","last_fullsized":"2024-05-08T21:21:05.657863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'867","reported_seq":894,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.579556+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T21:21:05.579556+0000","last_peered":"2024-05-08T21:21:05.579556+0000","last_clean":"2024-05-08T21:21:05.579556+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:21:05.579556+0000","last_undegraded":"2024-05-08T21:21:05.579556+0000","last_fullsized":"2024-05-08T21:21:05.579556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'805","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.520599+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T21:21:05.520599+0000","last_peered":"2024-05-08T21:21:05.520599+0000","last_clean":"2024-05-08T21:21:05.520599+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:05.520599+0000","last_undegraded":"2024-05-08T21:21:05.520599+0000","last_fullsized":"2024-05-08T21:21:05.520599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'802","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.696312+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T21:21:05.696312+0000","last_peered":"2024-05-08T21:21:05.696312+0000","last_clean":"2024-05-08T21:21:05.696312+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:05.696312+0000","last_undegraded":"2024-05-08T21:21:05.696312+0000","last_fullsized":"2024-05-08T21:21:05.696312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'790","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.583744+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T21:21:05.583744+0000","last_peered":"2024-05-08T21:21:05.583744+0000","last_clean":"2024-05-08T21:21:05.583744+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:05.583744+0000","last_undegraded":"2024-05-08T21:21:05.583744+0000","last_fullsized":"2024-05-08T21:21:05.583744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'823","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.558131+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T21:21:05.558131+0000","last_peered":"2024-05-08T21:21:05.558131+0000","last_clean":"2024-05-08T21:21:05.558131+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:05.558131+0000","last_undegraded":"2024-05-08T21:21:05.558131+0000","last_fullsized":"2024-05-08T21:21:05.558131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'830","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.845663+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T21:21:06.845663+0000","last_peered":"2024-05-08T21:21:06.845663+0000","last_clean":"2024-05-08T21:21:06.845663+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:06.845663+0000","last_undegraded":"2024-05-08T21:21:06.845663+0000","last_fullsized":"2024-05-08T21:21:06.845663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'828","reported_seq":854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.066170+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T21:21:05.066170+0000","last_peered":"2024-05-08T21:21:05.066170+0000","last_clean":"2024-05-08T21:21:05.066170+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:05.066170+0000","last_undegraded":"2024-05-08T21:21:05.066170+0000","last_fullsized":"2024-05-08T21:21:05.066170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86559,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113555,"ondisk_log_size":113555,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52259,"ondisk_log_size":52259,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243559552,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7529,"num_write":91796,"num_write_kb":660226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487178240,"data_stored":487119104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91041,"ondisk_log_size":91041,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575169,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516716,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":450302,"kb_avail":93855124,"statfs":{"total":96636764160,"available":96107646976,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":461109707},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.65200000000000002,"15min":0.44700000000000001},"min":{"1min":0.22500000000000001,"5min":0.216,"15min":0.191},"max":{"1min":9.2940000000000005,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.65700000000000003,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":11.170999999999999,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.70999999999999996,"15min":0.48399999999999999},"min":{"1min":0.254,"5min":0.22,"15min":0.20599999999999999},"max":{"1min":11.247999999999999,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.64600000000000002,"15min":0.505},"min":{"1min":0.251,"5min":0.22,"15min":0.20499999999999999},"max":{"1min":11.425000000000001,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56899999999999995,"15min":0.48399999999999999},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":2.1160000000000001,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.58299999999999996,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.9450000000000003,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.73799999999999999,"15min":0.53900000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.218,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":2.081,"5min":7.9459999999999997,"15min":7.9459999999999997},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.58899999999999997,"15min":0.498},"min":{"1min":0.253,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":0.65100000000000002,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.64900000000000002,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.254},"max":{"1min":1.109,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.40100000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.67500000000000004,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":8.9849999999999994,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.755,"15min":0.57499999999999996},"min":{"1min":0.44500000000000001,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":2.681,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.47099999999999997}]},{"osd":6,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.67600000000000005,"15min":0.54900000000000004},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":9.1050000000000004,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.58499999999999996},"min":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":1.599,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575169,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.45500000000000002,"15min":0.42099999999999999},"min":{"1min":0.23000000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59199999999999997,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.372,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53200000000000003,"5min":2.1080000000000001,"15min":3.839},"last":0.621}]},{"osd":1,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.63600000000000001,"15min":0.49399999999999999},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":1.4370000000000001,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.53600000000000003,"15min":0.47999999999999998},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.56499999999999995,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.48599999999999999},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.3089999999999999,"5min":3.694,"15min":3.694},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60399999999999998,"15min":0.497},"min":{"1min":0.28699999999999998,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":1.2709999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56599999999999995,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":1.661,"5min":3.218,"15min":3.8250000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":1.4770000000000001,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":3.077,"15min":7.3810000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.72899999999999998,"15min":0.56399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.222},"max":{"1min":0.66600000000000004,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.68700000000000006}]},{"osd":5,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.495},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.4039999999999999,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.56499999999999995},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.3420000000000001,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.40899999999999997,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.70499999999999996,"5min":3.1909999999999998,"15min":3.8100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":1.5009999999999999,"5min":2.919,"15min":3.8780000000000001},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575169,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581440,"kb_used_data":81080,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790400,"statfs":{"total":96636764160,"available":96041369600,"internally_reserved":0,"allocated":83025920,"data_stored":82844999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.46300000000000002,"15min":0.35899999999999999},"min":{"1min":0.189,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":2.0699999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.45400000000000001,"15min":0.38100000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.653,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.189},"max":{"1min":0.56599999999999995,"5min":5.141,"15min":5.141},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53600000000000003,"15min":0.45400000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.1179999999999999,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.628,"15min":0.49099999999999999},"min":{"1min":0.249,"5min":0.216,"15min":0.215},"max":{"1min":2.1890000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.53100000000000003,"15min":0.45700000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.19},"max":{"1min":1.6890000000000001,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.443}]},{"osd":4,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.55400000000000005,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":2.1709999999999998,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55500000000000005,"15min":0.499},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.7090000000000001,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.56299999999999994,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.67100000000000004,"15min":0.55100000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.7310000000000001,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.28499999999999998},"max":{"1min":2.4830000000000001,"5min":6.766,"15min":6.766},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.72799999999999998,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":2.3100000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69199999999999995,"15min":0.60999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33900000000000002},"max":{"1min":1.7529999999999999,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375608,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996232,"statfs":{"total":96636764160,"available":96252141568,"internally_reserved":0,"allocated":30261248,"data_stored":30073642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":1.1559999999999999,"5min":3.823,"15min":3.823},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.41099999999999998,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.224,"15min":0.19},"max":{"1min":1.179,"5min":3.879,"15min":4.5919999999999996},"last":0.30099999999999999}]},{"osd":2,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.39400000000000002,"15min":0.35499999999999998},"min":{"1min":0.22800000000000001,"5min":0.20699999999999999,"15min":0.17399999999999999},"max":{"1min":0.59999999999999998,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.41999999999999998,"5min":1.752,"15min":3.9870000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"min":{"1min":0.27300000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":0.74199999999999999,"5min":3.7160000000000002,"15min":3.895},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.45600000000000002,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":1.7509999999999999,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.254},"max":{"1min":0.77400000000000002,"5min":3.794,"15min":5.6559999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.45000000000000001},"min":{"1min":0.32200000000000001,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.68799999999999994,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.373}]},{"osd":5,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.89700000000000002,"5min":4.0019999999999998,"15min":4.165},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.73899999999999999,"15min":0.59299999999999997},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":2.8799999999999999,"5min":14.901,"15min":14.901},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56599999999999995,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.998,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.443}]},{"osd":7,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.36499999999999999,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.927,"15min":5.0220000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65400000000000003,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":2.9980000000000002,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834575169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.39600000000000002,"15min":0.34200000000000003},"min":{"1min":0.20799999999999999,"5min":0.17899999999999999,"15min":0.17000000000000001},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.443,"15min":0.40200000000000002},"min":{"1min":0.22500000000000001,"5min":0.187,"15min":0.187},"max":{"1min":5.7359999999999998,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.314}]},{"osd":1,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.45700000000000002,"15min":0.39600000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.194,"5min":0.58999999999999997,"15min":0.47199999999999998},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.90200000000000002,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.26500000000000001,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":1.484,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":16.651},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.997,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.38,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":5.7039999999999997,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":0.65600000000000003,"15min":0.53400000000000003},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70899999999999996,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.4550000000000001,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.60299999999999998,"15min":0.57899999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.27400000000000002},"max":{"1min":2.4689999999999999,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.309},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":0.73599999999999999,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34200000000000003},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":0.71599999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.35099999999999998},"max":{"1min":11.736000000000001,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575169,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505456,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866384,"statfs":{"total":96636764160,"available":96119177216,"internally_reserved":0,"allocated":38051840,"data_stored":37871916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.53100000000000003,"15min":0.41999999999999998},"min":{"1min":0.218,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":6.407,"5min":6.407,"15min":6.407},"last":0.5},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.753,"15min":0.496},"min":{"1min":0.246,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":4.2949999999999999,"5min":16.724,"15min":16.724},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86099999999999999,"15min":0.57999999999999996},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":4.4809999999999999,"5min":13.058,"15min":15.259},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63200000000000001,"15min":0.51400000000000001},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.192},"max":{"1min":6.1109999999999998,"5min":9.5370000000000008,"15min":10.831},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55700000000000005,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.222,"15min":0.214},"max":{"1min":4.3739999999999997,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.48299999999999998},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":2.2639999999999998,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.96099999999999997,"15min":0.70499999999999996},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.3200000000000003,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":0.76400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":4.5039999999999996,"5min":11.755000000000001,"15min":15.224},"last":0.86799999999999999}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.59799999999999998,"15min":0.53900000000000003},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.61899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2549999999999999,"5min":5.548,"15min":5.548},"last":0.77500000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89300000000000002,"15min":0.65700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":4.4180000000000001,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.75},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.61399999999999999},"min":{"1min":0.374,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.978,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.88300000000000001}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.876,"15min":0.67500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.3490000000000002,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.97899999999999998,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":4.4560000000000004,"5min":12.939,"15min":12.939},"last":0.83499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575169,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.64100000000000001,"15min":0.48499999999999999},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.68300000000000005,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.58899999999999997,"15min":0.45900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.73299999999999998,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.61599999999999999,"15min":0.48999999999999999},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":10.222,"15min":10.222},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.58199999999999996,"15min":0.52500000000000002},"min":{"1min":0.25,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":0.624,"5min":7.343,"15min":7.4370000000000003},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.61299999999999999,"15min":0.503},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.64300000000000002,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.63900000000000001,"15min":0.54400000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":2.1179999999999999,"5min":3.9900000000000002,"15min":6.617},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.75800000000000001,"15min":0.56799999999999995},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":1.9259999999999999,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.323,"5min":5.6609999999999996,"15min":5.6609999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57599999999999996,"15min":0.50900000000000001},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.78000000000000003,"5min":4.0190000000000001,"15min":6.4340000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.65700000000000003,"15min":0.54800000000000004},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.23100000000000001},"max":{"1min":0.80200000000000005,"5min":4.8040000000000003,"15min":5.2990000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.60999999999999999,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":0.68899999999999995,"5min":5.6340000000000003,"15min":7.0039999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.72999999999999998,"15min":0.62},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":9.4550000000000001,"15min":9.4550000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.73599999999999999,"15min":0.59199999999999997},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.27300000000000002},"max":{"1min":0.89500000000000002,"5min":4.8280000000000003,"15min":4.8280000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.71799999999999997,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.372,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":5.6890000000000001,"15min":12.691000000000001},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575169,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544968,"kb_used_data":98880,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826872,"statfs":{"total":96636764160,"available":96078716928,"internally_reserved":0,"allocated":101253120,"data_stored":101074344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.56299999999999994,"15min":0.47799999999999998},"min":{"1min":0.22500000000000001,"5min":0.21199999999999999,"15min":0.17899999999999999},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.038,"5min":0.878,"15min":0.61099999999999999},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":9.2059999999999995,"5min":24.800000000000001,"15min":24.800000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.60999999999999999},"min":{"1min":0.28199999999999997,"5min":0.218,"15min":0.215},"max":{"1min":7.343,"5min":27.719000000000001,"15min":27.719000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.89600000000000002,"15min":0.61399999999999999},"min":{"1min":0.246,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":6.6150000000000002,"5min":24.826000000000001,"15min":24.826000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.62,"15min":0.52000000000000002},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.24099999999999999},"max":{"1min":7.4779999999999998,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.65500000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.28699999999999998,"15min":0.24199999999999999},"max":{"1min":7.4009999999999998,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.93899999999999995,"15min":0.66700000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":6.6559999999999997,"5min":24.606000000000002,"15min":24.606000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.751,"15min":0.60299999999999998},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.253},"max":{"1min":7.9909999999999997,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.3069999999999999,"15min":0.79800000000000004},"min":{"1min":0.32400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.319000000000001,"5min":71.634,"15min":71.634},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.762,"15min":0.98399999999999999},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.24199999999999999},"max":{"1min":10.032,"5min":101.794,"15min":101.794},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":0.77300000000000002,"15min":0.61399999999999999},"min":{"1min":0.34200000000000003,"5min":0.254,"15min":0.254},"max":{"1min":14.997,"5min":14.997,"15min":14.997},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.073,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.26500000000000001},"max":{"1min":19.137,"5min":28.053999999999998,"15min":28.053999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":4.7690000000000001,"5min":1.79,"15min":1.0089999999999999},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":67.849999999999994,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.53600000000000003},{"interface":"front","average":{"1min":5.2670000000000003,"5min":1.845,"15min":0.99199999999999999},"min":{"1min":0.39400000000000002,"5min":0.31,"15min":0.31},"max":{"1min":67.561000000000007,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82731008,"data_stored":82722491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100958208,"data_stored":100951836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:21:17.834 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:21:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.988+0000 7fd105e04700 1 Processor -- start 2024-05-08T21:21:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.988+0000 7fd105e04700 1 -- start start 2024-05-08T21:21:17.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd105e04700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150400 0x7fd1000c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd105e04700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd1000c4b40 0x7fd1000c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd105e04700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd100156630 con 0x7fd100150020 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd105e04700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd100071be0 con 0x7fd1000c4b40 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd105e04700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000713a0 con 0x7fd100150400 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fffff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd1000c4b40 0x7fd1000c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0ff7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd100150020 0x7fd100155f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45188/0 (socket says 172.21.15.135:45188) 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0ff7fe700 1 -- 172.21.15.135:0/3649823942 learned_addr learned my addr 172.21.15.135:0/3649823942 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0feffd700 1 --2- 172.21.15.135:0/3649823942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150400 0x7fd1000c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fffff700 1 -- 172.21.15.135:0/3649823942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150400 msgr2=0x7fd1000c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fffff700 1 --2- 172.21.15.135:0/3649823942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150400 0x7fd1000c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fffff700 1 -- 172.21.15.135:0/3649823942 >> v1:172.21.15.135:6789/0 conn(0x7fd100150020 legacy=0x7fd100155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fe7fc700 1 -- 172.21.15.135:0/3649823942 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137309502 0 0) 0x7fd100156630 con 0x7fd100150020 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fffff700 1 -- 172.21.15.135:0/3649823942 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1000c1f70 con 0x7fd1000c4b40 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0feffd700 1 --2- 172.21.15.135:0/3649823942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150400 0x7fd1000c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fffff700 1 --2- 172.21.15.135:0/3649823942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1000c63e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009d90 tx=0x7fd0f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a468528ee8697e85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fe7fc700 1 -- 172.21.15.135:0/3649823942 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800e070 con 0x7fd1000c4b40 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fe7fc700 1 -- 172.21.15.135:0/3649823942 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f800bbd0 con 0x7fd1000c4b40 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.989+0000 7fd0fe7fc700 1 -- 172.21.15.135:0/3649823942 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8012430 con 0x7fd1000c4b40 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 -- 172.21.15.135:0/3649823942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 msgr2=0x7fd1000c63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 --2- 172.21.15.135:0/3649823942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1000c63e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009d90 tx=0x7fd0f800b330 comp rx=0 tx=0).stop 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 -- 172.21.15.135:0/3649823942 shutdown_connections 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 --2- 172.21.15.135:0/3649823942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1000c63e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 --2- 172.21.15.135:0/3649823942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150400 0x7fd1000c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 -- 172.21.15.135:0/3649823942 >> 172.21.15.135:0/3649823942 conn(0x7fd10006a960 msgr2=0x7fd10006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:17.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 -- 172.21.15.135:0/3649823942 shutdown_connections 2024-05-08T21:21:17.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.990+0000 7fd105e04700 1 -- 172.21.15.135:0/3649823942 wait complete. 2024-05-08T21:21:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.991+0000 7fd105e04700 1 Processor -- start 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.991+0000 7fd105e04700 1 -- start start 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd105e04700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1001546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd105e04700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150020 0x7fd10006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd105e04700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd100150400 0x7fd100140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd105e04700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1001ec880 con 0x7fd1000c4b40 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd105e04700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd100141de0 con 0x7fd100150400 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd105e04700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1001ecb40 con 0x7fd100150020 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1001546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1001546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47730/0 (socket says 172.21.15.135:47730) 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 -- 172.21.15.135:0/774852930 learned_addr learned my addr 172.21.15.135:0/774852930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0feffd700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150020 0x7fd10006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0fffff700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd100150400 0x7fd100140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 -- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150020 msgr2=0x7fd10006ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150020 0x7fd10006ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 -- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd100150400 msgr2=0x7fd100140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd100150400 0x7fd100140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.992+0000 7fd0ff7fe700 1 -- 172.21.15.135:0/774852930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009a70 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.993+0000 7fd0ff7fe700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1001546f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00011e0 tx=0x7fd0f000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.993+0000 7fd0e7fff700 1 -- 172.21.15.135:0/774852930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0004c80 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.993+0000 7fd0e7fff700 1 -- 172.21.15.135:0/774852930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0004e00 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.993+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1001ece20 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.993+0000 7fd0e7fff700 1 -- 172.21.15.135:0/774852930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0007310 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.993+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1001ed3e0 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.994+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1001ed5d0 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.994+0000 7fd0e7fff700 1 -- 172.21.15.135:0/774852930 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd0f0007470 con 0x7fd1000c4b40 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.994+0000 7fd0e7fff700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd0ec06ac90 0x7fd0ec06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.995+0000 7fd0e7fff700 1 -- 172.21.15.135:0/774852930 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0f00892e0 con 0x7fd1000c4b40 2024-05-08T21:21:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.995+0000 7fd0feffd700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd0ec06ac90 0x7fd0ec06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.995+0000 7fd0feffd700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd0ec06ac90 0x7fd0ec06d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd100154c30 tx=0x7fd0f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:18.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:17.999+0000 7fd0e7fff700 1 -- 172.21.15.135:0/774852930 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd0f0054190 con 0x7fd1000c4b40 2024-05-08T21:21:18.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.192+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1000c33a0 con 0x7fd0ec06ac90 2024-05-08T21:21:18.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.202+0000 7fd0e7fff700 1 -- 172.21.15.135:0/774852930 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371722 (secure 0 0 0) 0x7fd1000c33a0 con 0x7fd0ec06ac90 2024-05-08T21:21:18.209 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd0ec06ac90 msgr2=0x7fd0ec06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd0ec06ac90 0x7fd0ec06d150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd100154c30 tx=0x7fd0f4008040 comp rx=0 tx=0).stop 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 msgr2=0x7fd1001546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1001546f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00011e0 tx=0x7fd0f000ca30 comp rx=0 tx=0).stop 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 shutdown_connections 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd0ec06ac90 0x7fd0ec06d150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd100150400 0x7fd100140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1000c4b40 0x7fd1001546f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 --2- 172.21.15.135:0/774852930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd100150020 0x7fd10006ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 >> 172.21.15.135:0/774852930 conn(0x7fd10006a960 msgr2=0x7fd10006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:18.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 shutdown_connections 2024-05-08T21:21:18.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.206+0000 7fd105e04700 1 -- 172.21.15.135:0/774852930 wait complete. 2024-05-08T21:21:18.213 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:21:18.221 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":815,"stamp":"2024-05-08T21:21:16.811318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244154016,"num_objects":84,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":3046,"num_read_kb":7629,"num_write":179634,"num_write_kb":3998160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256972,"ondisk_log_size":256972,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3864680,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3385395,"kb_avail":751110040,"statfs":{"total":773094113280,"available":769136680960,"internally_reserved":0,"allocated":490708992,"data_stored":489263520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3466645049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-232700295,"num_objects":-1457,"num_object_clones":0,"num_object_copies":-4484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1457,"num_whiteouts":0,"num_read":14,"num_read_kb":114,"num_write":1718,"num_write_kb":3651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004858"},"pg_stats":[{"pgid":"3.3f","version":"27'766","reported_seq":794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.653284+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T21:21:05.653284+0000","last_peered":"2024-05-08T21:21:05.653284+0000","last_clean":"2024-05-08T21:21:05.653284+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:21:05.653284+0000","last_undegraded":"2024-05-08T21:21:05.653284+0000","last_fullsized":"2024-05-08T21:21:05.653284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'768","reported_seq":795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.903622+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T21:21:06.903622+0000","last_peered":"2024-05-08T21:21:06.903622+0000","last_clean":"2024-05-08T21:21:06.903622+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:06.903622+0000","last_undegraded":"2024-05-08T21:21:06.903622+0000","last_fullsized":"2024-05-08T21:21:06.903622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'855","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.677757+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T21:21:05.677757+0000","last_peered":"2024-05-08T21:21:05.677757+0000","last_clean":"2024-05-08T21:21:05.677757+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:05.677757+0000","last_undegraded":"2024-05-08T21:21:05.677757+0000","last_fullsized":"2024-05-08T21:21:05.677757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'815","reported_seq":843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905285+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T21:21:06.905285+0000","last_peered":"2024-05-08T21:21:06.905285+0000","last_clean":"2024-05-08T21:21:06.905285+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:06.905285+0000","last_undegraded":"2024-05-08T21:21:06.905285+0000","last_fullsized":"2024-05-08T21:21:06.905285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'856","reported_seq":882,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.854816+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T21:21:06.854816+0000","last_peered":"2024-05-08T21:21:06.854816+0000","last_clean":"2024-05-08T21:21:06.854816+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:21:06.854816+0000","last_undegraded":"2024-05-08T21:21:06.854816+0000","last_fullsized":"2024-05-08T21:21:06.854816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'761","reported_seq":786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.542541+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T21:21:05.542541+0000","last_peered":"2024-05-08T21:21:05.542541+0000","last_clean":"2024-05-08T21:21:05.542541+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:21:05.542541+0000","last_undegraded":"2024-05-08T21:21:05.542541+0000","last_fullsized":"2024-05-08T21:21:05.542541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'806","reported_seq":832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.801733+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T21:21:06.801733+0000","last_peered":"2024-05-08T21:21:06.801733+0000","last_clean":"2024-05-08T21:21:06.801733+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:06.801733+0000","last_undegraded":"2024-05-08T21:21:06.801733+0000","last_fullsized":"2024-05-08T21:21:06.801733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'779","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.721659+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T21:21:05.721659+0000","last_peered":"2024-05-08T21:21:05.721659+0000","last_clean":"2024-05-08T21:21:05.721659+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:05.721659+0000","last_undegraded":"2024-05-08T21:21:05.721659+0000","last_fullsized":"2024-05-08T21:21:05.721659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'835","reported_seq":861,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.801044+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T21:21:06.801044+0000","last_peered":"2024-05-08T21:21:06.801044+0000","last_clean":"2024-05-08T21:21:06.801044+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:21:06.801044+0000","last_undegraded":"2024-05-08T21:21:06.801044+0000","last_fullsized":"2024-05-08T21:21:06.801044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'792","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.665982+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T21:21:05.665982+0000","last_peered":"2024-05-08T21:21:05.665982+0000","last_clean":"2024-05-08T21:21:05.665982+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:05.665982+0000","last_undegraded":"2024-05-08T21:21:05.665982+0000","last_fullsized":"2024-05-08T21:21:05.665982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'813","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889805+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T21:21:06.889805+0000","last_peered":"2024-05-08T21:21:06.889805+0000","last_clean":"2024-05-08T21:21:06.889805+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:06.889805+0000","last_undegraded":"2024-05-08T21:21:06.889805+0000","last_fullsized":"2024-05-08T21:21:06.889805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'787","reported_seq":813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.177960+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T21:21:05.177960+0000","last_peered":"2024-05-08T21:21:05.177960+0000","last_clean":"2024-05-08T21:21:05.177960+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:05.177960+0000","last_undegraded":"2024-05-08T21:21:05.177960+0000","last_fullsized":"2024-05-08T21:21:05.177960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'803","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714883+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T21:21:05.714883+0000","last_peered":"2024-05-08T21:21:05.714883+0000","last_clean":"2024-05-08T21:21:05.714883+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:05.714883+0000","last_undegraded":"2024-05-08T21:21:05.714883+0000","last_fullsized":"2024-05-08T21:21:05.714883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'795","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.721613+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T21:21:05.721613+0000","last_peered":"2024-05-08T21:21:05.721613+0000","last_clean":"2024-05-08T21:21:05.721613+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:05.721613+0000","last_undegraded":"2024-05-08T21:21:05.721613+0000","last_fullsized":"2024-05-08T21:21:05.721613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'846","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.802398+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T21:21:06.802398+0000","last_peered":"2024-05-08T21:21:06.802398+0000","last_clean":"2024-05-08T21:21:06.802398+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:06.802398+0000","last_undegraded":"2024-05-08T21:21:06.802398+0000","last_fullsized":"2024-05-08T21:21:06.802398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'800","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.446971+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T21:21:05.446971+0000","last_peered":"2024-05-08T21:21:05.446971+0000","last_clean":"2024-05-08T21:21:05.446971+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:05.446971+0000","last_undegraded":"2024-05-08T21:21:05.446971+0000","last_fullsized":"2024-05-08T21:21:05.446971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'862","reported_seq":888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.792238+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T21:21:06.792238+0000","last_peered":"2024-05-08T21:21:06.792238+0000","last_clean":"2024-05-08T21:21:06.792238+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:06.792238+0000","last_undegraded":"2024-05-08T21:21:06.792238+0000","last_fullsized":"2024-05-08T21:21:06.792238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'779","reported_seq":806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.303249+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T21:21:05.303249+0000","last_peered":"2024-05-08T21:21:05.303249+0000","last_clean":"2024-05-08T21:21:05.303249+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:05.303249+0000","last_undegraded":"2024-05-08T21:21:05.303249+0000","last_fullsized":"2024-05-08T21:21:05.303249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'832","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.698055+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T21:21:05.698055+0000","last_peered":"2024-05-08T21:21:05.698055+0000","last_clean":"2024-05-08T21:21:05.698055+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:21:05.698055+0000","last_undegraded":"2024-05-08T21:21:05.698055+0000","last_fullsized":"2024-05-08T21:21:05.698055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.802125+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T21:21:06.802125+0000","last_peered":"2024-05-08T21:21:06.802125+0000","last_clean":"2024-05-08T21:21:06.802125+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:21:06.802125+0000","last_undegraded":"2024-05-08T21:21:06.802125+0000","last_fullsized":"2024-05-08T21:21:06.802125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:53.835534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1868","reported_seq":1897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.875447+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T21:21:06.875447+0000","last_peered":"2024-05-08T21:21:06.875447+0000","last_clean":"2024-05-08T21:21:06.875447+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:06.875447+0000","last_undegraded":"2024-05-08T21:21:06.875447+0000","last_fullsized":"2024-05-08T21:21:06.875447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'804","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.814873+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T21:21:06.814873+0000","last_peered":"2024-05-08T21:21:06.814873+0000","last_clean":"2024-05-08T21:21:06.814873+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:06.814873+0000","last_undegraded":"2024-05-08T21:21:06.814873+0000","last_fullsized":"2024-05-08T21:21:06.814873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.798727+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T21:21:06.798727+0000","last_peered":"2024-05-08T21:21:06.798727+0000","last_clean":"2024-05-08T21:21:06.798727+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:06.798727+0000","last_undegraded":"2024-05-08T21:21:06.798727+0000","last_fullsized":"2024-05-08T21:21:06.798727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4025","reported_seq":4055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.638275+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T21:21:07.638275+0000","last_peered":"2024-05-08T21:21:07.638275+0000","last_clean":"2024-05-08T21:21:07.638275+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:07.638275+0000","last_undegraded":"2024-05-08T21:21:07.638275+0000","last_fullsized":"2024-05-08T21:21:07.638275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'773","reported_seq":801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.798371+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T21:21:06.798371+0000","last_peered":"2024-05-08T21:21:06.798371+0000","last_clean":"2024-05-08T21:21:06.798371+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:06.798371+0000","last_undegraded":"2024-05-08T21:21:06.798371+0000","last_fullsized":"2024-05-08T21:21:06.798371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.904663+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T21:21:06.904663+0000","last_peered":"2024-05-08T21:21:06.904663+0000","last_clean":"2024-05-08T21:21:06.904663+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:21:06.904663+0000","last_undegraded":"2024-05-08T21:21:06.904663+0000","last_fullsized":"2024-05-08T21:21:06.904663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:49.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4862","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795131+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T21:21:07.795131+0000","last_peered":"2024-05-08T21:21:07.795131+0000","last_clean":"2024-05-08T21:21:07.795131+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:07.795131+0000","last_undegraded":"2024-05-08T21:21:07.795131+0000","last_fullsized":"2024-05-08T21:21:07.795131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4862,"log_dups_size":0,"ondisk_log_size":4862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'852","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.820407+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T21:21:06.820407+0000","last_peered":"2024-05-08T21:21:06.820407+0000","last_clean":"2024-05-08T21:21:06.820407+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:21:06.820407+0000","last_undegraded":"2024-05-08T21:21:06.820407+0000","last_fullsized":"2024-05-08T21:21:06.820407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.807673+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T21:21:06.807673+0000","last_peered":"2024-05-08T21:21:06.807673+0000","last_clean":"2024-05-08T21:21:06.807673+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:06.807673+0000","last_undegraded":"2024-05-08T21:21:06.807673+0000","last_fullsized":"2024-05-08T21:21:06.807673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1175","reported_seq":1202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.868441+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T21:21:06.868441+0000","last_peered":"2024-05-08T21:21:06.868441+0000","last_clean":"2024-05-08T21:21:06.868441+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:06.868441+0000","last_undegraded":"2024-05-08T21:21:06.868441+0000","last_fullsized":"2024-05-08T21:21:06.868441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'819","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.541985+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T21:21:05.541985+0000","last_peered":"2024-05-08T21:21:05.541985+0000","last_clean":"2024-05-08T21:21:05.541985+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:21:05.541985+0000","last_undegraded":"2024-05-08T21:21:05.541985+0000","last_fullsized":"2024-05-08T21:21:05.541985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.692949+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T21:21:05.692949+0000","last_peered":"2024-05-08T21:21:05.692949+0000","last_clean":"2024-05-08T21:21:05.692949+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:21:05.692949+0000","last_undegraded":"2024-05-08T21:21:05.692949+0000","last_fullsized":"2024-05-08T21:21:05.692949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:15.767597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2315","reported_seq":2342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.892014+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T21:21:06.892014+0000","last_peered":"2024-05-08T21:21:06.892014+0000","last_clean":"2024-05-08T21:21:06.892014+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:06.892014+0000","last_undegraded":"2024-05-08T21:21:06.892014+0000","last_fullsized":"2024-05-08T21:21:06.892014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'822","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.687112+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T21:21:05.687112+0000","last_peered":"2024-05-08T21:21:05.687112+0000","last_clean":"2024-05-08T21:21:05.687112+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:05.687112+0000","last_undegraded":"2024-05-08T21:21:05.687112+0000","last_fullsized":"2024-05-08T21:21:05.687112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:00.135628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905860+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T21:21:06.905860+0000","last_peered":"2024-05-08T21:21:06.905860+0000","last_clean":"2024-05-08T21:21:06.905860+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:06.905860+0000","last_undegraded":"2024-05-08T21:21:06.905860+0000","last_fullsized":"2024-05-08T21:21:06.905860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:52.925278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4376","reported_seq":4402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.789539+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T21:21:07.789539+0000","last_peered":"2024-05-08T21:21:07.789539+0000","last_clean":"2024-05-08T21:21:07.789539+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:07.789539+0000","last_undegraded":"2024-05-08T21:21:07.789539+0000","last_fullsized":"2024-05-08T21:21:07.789539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4376,"log_dups_size":0,"ondisk_log_size":4376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'810","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.891188+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T21:21:06.891188+0000","last_peered":"2024-05-08T21:21:06.891188+0000","last_clean":"2024-05-08T21:21:06.891188+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:06.891188+0000","last_undegraded":"2024-05-08T21:21:06.891188+0000","last_fullsized":"2024-05-08T21:21:06.891188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.796652+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T21:21:06.796652+0000","last_peered":"2024-05-08T21:21:06.796652+0000","last_clean":"2024-05-08T21:21:06.796652+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:21:06.796652+0000","last_undegraded":"2024-05-08T21:21:06.796652+0000","last_fullsized":"2024-05-08T21:21:06.796652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1715","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.791537+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T21:21:07.791537+0000","last_peered":"2024-05-08T21:21:07.791537+0000","last_clean":"2024-05-08T21:21:07.791537+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:07.791537+0000","last_undegraded":"2024-05-08T21:21:07.791537+0000","last_fullsized":"2024-05-08T21:21:07.791537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'873","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.712934+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T21:21:05.712934+0000","last_peered":"2024-05-08T21:21:05.712934+0000","last_clean":"2024-05-08T21:21:05.712934+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:05.712934+0000","last_undegraded":"2024-05-08T21:21:05.712934+0000","last_fullsized":"2024-05-08T21:21:05.712934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.914439+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T21:21:06.914439+0000","last_peered":"2024-05-08T21:21:06.914439+0000","last_clean":"2024-05-08T21:21:06.914439+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:06.914439+0000","last_undegraded":"2024-05-08T21:21:06.914439+0000","last_fullsized":"2024-05-08T21:21:06.914439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5269","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.598466+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T21:19:12.598466+0000","last_peered":"2024-05-08T21:19:12.598466+0000","last_clean":"2024-05-08T21:19:12.598466+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:19:12.598466+0000","last_undegraded":"2024-05-08T21:19:12.598466+0000","last_fullsized":"2024-05-08T21:19:12.598466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5269,"log_dups_size":0,"ondisk_log_size":5269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'816","reported_seq":841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.631162+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T21:21:05.631162+0000","last_peered":"2024-05-08T21:21:05.631162+0000","last_clean":"2024-05-08T21:21:05.631162+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:05.631162+0000","last_undegraded":"2024-05-08T21:21:05.631162+0000","last_fullsized":"2024-05-08T21:21:05.631162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855319+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T21:21:06.855319+0000","last_peered":"2024-05-08T21:21:06.855319+0000","last_clean":"2024-05-08T21:21:06.855319+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:21:06.855319+0000","last_undegraded":"2024-05-08T21:21:06.855319+0000","last_fullsized":"2024-05-08T21:21:06.855319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:25.005036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2689","reported_seq":3285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795020+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T21:21:07.795020+0000","last_peered":"2024-05-08T21:21:07.795020+0000","last_clean":"2024-05-08T21:21:07.795020+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:07.795020+0000","last_undegraded":"2024-05-08T21:21:07.795020+0000","last_fullsized":"2024-05-08T21:21:07.795020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1794,"num_write":2690,"num_write_kb":19158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'802","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.352224+0000","last_change":"2024-05-08T20:55:41.598425+0000","last_active":"2024-05-08T21:21:05.352224+0000","last_peered":"2024-05-08T21:21:05.352224+0000","last_clean":"2024-05-08T21:21:05.352224+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:05.352224+0000","last_undegraded":"2024-05-08T21:21:05.352224+0000","last_fullsized":"2024-05-08T21:21:05.352224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:54.987104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.631431+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T21:21:05.631431+0000","last_peered":"2024-05-08T21:21:05.631431+0000","last_clean":"2024-05-08T21:21:05.631431+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:05.631431+0000","last_undegraded":"2024-05-08T21:21:05.631431+0000","last_fullsized":"2024-05-08T21:21:05.631431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3354","reported_seq":3380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.826855+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T21:21:06.826855+0000","last_peered":"2024-05-08T21:21:06.826855+0000","last_clean":"2024-05-08T21:21:06.826855+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:06.826855+0000","last_undegraded":"2024-05-08T21:21:06.826855+0000","last_fullsized":"2024-05-08T21:21:06.826855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3354,"log_dups_size":0,"ondisk_log_size":3354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'816","reported_seq":842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.656934+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T21:21:05.656934+0000","last_peered":"2024-05-08T21:21:05.656934+0000","last_clean":"2024-05-08T21:21:05.656934+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:05.656934+0000","last_undegraded":"2024-05-08T21:21:05.656934+0000","last_fullsized":"2024-05-08T21:21:05.656934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4040,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714358+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T21:21:05.714358+0000","last_peered":"2024-05-08T21:21:05.714358+0000","last_clean":"2024-05-08T21:21:05.714358+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:21:05.714358+0000","last_undegraded":"2024-05-08T21:21:05.714358+0000","last_fullsized":"2024-05-08T21:21:05.714358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4046","reported_seq":4072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.793921+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T21:21:07.793921+0000","last_peered":"2024-05-08T21:21:07.793921+0000","last_clean":"2024-05-08T21:21:07.793921+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:07.793921+0000","last_undegraded":"2024-05-08T21:21:07.793921+0000","last_fullsized":"2024-05-08T21:21:07.793921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4046,"log_dups_size":0,"ondisk_log_size":4046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4055,"num_write_kb":23094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'822","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.439153+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T21:21:05.439153+0000","last_peered":"2024-05-08T21:21:05.439153+0000","last_clean":"2024-05-08T21:21:05.439153+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:05.439153+0000","last_undegraded":"2024-05-08T21:21:05.439153+0000","last_fullsized":"2024-05-08T21:21:05.439153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.727219+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T21:21:05.727219+0000","last_peered":"2024-05-08T21:21:05.727219+0000","last_clean":"2024-05-08T21:21:05.727219+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:21:05.727219+0000","last_undegraded":"2024-05-08T21:21:05.727219+0000","last_fullsized":"2024-05-08T21:21:05.727219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4547","reported_seq":4574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.852319+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T21:21:06.852319+0000","last_peered":"2024-05-08T21:21:06.852319+0000","last_clean":"2024-05-08T21:21:06.852319+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:06.852319+0000","last_undegraded":"2024-05-08T21:21:06.852319+0000","last_fullsized":"2024-05-08T21:21:06.852319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'799","reported_seq":825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.712819+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T21:21:05.712819+0000","last_peered":"2024-05-08T21:21:05.712819+0000","last_clean":"2024-05-08T21:21:05.712819+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:21:05.712819+0000","last_undegraded":"2024-05-08T21:21:05.712819+0000","last_fullsized":"2024-05-08T21:21:05.712819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.897454+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T21:21:06.897454+0000","last_peered":"2024-05-08T21:21:06.897454+0000","last_clean":"2024-05-08T21:21:06.897454+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:21:06.897454+0000","last_undegraded":"2024-05-08T21:21:06.897454+0000","last_fullsized":"2024-05-08T21:21:06.897454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2508","reported_seq":2536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.874597+0000","last_change":"2024-05-08T20:54:59.629962+0000","last_active":"2024-05-08T21:21:06.874597+0000","last_peered":"2024-05-08T21:21:06.874597+0000","last_clean":"2024-05-08T21:21:06.874597+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:06.874597+0000","last_undegraded":"2024-05-08T21:21:06.874597+0000","last_fullsized":"2024-05-08T21:21:06.874597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2508,"log_dups_size":0,"ondisk_log_size":2508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'791","reported_seq":811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.654638+0000","last_change":"2024-05-08T20:55:41.595254+0000","last_active":"2024-05-08T21:21:05.654638+0000","last_peered":"2024-05-08T21:21:05.654638+0000","last_clean":"2024-05-08T21:21:05.654638+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:05.654638+0000","last_undegraded":"2024-05-08T21:21:05.654638+0000","last_fullsized":"2024-05-08T21:21:05.654638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:41.183338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.547382+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T21:21:05.547382+0000","last_peered":"2024-05-08T21:21:05.547382+0000","last_clean":"2024-05-08T21:21:05.547382+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:21:05.547382+0000","last_undegraded":"2024-05-08T21:21:05.547382+0000","last_fullsized":"2024-05-08T21:21:05.547382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.959849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788155+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T21:21:07.788155+0000","last_peered":"2024-05-08T21:21:07.788155+0000","last_clean":"2024-05-08T21:21:07.788155+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:07.788155+0000","last_undegraded":"2024-05-08T21:21:07.788155+0000","last_fullsized":"2024-05-08T21:21:07.788155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'819","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.651411+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T21:21:05.651411+0000","last_peered":"2024-05-08T21:21:05.651411+0000","last_clean":"2024-05-08T21:21:05.651411+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:05.651411+0000","last_undegraded":"2024-05-08T21:21:05.651411+0000","last_fullsized":"2024-05-08T21:21:05.651411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.827287+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T21:21:06.827287+0000","last_peered":"2024-05-08T21:21:06.827287+0000","last_clean":"2024-05-08T21:21:06.827287+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:21:06.827287+0000","last_undegraded":"2024-05-08T21:21:06.827287+0000","last_fullsized":"2024-05-08T21:21:06.827287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:34.555272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1099","reported_seq":1126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794753+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T21:21:07.794753+0000","last_peered":"2024-05-08T21:21:07.794753+0000","last_clean":"2024-05-08T21:21:07.794753+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:07.794753+0000","last_undegraded":"2024-05-08T21:21:07.794753+0000","last_fullsized":"2024-05-08T21:21:07.794753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'813","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.412989+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T21:21:05.412989+0000","last_peered":"2024-05-08T21:21:05.412989+0000","last_clean":"2024-05-08T21:21:05.412989+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:05.412989+0000","last_undegraded":"2024-05-08T21:21:05.412989+0000","last_fullsized":"2024-05-08T21:21:05.412989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.715442+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T21:21:05.715442+0000","last_peered":"2024-05-08T21:21:05.715442+0000","last_clean":"2024-05-08T21:21:05.715442+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:21:05.715442+0000","last_undegraded":"2024-05-08T21:21:05.715442+0000","last_fullsized":"2024-05-08T21:21:05.715442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1824","reported_seq":1852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.790327+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T21:21:07.790327+0000","last_peered":"2024-05-08T21:21:07.790327+0000","last_clean":"2024-05-08T21:21:07.790327+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:07.790327+0000","last_undegraded":"2024-05-08T21:21:07.790327+0000","last_fullsized":"2024-05-08T21:21:07.790327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'852","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.816819+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T21:21:06.816819+0000","last_peered":"2024-05-08T21:21:06.816819+0000","last_clean":"2024-05-08T21:21:06.816819+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:06.816819+0000","last_undegraded":"2024-05-08T21:21:06.816819+0000","last_fullsized":"2024-05-08T21:21:06.816819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.903427+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T21:21:06.903427+0000","last_peered":"2024-05-08T21:21:06.903427+0000","last_clean":"2024-05-08T21:21:06.903427+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:21:06.903427+0000","last_undegraded":"2024-05-08T21:21:06.903427+0000","last_fullsized":"2024-05-08T21:21:06.903427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1830","reported_seq":1858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.877172+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T21:21:06.877172+0000","last_peered":"2024-05-08T21:21:06.877172+0000","last_clean":"2024-05-08T21:21:06.877172+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:06.877172+0000","last_undegraded":"2024-05-08T21:21:06.877172+0000","last_fullsized":"2024-05-08T21:21:06.877172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:17.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860634+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T21:21:06.860634+0000","last_peered":"2024-05-08T21:21:06.860634+0000","last_clean":"2024-05-08T21:21:06.860634+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:06.860634+0000","last_undegraded":"2024-05-08T21:21:06.860634+0000","last_fullsized":"2024-05-08T21:21:06.860634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.816432+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T21:21:06.816432+0000","last_peered":"2024-05-08T21:21:06.816432+0000","last_clean":"2024-05-08T21:21:06.816432+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:06.816432+0000","last_undegraded":"2024-05-08T21:21:06.816432+0000","last_fullsized":"2024-05-08T21:21:06.816432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1214","reported_seq":1242,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786415+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T21:21:07.786415+0000","last_peered":"2024-05-08T21:21:07.786415+0000","last_clean":"2024-05-08T21:21:07.786415+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:07.786415+0000","last_undegraded":"2024-05-08T21:21:07.786415+0000","last_fullsized":"2024-05-08T21:21:07.786415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'818","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.666674+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T21:21:05.666674+0000","last_peered":"2024-05-08T21:21:05.666674+0000","last_clean":"2024-05-08T21:21:05.666674+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:05.666674+0000","last_undegraded":"2024-05-08T21:21:05.666674+0000","last_fullsized":"2024-05-08T21:21:05.666674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.878575+0000","last_change":"2024-05-08T20:55:41.599810+0000","last_active":"2024-05-08T21:21:06.878575+0000","last_peered":"2024-05-08T21:21:06.878575+0000","last_clean":"2024-05-08T21:21:06.878575+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:21:06.878575+0000","last_undegraded":"2024-05-08T21:21:06.878575+0000","last_fullsized":"2024-05-08T21:21:06.878575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:59.058826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5314","reported_seq":5342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:08.308765+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T21:21:08.308765+0000","last_peered":"2024-05-08T21:21:08.308765+0000","last_clean":"2024-05-08T21:21:08.308765+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:08.308765+0000","last_undegraded":"2024-05-08T21:21:08.308765+0000","last_fullsized":"2024-05-08T21:21:08.308765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5314,"log_dups_size":0,"ondisk_log_size":5314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24002075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5312,"num_write_kb":42290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'808","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.408322+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T21:21:05.408322+0000","last_peered":"2024-05-08T21:21:05.408322+0000","last_clean":"2024-05-08T21:21:05.408322+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:05.408322+0000","last_undegraded":"2024-05-08T21:21:05.408322+0000","last_fullsized":"2024-05-08T21:21:05.408322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:30.883278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3417","reported_seq":3443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905261+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T21:21:06.905261+0000","last_peered":"2024-05-08T21:21:06.905261+0000","last_clean":"2024-05-08T21:21:06.905261+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:21:06.905261+0000","last_undegraded":"2024-05-08T21:21:06.905261+0000","last_fullsized":"2024-05-08T21:21:06.905261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3417,"log_dups_size":0,"ondisk_log_size":3417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2633,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'836","reported_seq":864,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.908775+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T21:21:06.908775+0000","last_peered":"2024-05-08T21:21:06.908775+0000","last_clean":"2024-05-08T21:21:06.908775+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:06.908775+0000","last_undegraded":"2024-05-08T21:21:06.908775+0000","last_fullsized":"2024-05-08T21:21:06.908775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.904083+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T21:21:06.904083+0000","last_peered":"2024-05-08T21:21:06.904083+0000","last_clean":"2024-05-08T21:21:06.904083+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:06.904083+0000","last_undegraded":"2024-05-08T21:21:06.904083+0000","last_fullsized":"2024-05-08T21:21:06.904083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.675819+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T21:21:05.675819+0000","last_peered":"2024-05-08T21:21:05.675819+0000","last_clean":"2024-05-08T21:21:05.675819+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:21:05.675819+0000","last_undegraded":"2024-05-08T21:21:05.675819+0000","last_fullsized":"2024-05-08T21:21:05.675819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'836","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.806709+0000","last_change":"2024-05-08T20:55:41.599436+0000","last_active":"2024-05-08T21:21:06.806709+0000","last_peered":"2024-05-08T21:21:06.806709+0000","last_clean":"2024-05-08T21:21:06.806709+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:06.806709+0000","last_undegraded":"2024-05-08T21:21:06.806709+0000","last_fullsized":"2024-05-08T21:21:06.806709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:12.873685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2354","reported_seq":2382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.817404+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T21:21:06.817404+0000","last_peered":"2024-05-08T21:21:06.817404+0000","last_clean":"2024-05-08T21:21:06.817404+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:06.817404+0000","last_undegraded":"2024-05-08T21:21:06.817404+0000","last_fullsized":"2024-05-08T21:21:06.817404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:18:52.697136+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T21:18:52.697136+0000","last_peered":"2024-05-08T21:18:52.697136+0000","last_clean":"2024-05-08T21:18:52.697136+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:18:52.697136+0000","last_undegraded":"2024-05-08T21:18:52.697136+0000","last_fullsized":"2024-05-08T21:18:52.697136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3603,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853507+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T21:21:06.853507+0000","last_peered":"2024-05-08T21:21:06.853507+0000","last_clean":"2024-05-08T21:21:06.853507+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:21:06.853507+0000","last_undegraded":"2024-05-08T21:21:06.853507+0000","last_fullsized":"2024-05-08T21:21:06.853507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'783","reported_seq":811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.409284+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T21:21:05.409284+0000","last_peered":"2024-05-08T21:21:05.409284+0000","last_clean":"2024-05-08T21:21:05.409284+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:05.409284+0000","last_undegraded":"2024-05-08T21:21:05.409284+0000","last_fullsized":"2024-05-08T21:21:05.409284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:16.831824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4039","reported_seq":4069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.907119+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T21:21:06.907119+0000","last_peered":"2024-05-08T21:21:06.907119+0000","last_clean":"2024-05-08T21:21:06.907119+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:06.907119+0000","last_undegraded":"2024-05-08T21:21:06.907119+0000","last_fullsized":"2024-05-08T21:21:06.907119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4039,"log_dups_size":0,"ondisk_log_size":4039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.657426+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T21:21:05.657426+0000","last_peered":"2024-05-08T21:21:05.657426+0000","last_clean":"2024-05-08T21:21:05.657426+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:21:05.657426+0000","last_undegraded":"2024-05-08T21:21:05.657426+0000","last_fullsized":"2024-05-08T21:21:05.657426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2955","reported_seq":2984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.785687+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T21:21:07.785687+0000","last_peered":"2024-05-08T21:21:07.785687+0000","last_clean":"2024-05-08T21:21:07.785687+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:07.785687+0000","last_undegraded":"2024-05-08T21:21:07.785687+0000","last_fullsized":"2024-05-08T21:21:07.785687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'830","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853241+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T21:21:06.853241+0000","last_peered":"2024-05-08T21:21:06.853241+0000","last_clean":"2024-05-08T21:21:06.853241+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:06.853241+0000","last_undegraded":"2024-05-08T21:21:06.853241+0000","last_fullsized":"2024-05-08T21:21:06.853241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3593,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.910008+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T21:21:06.910008+0000","last_peered":"2024-05-08T21:21:06.910008+0000","last_clean":"2024-05-08T21:21:06.910008+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:06.910008+0000","last_undegraded":"2024-05-08T21:21:06.910008+0000","last_fullsized":"2024-05-08T21:21:06.910008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:18.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2156","reported_seq":2184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.792986+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T21:21:07.792986+0000","last_peered":"2024-05-08T21:21:07.792986+0000","last_clean":"2024-05-08T21:21:07.792986+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:07.792986+0000","last_undegraded":"2024-05-08T21:21:07.792986+0000","last_fullsized":"2024-05-08T21:21:07.792986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2744,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'774","reported_seq":802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.829556+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T21:21:06.829556+0000","last_peered":"2024-05-08T21:21:06.829556+0000","last_clean":"2024-05-08T21:21:06.829556+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:06.829556+0000","last_undegraded":"2024-05-08T21:21:06.829556+0000","last_fullsized":"2024-05-08T21:21:06.829556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.806135+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T21:21:06.806135+0000","last_peered":"2024-05-08T21:21:06.806135+0000","last_clean":"2024-05-08T21:21:06.806135+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:06.806135+0000","last_undegraded":"2024-05-08T21:21:06.806135+0000","last_fullsized":"2024-05-08T21:21:06.806135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:59.610624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1265","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.792632+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T21:21:07.792632+0000","last_peered":"2024-05-08T21:21:07.792632+0000","last_clean":"2024-05-08T21:21:07.792632+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:07.792632+0000","last_undegraded":"2024-05-08T21:21:07.792632+0000","last_fullsized":"2024-05-08T21:21:07.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'812","reported_seq":840,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.656810+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T21:21:05.656810+0000","last_peered":"2024-05-08T21:21:05.656810+0000","last_clean":"2024-05-08T21:21:05.656810+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:05.656810+0000","last_undegraded":"2024-05-08T21:21:05.656810+0000","last_fullsized":"2024-05-08T21:21:05.656810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853943+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T21:21:06.853943+0000","last_peered":"2024-05-08T21:21:06.853943+0000","last_clean":"2024-05-08T21:21:06.853943+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:21:06.853943+0000","last_undegraded":"2024-05-08T21:21:06.853943+0000","last_fullsized":"2024-05-08T21:21:06.853943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1126","reported_seq":1155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788639+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T21:21:07.788639+0000","last_peered":"2024-05-08T21:21:07.788639+0000","last_clean":"2024-05-08T21:21:07.788639+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:07.788639+0000","last_undegraded":"2024-05-08T21:21:07.788639+0000","last_fullsized":"2024-05-08T21:21:07.788639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'838","reported_seq":866,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.817352+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T21:21:06.817352+0000","last_peered":"2024-05-08T21:21:06.817352+0000","last_clean":"2024-05-08T21:21:06.817352+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:06.817352+0000","last_undegraded":"2024-05-08T21:21:06.817352+0000","last_fullsized":"2024-05-08T21:21:06.817352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.899173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.833211+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T21:21:06.833211+0000","last_peered":"2024-05-08T21:21:06.833211+0000","last_clean":"2024-05-08T21:21:06.833211+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:06.833211+0000","last_undegraded":"2024-05-08T21:21:06.833211+0000","last_fullsized":"2024-05-08T21:21:06.833211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2225","reported_seq":2253,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.789335+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T21:21:07.789335+0000","last_peered":"2024-05-08T21:21:07.789335+0000","last_clean":"2024-05-08T21:21:07.789335+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:07.789335+0000","last_undegraded":"2024-05-08T21:21:07.789335+0000","last_fullsized":"2024-05-08T21:21:07.789335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'879","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.831261+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T21:21:06.831261+0000","last_peered":"2024-05-08T21:21:06.831261+0000","last_clean":"2024-05-08T21:21:06.831261+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:06.831261+0000","last_undegraded":"2024-05-08T21:21:06.831261+0000","last_fullsized":"2024-05-08T21:21:06.831261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3781,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.693049+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T21:21:05.693049+0000","last_peered":"2024-05-08T21:21:05.693049+0000","last_clean":"2024-05-08T21:21:05.693049+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:05.693049+0000","last_undegraded":"2024-05-08T21:21:05.693049+0000","last_fullsized":"2024-05-08T21:21:05.693049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:27.059976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3678","reported_seq":3706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.790462+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T21:21:07.790462+0000","last_peered":"2024-05-08T21:21:07.790462+0000","last_clean":"2024-05-08T21:21:07.790462+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:07.790462+0000","last_undegraded":"2024-05-08T21:21:07.790462+0000","last_fullsized":"2024-05-08T21:21:07.790462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.601675+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T21:21:05.601675+0000","last_peered":"2024-05-08T21:21:05.601675+0000","last_clean":"2024-05-08T21:21:05.601675+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:05.601675+0000","last_undegraded":"2024-05-08T21:21:05.601675+0000","last_fullsized":"2024-05-08T21:21:05.601675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3512,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714540+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T21:21:05.714540+0000","last_peered":"2024-05-08T21:21:05.714540+0000","last_clean":"2024-05-08T21:21:05.714540+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:21:05.714540+0000","last_undegraded":"2024-05-08T21:21:05.714540+0000","last_fullsized":"2024-05-08T21:21:05.714540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4106","reported_seq":4134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889069+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T21:21:06.889069+0000","last_peered":"2024-05-08T21:21:06.889069+0000","last_clean":"2024-05-08T21:21:06.889069+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:06.889069+0000","last_undegraded":"2024-05-08T21:21:06.889069+0000","last_fullsized":"2024-05-08T21:21:06.889069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4106,"log_dups_size":0,"ondisk_log_size":4106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'805","reported_seq":832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714591+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T21:21:05.714591+0000","last_peered":"2024-05-08T21:21:05.714591+0000","last_clean":"2024-05-08T21:21:05.714591+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:05.714591+0000","last_undegraded":"2024-05-08T21:21:05.714591+0000","last_fullsized":"2024-05-08T21:21:05.714591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.797861+0000","last_change":"2024-05-08T20:55:41.605046+0000","last_active":"2024-05-08T21:21:06.797861+0000","last_peered":"2024-05-08T21:21:06.797861+0000","last_clean":"2024-05-08T21:21:06.797861+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:21:06.797861+0000","last_undegraded":"2024-05-08T21:21:06.797861+0000","last_fullsized":"2024-05-08T21:21:06.797861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:10.838870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3436","reported_seq":3464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794034+0000","last_change":"2024-05-08T20:54:59.625358+0000","last_active":"2024-05-08T21:21:07.794034+0000","last_peered":"2024-05-08T21:21:07.794034+0000","last_clean":"2024-05-08T21:21:07.794034+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:07.794034+0000","last_undegraded":"2024-05-08T21:21:07.794034+0000","last_fullsized":"2024-05-08T21:21:07.794034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3436,"log_dups_size":0,"ondisk_log_size":3436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'803","reported_seq":830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.557872+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T21:21:05.557872+0000","last_peered":"2024-05-08T21:21:05.557872+0000","last_clean":"2024-05-08T21:21:05.557872+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:05.557872+0000","last_undegraded":"2024-05-08T21:21:05.557872+0000","last_fullsized":"2024-05-08T21:21:05.557872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855224+0000","last_change":"2024-05-08T20:55:41.613686+0000","last_active":"2024-05-08T21:21:06.855224+0000","last_peered":"2024-05-08T21:21:06.855224+0000","last_clean":"2024-05-08T21:21:06.855224+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:21:06.855224+0000","last_undegraded":"2024-05-08T21:21:06.855224+0000","last_fullsized":"2024-05-08T21:21:06.855224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:43.286175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3909","reported_seq":3936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786269+0000","last_change":"2024-05-08T20:54:59.618192+0000","last_active":"2024-05-08T21:21:07.786269+0000","last_peered":"2024-05-08T21:21:07.786269+0000","last_clean":"2024-05-08T21:21:07.786269+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:07.786269+0000","last_undegraded":"2024-05-08T21:21:07.786269+0000","last_fullsized":"2024-05-08T21:21:07.786269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'813","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.666784+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T21:21:05.666784+0000","last_peered":"2024-05-08T21:21:05.666784+0000","last_clean":"2024-05-08T21:21:05.666784+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:05.666784+0000","last_undegraded":"2024-05-08T21:21:05.666784+0000","last_fullsized":"2024-05-08T21:21:05.666784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.849896+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T21:21:06.849896+0000","last_peered":"2024-05-08T21:21:06.849896+0000","last_clean":"2024-05-08T21:21:06.849896+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:21:06.849896+0000","last_undegraded":"2024-05-08T21:21:06.849896+0000","last_fullsized":"2024-05-08T21:21:06.849896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1801","reported_seq":1829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855668+0000","last_change":"2024-05-08T20:54:59.623921+0000","last_active":"2024-05-08T21:21:06.855668+0000","last_peered":"2024-05-08T21:21:06.855668+0000","last_clean":"2024-05-08T21:21:06.855668+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:06.855668+0000","last_undegraded":"2024-05-08T21:21:06.855668+0000","last_fullsized":"2024-05-08T21:21:06.855668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'809","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.568249+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T21:21:05.568249+0000","last_peered":"2024-05-08T21:21:05.568249+0000","last_clean":"2024-05-08T21:21:05.568249+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:05.568249+0000","last_undegraded":"2024-05-08T21:21:05.568249+0000","last_fullsized":"2024-05-08T21:21:05.568249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.685344+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T21:21:05.685344+0000","last_peered":"2024-05-08T21:21:05.685344+0000","last_clean":"2024-05-08T21:21:05.685344+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:05.685344+0000","last_undegraded":"2024-05-08T21:21:05.685344+0000","last_fullsized":"2024-05-08T21:21:05.685344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'857","reported_seq":893,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.784291+0000","last_change":"2024-05-08T20:55:42.115166+0000","last_active":"2024-05-08T21:21:06.784291+0000","last_peered":"2024-05-08T21:21:06.784291+0000","last_clean":"2024-05-08T21:21:06.784291+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:06.784291+0000","last_undegraded":"2024-05-08T21:21:06.784291+0000","last_fullsized":"2024-05-08T21:21:06.784291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:55.110706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'809","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.687798+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T21:21:05.687798+0000","last_peered":"2024-05-08T21:21:05.687798+0000","last_clean":"2024-05-08T21:21:05.687798+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:05.687798+0000","last_undegraded":"2024-05-08T21:21:05.687798+0000","last_fullsized":"2024-05-08T21:21:05.687798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'841","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.671360+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T21:21:05.671360+0000","last_peered":"2024-05-08T21:21:05.671360+0000","last_clean":"2024-05-08T21:21:05.671360+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:05.671360+0000","last_undegraded":"2024-05-08T21:21:05.671360+0000","last_fullsized":"2024-05-08T21:21:05.671360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'810","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.592695+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T21:21:05.592695+0000","last_peered":"2024-05-08T21:21:05.592695+0000","last_clean":"2024-05-08T21:21:05.592695+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:05.592695+0000","last_undegraded":"2024-05-08T21:21:05.592695+0000","last_fullsized":"2024-05-08T21:21:05.592695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'812","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.657863+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T21:21:05.657863+0000","last_peered":"2024-05-08T21:21:05.657863+0000","last_clean":"2024-05-08T21:21:05.657863+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:05.657863+0000","last_undegraded":"2024-05-08T21:21:05.657863+0000","last_fullsized":"2024-05-08T21:21:05.657863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'867","reported_seq":894,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.579556+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T21:21:05.579556+0000","last_peered":"2024-05-08T21:21:05.579556+0000","last_clean":"2024-05-08T21:21:05.579556+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:21:05.579556+0000","last_undegraded":"2024-05-08T21:21:05.579556+0000","last_fullsized":"2024-05-08T21:21:05.579556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'805","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.520599+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T21:21:05.520599+0000","last_peered":"2024-05-08T21:21:05.520599+0000","last_clean":"2024-05-08T21:21:05.520599+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:05.520599+0000","last_undegraded":"2024-05-08T21:21:05.520599+0000","last_fullsized":"2024-05-08T21:21:05.520599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'802","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.696312+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T21:21:05.696312+0000","last_peered":"2024-05-08T21:21:05.696312+0000","last_clean":"2024-05-08T21:21:05.696312+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:05.696312+0000","last_undegraded":"2024-05-08T21:21:05.696312+0000","last_fullsized":"2024-05-08T21:21:05.696312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'790","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.583744+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T21:21:05.583744+0000","last_peered":"2024-05-08T21:21:05.583744+0000","last_clean":"2024-05-08T21:21:05.583744+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:05.583744+0000","last_undegraded":"2024-05-08T21:21:05.583744+0000","last_fullsized":"2024-05-08T21:21:05.583744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'823","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.558131+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T21:21:05.558131+0000","last_peered":"2024-05-08T21:21:05.558131+0000","last_clean":"2024-05-08T21:21:05.558131+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:05.558131+0000","last_undegraded":"2024-05-08T21:21:05.558131+0000","last_fullsized":"2024-05-08T21:21:05.558131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'830","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.845663+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T21:21:06.845663+0000","last_peered":"2024-05-08T21:21:06.845663+0000","last_clean":"2024-05-08T21:21:06.845663+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:06.845663+0000","last_undegraded":"2024-05-08T21:21:06.845663+0000","last_fullsized":"2024-05-08T21:21:06.845663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'828","reported_seq":854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.066170+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T21:21:05.066170+0000","last_peered":"2024-05-08T21:21:05.066170+0000","last_clean":"2024-05-08T21:21:05.066170+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:05.066170+0000","last_undegraded":"2024-05-08T21:21:05.066170+0000","last_fullsized":"2024-05-08T21:21:05.066170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86559,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113555,"ondisk_log_size":113555,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52259,"ondisk_log_size":52259,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243559552,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7529,"num_write":91796,"num_write_kb":660226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487178240,"data_stored":487119104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91041,"ondisk_log_size":91041,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575169,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516716,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":450302,"kb_avail":93855124,"statfs":{"total":96636764160,"available":96107646976,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":461109707},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.65200000000000002,"15min":0.44700000000000001},"min":{"1min":0.22500000000000001,"5min":0.216,"15min":0.191},"max":{"1min":9.2940000000000005,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.65700000000000003,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":11.170999999999999,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.70999999999999996,"15min":0.48399999999999999},"min":{"1min":0.254,"5min":0.22,"15min":0.20599999999999999},"max":{"1min":11.247999999999999,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.64600000000000002,"15min":0.505},"min":{"1min":0.251,"5min":0.22,"15min":0.20499999999999999},"max":{"1min":11.425000000000001,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56899999999999995,"15min":0.48399999999999999},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":2.1160000000000001,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.58299999999999996,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.9450000000000003,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.73799999999999999,"15min":0.53900000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.218,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":2.081,"5min":7.9459999999999997,"15min":7.9459999999999997},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.58899999999999997,"15min":0.498},"min":{"1min":0.253,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":0.65100000000000002,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.64900000000000002,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.254},"max":{"1min":1.109,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.40100000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.67500000000000004,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":8.9849999999999994,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.755,"15min":0.57499999999999996},"min":{"1min":0.44500000000000001,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":2.681,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.47099999999999997}]},{"osd":6,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.67600000000000005,"15min":0.54900000000000004},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":9.1050000000000004,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.58499999999999996},"min":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":1.599,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575169,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.45500000000000002,"15min":0.42099999999999999},"min":{"1min":0.23000000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59199999999999997,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.372,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53200000000000003,"5min":2.1080000000000001,"15min":3.839},"last":0.621}]},{"osd":1,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.63600000000000001,"15min":0.49399999999999999},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":1.4370000000000001,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.53600000000000003,"15min":0.47999999999999998},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.56499999999999995,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.48599999999999999},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.3089999999999999,"5min":3.694,"15min":3.694},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60399999999999998,"15min":0.497},"min":{"1min":0.28699999999999998,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":1.2709999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56599999999999995,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":1.661,"5min":3.218,"15min":3.8250000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":1.4770000000000001,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":3.077,"15min":7.3810000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.72899999999999998,"15min":0.56399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.222},"max":{"1min":0.66600000000000004,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.68700000000000006}]},{"osd":5,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.495},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.4039999999999999,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.56499999999999995},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.3420000000000001,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.40899999999999997,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.70499999999999996,"5min":3.1909999999999998,"15min":3.8100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":1.5009999999999999,"5min":2.919,"15min":3.8780000000000001},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575169,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581440,"kb_used_data":81080,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790400,"statfs":{"total":96636764160,"available":96041369600,"internally_reserved":0,"allocated":83025920,"data_stored":82844999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.46300000000000002,"15min":0.35899999999999999},"min":{"1min":0.189,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":2.0699999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.45400000000000001,"15min":0.38100000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.653,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.189},"max":{"1min":0.56599999999999995,"5min":5.141,"15min":5.141},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53600000000000003,"15min":0.45400000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.1179999999999999,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.628,"15min":0.49099999999999999},"min":{"1min":0.249,"5min":0.216,"15min":0.215},"max":{"1min":2.1890000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.53100000000000003,"15min":0.45700000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.19},"max":{"1min":1.6890000000000001,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.443}]},{"osd":4,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.55400000000000005,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":2.1709999999999998,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55500000000000005,"15min":0.499},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.7090000000000001,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.56299999999999994,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.67100000000000004,"15min":0.55100000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.7310000000000001,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.28499999999999998},"max":{"1min":2.4830000000000001,"5min":6.766,"15min":6.766},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.72799999999999998,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":2.3100000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69199999999999995,"15min":0.60999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33900000000000002},"max":{"1min":1.7529999999999999,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375608,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996232,"statfs":{"total":96636764160,"available":96252141568,"internally_reserved":0,"allocated":30261248,"data_stored":30073642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":1.1559999999999999,"5min":3.823,"15min":3.823},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.41099999999999998,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.224,"15min":0.19},"max":{"1min":1.179,"5min":3.879,"15min":4.5919999999999996},"last":0.30099999999999999}]},{"osd":2,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.39400000000000002,"15min":0.35499999999999998},"min":{"1min":0.22800000000000001,"5min":0.20699999999999999,"15min":0.17399999999999999},"max":{"1min":0.59999999999999998,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.41999999999999998,"5min":1.752,"15min":3.9870000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"min":{"1min":0.27300000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":0.74199999999999999,"5min":3.7160000000000002,"15min":3.895},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.45600000000000002,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":1.7509999999999999,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.254},"max":{"1min":0.77400000000000002,"5min":3.794,"15min":5.6559999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.45000000000000001},"min":{"1min":0.32200000000000001,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.68799999999999994,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.373}]},{"osd":5,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.89700000000000002,"5min":4.0019999999999998,"15min":4.165},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.73899999999999999,"15min":0.59299999999999997},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":2.8799999999999999,"5min":14.901,"15min":14.901},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56599999999999995,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.998,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.443}]},{"osd":7,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.36499999999999999,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.927,"15min":5.0220000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65400000000000003,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":2.9980000000000002,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834575169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.39600000000000002,"15min":0.34200000000000003},"min":{"1min":0.20799999999999999,"5min":0.17899999999999999,"15min":0.17000000000000001},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.443,"15min":0.40200000000000002},"min":{"1min":0.22500000000000001,"5min":0.187,"15min":0.187},"max":{"1min":5.7359999999999998,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.314}]},{"osd":1,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.45700000000000002,"15min":0.39600000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.194,"5min":0.58999999999999997,"15min":0.47199999999999998},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.90200000000000002,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.26500000000000001,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":1.484,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":16.651},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.997,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.38,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":5.7039999999999997,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":0.65600000000000003,"15min":0.53400000000000003},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70899999999999996,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.4550000000000001,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.60299999999999998,"15min":0.57899999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.27400000000000002},"max":{"1min":2.4689999999999999,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.309},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":0.73599999999999999,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34200000000000003},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":0.71599999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.35099999999999998},"max":{"1min":11.736000000000001,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575169,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505456,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866384,"statfs":{"total":96636764160,"available":96119177216,"internally_reserved":0,"allocated":38051840,"data_stored":37871916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.53100000000000003,"15min":0.41999999999999998},"min":{"1min":0.218,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":6.407,"5min":6.407,"15min":6.407},"last":0.5},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.753,"15min":0.496},"min":{"1min":0.246,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":4.2949999999999999,"5min":16.724,"15min":16.724},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86099999999999999,"15min":0.57999999999999996},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":4.4809999999999999,"5min":13.058,"15min":15.259},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63200000000000001,"15min":0.51400000000000001},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.192},"max":{"1min":6.1109999999999998,"5min":9.5370000000000008,"15min":10.831},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55700000000000005,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.222,"15min":0.214},"max":{"1min":4.3739999999999997,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.48299999999999998},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":2.2639999999999998,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.96099999999999997,"15min":0.70499999999999996},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.3200000000000003,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":0.76400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":4.5039999999999996,"5min":11.755000000000001,"15min":15.224},"last":0.86799999999999999}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.59799999999999998,"15min":0.53900000000000003},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.61899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2549999999999999,"5min":5.548,"15min":5.548},"last":0.77500000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89300000000000002,"15min":0.65700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":4.4180000000000001,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.75},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.61399999999999999},"min":{"1min":0.374,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.978,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.88300000000000001}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.876,"15min":0.67500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.3490000000000002,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.97899999999999998,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":4.4560000000000004,"5min":12.939,"15min":12.939},"last":0.83499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575169,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.64100000000000001,"15min":0.48499999999999999},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.68300000000000005,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.58899999999999997,"15min":0.45900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.73299999999999998,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.61599999999999999,"15min":0.48999999999999999},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":10.222,"15min":10.222},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.58199999999999996,"15min":0.52500000000000002},"min":{"1min":0.25,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":0.624,"5min":7.343,"15min":7.4370000000000003},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.61299999999999999,"15min":0.503},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.64300000000000002,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.63900000000000001,"15min":0.54400000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":2.1179999999999999,"5min":3.9900000000000002,"15min":6.617},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.75800000000000001,"15min":0.56799999999999995},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":1.9259999999999999,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.323,"5min":5.6609999999999996,"15min":5.6609999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57599999999999996,"15min":0.50900000000000001},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.78000000000000003,"5min":4.0190000000000001,"15min":6.4340000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.65700000000000003,"15min":0.54800000000000004},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.23100000000000001},"max":{"1min":0.80200000000000005,"5min":4.8040000000000003,"15min":5.2990000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.60999999999999999,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":0.68899999999999995,"5min":5.6340000000000003,"15min":7.0039999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.72999999999999998,"15min":0.62},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":9.4550000000000001,"15min":9.4550000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.73599999999999999,"15min":0.59199999999999997},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.27300000000000002},"max":{"1min":0.89500000000000002,"5min":4.8280000000000003,"15min":4.8280000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.71799999999999997,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.372,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":5.6890000000000001,"15min":12.691000000000001},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575169,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544968,"kb_used_data":98880,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826872,"statfs":{"total":96636764160,"available":96078716928,"internally_reserved":0,"allocated":101253120,"data_stored":101074344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.56299999999999994,"15min":0.47799999999999998},"min":{"1min":0.22500000000000001,"5min":0.21199999999999999,"15min":0.17899999999999999},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.038,"5min":0.878,"15min":0.61099999999999999},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":9.2059999999999995,"5min":24.800000000000001,"15min":24.800000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.60999999999999999},"min":{"1min":0.28199999999999997,"5min":0.218,"15min":0.215},"max":{"1min":7.343,"5min":27.719000000000001,"15min":27.719000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.89600000000000002,"15min":0.61399999999999999},"min":{"1min":0.246,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":6.6150000000000002,"5min":24.826000000000001,"15min":24.826000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.62,"15min":0.52000000000000002},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.24099999999999999},"max":{"1min":7.4779999999999998,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.65500000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.28699999999999998,"15min":0.24199999999999999},"max":{"1min":7.4009999999999998,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.93899999999999995,"15min":0.66700000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":6.6559999999999997,"5min":24.606000000000002,"15min":24.606000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.751,"15min":0.60299999999999998},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.253},"max":{"1min":7.9909999999999997,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.3069999999999999,"15min":0.79800000000000004},"min":{"1min":0.32400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.319000000000001,"5min":71.634,"15min":71.634},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.762,"15min":0.98399999999999999},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.24199999999999999},"max":{"1min":10.032,"5min":101.794,"15min":101.794},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":0.77300000000000002,"15min":0.61399999999999999},"min":{"1min":0.34200000000000003,"5min":0.254,"15min":0.254},"max":{"1min":14.997,"5min":14.997,"15min":14.997},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.073,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.26500000000000001},"max":{"1min":19.137,"5min":28.053999999999998,"15min":28.053999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":4.7690000000000001,"5min":1.79,"15min":1.0089999999999999},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":67.849999999999994,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.53600000000000003},{"interface":"front","average":{"1min":5.2670000000000003,"5min":1.845,"15min":0.99199999999999999},"min":{"1min":0.39400000000000002,"5min":0.31,"15min":0.31},"max":{"1min":67.561000000000007,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82731008,"data_stored":82722491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100958208,"data_stored":100951836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:21:18.226 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T21:21:18.227 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:21:18.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.382+0000 7fe1d879c700 1 Processor -- start 2024-05-08T21:21:18.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.382+0000 7fe1d879c700 1 -- start start 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d879c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe1d01571f0 0x7fe1d00c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d879c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1d00c89b0 0x7fe1d00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d879c700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d015abf0 con 0x7fe1d01512e0 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d879c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d0157650 con 0x7fe1d00c89b0 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d879c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d00c3a20 con 0x7fe1d01571f0 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d6d39700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fe1d00c89b0 0x7fe1d00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d6538700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fe1d01512e0 0x7fe1d015b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45204/0 (socket says 172.21.15.135:45204) 2024-05-08T21:21:18.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.383+0000 7fe1d6538700 1 -- 172.21.15.135:0/301990912 learned_addr learned my addr 172.21.15.135:0/301990912 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d5d37700 1 --2- 172.21.15.135:0/301990912 >> v2:172.21.15.183:3300/0 conn(0x7fe1d01571f0 0x7fe1d00c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d6d39700 1 -- 172.21.15.135:0/301990912 >> v2:172.21.15.183:3300/0 conn(0x7fe1d01571f0 msgr2=0x7fe1d00c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d6d39700 1 --2- 172.21.15.135:0/301990912 >> v2:172.21.15.183:3300/0 conn(0x7fe1d01571f0 0x7fe1d00c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d6d39700 1 -- 172.21.15.135:0/301990912 >> v1:172.21.15.135:6789/0 conn(0x7fe1d01512e0 legacy=0x7fe1d015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d6d39700 1 -- 172.21.15.135:0/301990912 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d015b790 con 0x7fe1d00c89b0 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d5536700 1 -- 172.21.15.135:0/301990912 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746026765 0 0) 0x7fe1d015abf0 con 0x7fe1d01512e0 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d6d39700 1 --2- 172.21.15.135:0/301990912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d00c7760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00c7650 tx=0x7fe1c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0354a6774b0e69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d5536700 1 -- 172.21.15.135:0/301990912 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800e070 con 0x7fe1d00c89b0 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d5536700 1 -- 172.21.15.135:0/301990912 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c800bbd0 con 0x7fe1d00c89b0 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.384+0000 7fe1d5536700 1 -- 172.21.15.135:0/301990912 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8012430 con 0x7fe1d00c89b0 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 -- 172.21.15.135:0/301990912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 msgr2=0x7fe1d00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 --2- 172.21.15.135:0/301990912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d00c7760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00c7650 tx=0x7fe1c800b330 comp rx=0 tx=0).stop 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 -- 172.21.15.135:0/301990912 shutdown_connections 2024-05-08T21:21:18.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 --2- 172.21.15.135:0/301990912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d00c7760 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 --2- 172.21.15.135:0/301990912 >> v2:172.21.15.183:3300/0 conn(0x7fe1d01571f0 0x7fe1d00c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 -- 172.21.15.135:0/301990912 >> 172.21.15.135:0/301990912 conn(0x7fe1d006a960 msgr2=0x7fe1d006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:18.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 -- 172.21.15.135:0/301990912 shutdown_connections 2024-05-08T21:21:18.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.385+0000 7fe1d879c700 1 -- 172.21.15.135:0/301990912 wait complete. 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.386+0000 7fe1d879c700 1 Processor -- start 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.386+0000 7fe1d879c700 1 -- start start 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d01eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1d01512e0 0x7fe1d0156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1d01571f0 0x7fe1d0158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d0154930 con 0x7fe1d00c89b0 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d0159770 con 0x7fe1d01512e0 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d01599c0 con 0x7fe1d01571f0 2024-05-08T21:21:18.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d01eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d01eecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47752/0 (socket says 172.21.15.135:47752) 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 -- 172.21.15.135:0/1826480559 learned_addr learned my addr 172.21.15.135:0/1826480559 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d5d37700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1d01512e0 0x7fe1d0156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6d39700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1d01571f0 0x7fe1d0158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 -- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1d01571f0 msgr2=0x7fe1d0158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1d01571f0 0x7fe1d0158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 -- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1d01512e0 msgr2=0x7fe1d0156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1d01512e0 0x7fe1d0156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 -- 172.21.15.135:0/1826480559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8009a70 con 0x7fe1d00c89b0 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6d39700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1d01571f0 0x7fe1d0158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d6538700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d01eecb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c750 tx=0x7fe1c000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1c6ffd700 1 -- 172.21.15.135:0/1826480559 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0004c80 con 0x7fe1d00c89b0 2024-05-08T21:21:18.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1c6ffd700 1 -- 172.21.15.135:0/1826480559 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0004e00 con 0x7fe1d00c89b0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1c6ffd700 1 -- 172.21.15.135:0/1826480559 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0007310 con 0x7fe1d00c89b0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d0159ca0 con 0x7fe1d00c89b0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.387+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d015a260 con 0x7fe1d00c89b0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.388+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d015a8b0 con 0x7fe1d00c89b0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.389+0000 7fe1c6ffd700 1 -- 172.21.15.135:0/1826480559 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe1c0007470 con 0x7fe1d00c89b0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.389+0000 7fe1c6ffd700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe1b406acc0 0x7fe1b406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.389+0000 7fe1c6ffd700 1 -- 172.21.15.135:0/1826480559 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1c00894c0 con 0x7fe1d00c89b0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.389+0000 7fe1d5d37700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe1b406acc0 0x7fe1b406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.390+0000 7fe1d5d37700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe1b406acc0 0x7fe1b406d180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0150a50 tx=0x7fe1cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:18.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.394+0000 7fe1c6ffd700 1 -- 172.21.15.135:0/1826480559 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe1c00542e0 con 0x7fe1d00c89b0 2024-05-08T21:21:18.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.585+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1d0157b10 con 0x7fe1b406acc0 2024-05-08T21:21:18.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.595+0000 7fe1c6ffd700 1 -- 172.21.15.135:0/1826480559 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371722 (secure 0 0 0) 0x7fe1cc00b5c0 con 0x7fe1b406acc0 2024-05-08T21:21:18.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe1b406acc0 msgr2=0x7fe1b406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe1b406acc0 0x7fe1b406d180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0150a50 tx=0x7fe1cc008040 comp rx=0 tx=0).stop 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 msgr2=0x7fe1d01eecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d01eecb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c750 tx=0x7fe1c000cb10 comp rx=0 tx=0).stop 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 shutdown_connections 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fe1b406acc0 0x7fe1b406d180 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1d01571f0 0x7fe1d0158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1d00c89b0 0x7fe1d01eecb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 --2- 172.21.15.135:0/1826480559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1d01512e0 0x7fe1d0156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 >> 172.21.15.135:0/1826480559 conn(0x7fe1d006a960 msgr2=0x7fe1d014fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 shutdown_connections 2024-05-08T21:21:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.599+0000 7fe1d879c700 1 -- 172.21.15.135:0/1826480559 wait complete. 2024-05-08T21:21:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:21:18.613 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":815,"stamp":"2024-05-08T21:21:16.811318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244154016,"num_objects":84,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":3046,"num_read_kb":7629,"num_write":179634,"num_write_kb":3998160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256972,"ondisk_log_size":256972,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3864680,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3385395,"kb_avail":751110040,"statfs":{"total":773094113280,"available":769136680960,"internally_reserved":0,"allocated":490708992,"data_stored":489263520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3466645049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-232700295,"num_objects":-1457,"num_object_clones":0,"num_object_copies":-4484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1457,"num_whiteouts":0,"num_read":14,"num_read_kb":114,"num_write":1718,"num_write_kb":3651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-112,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004858"},"pg_stats":[{"pgid":"3.3f","version":"27'766","reported_seq":794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.653284+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T21:21:05.653284+0000","last_peered":"2024-05-08T21:21:05.653284+0000","last_clean":"2024-05-08T21:21:05.653284+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:21:05.653284+0000","last_undegraded":"2024-05-08T21:21:05.653284+0000","last_fullsized":"2024-05-08T21:21:05.653284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'768","reported_seq":795,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.903622+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T21:21:06.903622+0000","last_peered":"2024-05-08T21:21:06.903622+0000","last_clean":"2024-05-08T21:21:06.903622+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:06.903622+0000","last_undegraded":"2024-05-08T21:21:06.903622+0000","last_fullsized":"2024-05-08T21:21:06.903622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'855","reported_seq":883,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.677757+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T21:21:05.677757+0000","last_peered":"2024-05-08T21:21:05.677757+0000","last_clean":"2024-05-08T21:21:05.677757+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:05.677757+0000","last_undegraded":"2024-05-08T21:21:05.677757+0000","last_fullsized":"2024-05-08T21:21:05.677757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'815","reported_seq":843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905285+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T21:21:06.905285+0000","last_peered":"2024-05-08T21:21:06.905285+0000","last_clean":"2024-05-08T21:21:06.905285+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:06.905285+0000","last_undegraded":"2024-05-08T21:21:06.905285+0000","last_fullsized":"2024-05-08T21:21:06.905285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'856","reported_seq":882,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.854816+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T21:21:06.854816+0000","last_peered":"2024-05-08T21:21:06.854816+0000","last_clean":"2024-05-08T21:21:06.854816+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:21:06.854816+0000","last_undegraded":"2024-05-08T21:21:06.854816+0000","last_fullsized":"2024-05-08T21:21:06.854816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'761","reported_seq":786,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.542541+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T21:21:05.542541+0000","last_peered":"2024-05-08T21:21:05.542541+0000","last_clean":"2024-05-08T21:21:05.542541+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:21:05.542541+0000","last_undegraded":"2024-05-08T21:21:05.542541+0000","last_fullsized":"2024-05-08T21:21:05.542541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'806","reported_seq":832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.801733+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T21:21:06.801733+0000","last_peered":"2024-05-08T21:21:06.801733+0000","last_clean":"2024-05-08T21:21:06.801733+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:06.801733+0000","last_undegraded":"2024-05-08T21:21:06.801733+0000","last_fullsized":"2024-05-08T21:21:06.801733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'779","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.721659+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T21:21:05.721659+0000","last_peered":"2024-05-08T21:21:05.721659+0000","last_clean":"2024-05-08T21:21:05.721659+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:05.721659+0000","last_undegraded":"2024-05-08T21:21:05.721659+0000","last_fullsized":"2024-05-08T21:21:05.721659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'835","reported_seq":861,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.801044+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T21:21:06.801044+0000","last_peered":"2024-05-08T21:21:06.801044+0000","last_clean":"2024-05-08T21:21:06.801044+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:21:06.801044+0000","last_undegraded":"2024-05-08T21:21:06.801044+0000","last_fullsized":"2024-05-08T21:21:06.801044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'792","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.665982+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T21:21:05.665982+0000","last_peered":"2024-05-08T21:21:05.665982+0000","last_clean":"2024-05-08T21:21:05.665982+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:05.665982+0000","last_undegraded":"2024-05-08T21:21:05.665982+0000","last_fullsized":"2024-05-08T21:21:05.665982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'813","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889805+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T21:21:06.889805+0000","last_peered":"2024-05-08T21:21:06.889805+0000","last_clean":"2024-05-08T21:21:06.889805+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:06.889805+0000","last_undegraded":"2024-05-08T21:21:06.889805+0000","last_fullsized":"2024-05-08T21:21:06.889805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'787","reported_seq":813,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.177960+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T21:21:05.177960+0000","last_peered":"2024-05-08T21:21:05.177960+0000","last_clean":"2024-05-08T21:21:05.177960+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:05.177960+0000","last_undegraded":"2024-05-08T21:21:05.177960+0000","last_fullsized":"2024-05-08T21:21:05.177960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":787,"log_dups_size":0,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:00.468782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'803","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714883+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T21:21:05.714883+0000","last_peered":"2024-05-08T21:21:05.714883+0000","last_clean":"2024-05-08T21:21:05.714883+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:05.714883+0000","last_undegraded":"2024-05-08T21:21:05.714883+0000","last_fullsized":"2024-05-08T21:21:05.714883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'795","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.721613+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T21:21:05.721613+0000","last_peered":"2024-05-08T21:21:05.721613+0000","last_clean":"2024-05-08T21:21:05.721613+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:05.721613+0000","last_undegraded":"2024-05-08T21:21:05.721613+0000","last_fullsized":"2024-05-08T21:21:05.721613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'846","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.802398+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T21:21:06.802398+0000","last_peered":"2024-05-08T21:21:06.802398+0000","last_clean":"2024-05-08T21:21:06.802398+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:06.802398+0000","last_undegraded":"2024-05-08T21:21:06.802398+0000","last_fullsized":"2024-05-08T21:21:06.802398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'800","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.446971+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T21:21:05.446971+0000","last_peered":"2024-05-08T21:21:05.446971+0000","last_clean":"2024-05-08T21:21:05.446971+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:05.446971+0000","last_undegraded":"2024-05-08T21:21:05.446971+0000","last_fullsized":"2024-05-08T21:21:05.446971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'862","reported_seq":888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.792238+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T21:21:06.792238+0000","last_peered":"2024-05-08T21:21:06.792238+0000","last_clean":"2024-05-08T21:21:06.792238+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:06.792238+0000","last_undegraded":"2024-05-08T21:21:06.792238+0000","last_fullsized":"2024-05-08T21:21:06.792238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'779","reported_seq":806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.303249+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T21:21:05.303249+0000","last_peered":"2024-05-08T21:21:05.303249+0000","last_clean":"2024-05-08T21:21:05.303249+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:05.303249+0000","last_undegraded":"2024-05-08T21:21:05.303249+0000","last_fullsized":"2024-05-08T21:21:05.303249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'832","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.698055+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T21:21:05.698055+0000","last_peered":"2024-05-08T21:21:05.698055+0000","last_clean":"2024-05-08T21:21:05.698055+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:21:05.698055+0000","last_undegraded":"2024-05-08T21:21:05.698055+0000","last_fullsized":"2024-05-08T21:21:05.698055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3809,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.802125+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T21:21:06.802125+0000","last_peered":"2024-05-08T21:21:06.802125+0000","last_clean":"2024-05-08T21:21:06.802125+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:21:06.802125+0000","last_undegraded":"2024-05-08T21:21:06.802125+0000","last_fullsized":"2024-05-08T21:21:06.802125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:53.835534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1868","reported_seq":1897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.875447+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T21:21:06.875447+0000","last_peered":"2024-05-08T21:21:06.875447+0000","last_clean":"2024-05-08T21:21:06.875447+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:06.875447+0000","last_undegraded":"2024-05-08T21:21:06.875447+0000","last_fullsized":"2024-05-08T21:21:06.875447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'804","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.814873+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T21:21:06.814873+0000","last_peered":"2024-05-08T21:21:06.814873+0000","last_clean":"2024-05-08T21:21:06.814873+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:06.814873+0000","last_undegraded":"2024-05-08T21:21:06.814873+0000","last_fullsized":"2024-05-08T21:21:06.814873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3719,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.798727+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T21:21:06.798727+0000","last_peered":"2024-05-08T21:21:06.798727+0000","last_clean":"2024-05-08T21:21:06.798727+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:06.798727+0000","last_undegraded":"2024-05-08T21:21:06.798727+0000","last_fullsized":"2024-05-08T21:21:06.798727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4025","reported_seq":4055,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.638275+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T21:21:07.638275+0000","last_peered":"2024-05-08T21:21:07.638275+0000","last_clean":"2024-05-08T21:21:07.638275+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:07.638275+0000","last_undegraded":"2024-05-08T21:21:07.638275+0000","last_fullsized":"2024-05-08T21:21:07.638275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'773","reported_seq":801,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.798371+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T21:21:06.798371+0000","last_peered":"2024-05-08T21:21:06.798371+0000","last_clean":"2024-05-08T21:21:06.798371+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:06.798371+0000","last_undegraded":"2024-05-08T21:21:06.798371+0000","last_fullsized":"2024-05-08T21:21:06.798371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3656,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.904663+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T21:21:06.904663+0000","last_peered":"2024-05-08T21:21:06.904663+0000","last_clean":"2024-05-08T21:21:06.904663+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:21:06.904663+0000","last_undegraded":"2024-05-08T21:21:06.904663+0000","last_fullsized":"2024-05-08T21:21:06.904663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:49.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4862","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795131+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T21:21:07.795131+0000","last_peered":"2024-05-08T21:21:07.795131+0000","last_clean":"2024-05-08T21:21:07.795131+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:07.795131+0000","last_undegraded":"2024-05-08T21:21:07.795131+0000","last_fullsized":"2024-05-08T21:21:07.795131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4862,"log_dups_size":0,"ondisk_log_size":4862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'852","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.820407+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T21:21:06.820407+0000","last_peered":"2024-05-08T21:21:06.820407+0000","last_clean":"2024-05-08T21:21:06.820407+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:21:06.820407+0000","last_undegraded":"2024-05-08T21:21:06.820407+0000","last_fullsized":"2024-05-08T21:21:06.820407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.807673+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T21:21:06.807673+0000","last_peered":"2024-05-08T21:21:06.807673+0000","last_clean":"2024-05-08T21:21:06.807673+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:06.807673+0000","last_undegraded":"2024-05-08T21:21:06.807673+0000","last_fullsized":"2024-05-08T21:21:06.807673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1175","reported_seq":1202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.868441+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T21:21:06.868441+0000","last_peered":"2024-05-08T21:21:06.868441+0000","last_clean":"2024-05-08T21:21:06.868441+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:06.868441+0000","last_undegraded":"2024-05-08T21:21:06.868441+0000","last_fullsized":"2024-05-08T21:21:06.868441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'819","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.541985+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T21:21:05.541985+0000","last_peered":"2024-05-08T21:21:05.541985+0000","last_clean":"2024-05-08T21:21:05.541985+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:21:05.541985+0000","last_undegraded":"2024-05-08T21:21:05.541985+0000","last_fullsized":"2024-05-08T21:21:05.541985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.692949+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T21:21:05.692949+0000","last_peered":"2024-05-08T21:21:05.692949+0000","last_clean":"2024-05-08T21:21:05.692949+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:21:05.692949+0000","last_undegraded":"2024-05-08T21:21:05.692949+0000","last_fullsized":"2024-05-08T21:21:05.692949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:15.767597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2315","reported_seq":2342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.892014+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T21:21:06.892014+0000","last_peered":"2024-05-08T21:21:06.892014+0000","last_clean":"2024-05-08T21:21:06.892014+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:06.892014+0000","last_undegraded":"2024-05-08T21:21:06.892014+0000","last_fullsized":"2024-05-08T21:21:06.892014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'822","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.687112+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T21:21:05.687112+0000","last_peered":"2024-05-08T21:21:05.687112+0000","last_clean":"2024-05-08T21:21:05.687112+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:05.687112+0000","last_undegraded":"2024-05-08T21:21:05.687112+0000","last_fullsized":"2024-05-08T21:21:05.687112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:00.135628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905860+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T21:21:06.905860+0000","last_peered":"2024-05-08T21:21:06.905860+0000","last_clean":"2024-05-08T21:21:06.905860+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:06.905860+0000","last_undegraded":"2024-05-08T21:21:06.905860+0000","last_fullsized":"2024-05-08T21:21:06.905860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:52.925278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4376","reported_seq":4402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.789539+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T21:21:07.789539+0000","last_peered":"2024-05-08T21:21:07.789539+0000","last_clean":"2024-05-08T21:21:07.789539+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:07.789539+0000","last_undegraded":"2024-05-08T21:21:07.789539+0000","last_fullsized":"2024-05-08T21:21:07.789539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4376,"log_dups_size":0,"ondisk_log_size":4376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'810","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.891188+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T21:21:06.891188+0000","last_peered":"2024-05-08T21:21:06.891188+0000","last_clean":"2024-05-08T21:21:06.891188+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:06.891188+0000","last_undegraded":"2024-05-08T21:21:06.891188+0000","last_fullsized":"2024-05-08T21:21:06.891188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.796652+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T21:21:06.796652+0000","last_peered":"2024-05-08T21:21:06.796652+0000","last_clean":"2024-05-08T21:21:06.796652+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:21:06.796652+0000","last_undegraded":"2024-05-08T21:21:06.796652+0000","last_fullsized":"2024-05-08T21:21:06.796652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1715","reported_seq":1742,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.791537+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T21:21:07.791537+0000","last_peered":"2024-05-08T21:21:07.791537+0000","last_clean":"2024-05-08T21:21:07.791537+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:07.791537+0000","last_undegraded":"2024-05-08T21:21:07.791537+0000","last_fullsized":"2024-05-08T21:21:07.791537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'873","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.712934+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T21:21:05.712934+0000","last_peered":"2024-05-08T21:21:05.712934+0000","last_clean":"2024-05-08T21:21:05.712934+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:05.712934+0000","last_undegraded":"2024-05-08T21:21:05.712934+0000","last_fullsized":"2024-05-08T21:21:05.712934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.914439+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T21:21:06.914439+0000","last_peered":"2024-05-08T21:21:06.914439+0000","last_clean":"2024-05-08T21:21:06.914439+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:06.914439+0000","last_undegraded":"2024-05-08T21:21:06.914439+0000","last_fullsized":"2024-05-08T21:21:06.914439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:11.358274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5269","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.598466+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T21:19:12.598466+0000","last_peered":"2024-05-08T21:19:12.598466+0000","last_clean":"2024-05-08T21:19:12.598466+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:19:12.598466+0000","last_undegraded":"2024-05-08T21:19:12.598466+0000","last_fullsized":"2024-05-08T21:19:12.598466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5269,"log_dups_size":0,"ondisk_log_size":5269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'816","reported_seq":841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.631162+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T21:21:05.631162+0000","last_peered":"2024-05-08T21:21:05.631162+0000","last_clean":"2024-05-08T21:21:05.631162+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:05.631162+0000","last_undegraded":"2024-05-08T21:21:05.631162+0000","last_fullsized":"2024-05-08T21:21:05.631162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855319+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T21:21:06.855319+0000","last_peered":"2024-05-08T21:21:06.855319+0000","last_clean":"2024-05-08T21:21:06.855319+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:21:06.855319+0000","last_undegraded":"2024-05-08T21:21:06.855319+0000","last_fullsized":"2024-05-08T21:21:06.855319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:53:25.005036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2689","reported_seq":3285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795020+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T21:21:07.795020+0000","last_peered":"2024-05-08T21:21:07.795020+0000","last_clean":"2024-05-08T21:21:07.795020+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:07.795020+0000","last_undegraded":"2024-05-08T21:21:07.795020+0000","last_fullsized":"2024-05-08T21:21:07.795020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2689,"log_dups_size":0,"ondisk_log_size":2689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":570,"num_read_kb":1794,"num_write":2690,"num_write_kb":19158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'802","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.352224+0000","last_change":"2024-05-08T20:55:41.598425+0000","last_active":"2024-05-08T21:21:05.352224+0000","last_peered":"2024-05-08T21:21:05.352224+0000","last_clean":"2024-05-08T21:21:05.352224+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:05.352224+0000","last_undegraded":"2024-05-08T21:21:05.352224+0000","last_fullsized":"2024-05-08T21:21:05.352224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:54.987104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.631431+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T21:21:05.631431+0000","last_peered":"2024-05-08T21:21:05.631431+0000","last_clean":"2024-05-08T21:21:05.631431+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:05.631431+0000","last_undegraded":"2024-05-08T21:21:05.631431+0000","last_fullsized":"2024-05-08T21:21:05.631431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3354","reported_seq":3380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.826855+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T21:21:06.826855+0000","last_peered":"2024-05-08T21:21:06.826855+0000","last_clean":"2024-05-08T21:21:06.826855+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:06.826855+0000","last_undegraded":"2024-05-08T21:21:06.826855+0000","last_fullsized":"2024-05-08T21:21:06.826855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3354,"log_dups_size":0,"ondisk_log_size":3354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'816","reported_seq":842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.656934+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T21:21:05.656934+0000","last_peered":"2024-05-08T21:21:05.656934+0000","last_clean":"2024-05-08T21:21:05.656934+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:05.656934+0000","last_undegraded":"2024-05-08T21:21:05.656934+0000","last_fullsized":"2024-05-08T21:21:05.656934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4040,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714358+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T21:21:05.714358+0000","last_peered":"2024-05-08T21:21:05.714358+0000","last_clean":"2024-05-08T21:21:05.714358+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:21:05.714358+0000","last_undegraded":"2024-05-08T21:21:05.714358+0000","last_fullsized":"2024-05-08T21:21:05.714358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4046","reported_seq":4072,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.793921+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T21:21:07.793921+0000","last_peered":"2024-05-08T21:21:07.793921+0000","last_clean":"2024-05-08T21:21:07.793921+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:07.793921+0000","last_undegraded":"2024-05-08T21:21:07.793921+0000","last_fullsized":"2024-05-08T21:21:07.793921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4046,"log_dups_size":0,"ondisk_log_size":4046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4055,"num_write_kb":23094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'822","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.439153+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T21:21:05.439153+0000","last_peered":"2024-05-08T21:21:05.439153+0000","last_clean":"2024-05-08T21:21:05.439153+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:05.439153+0000","last_undegraded":"2024-05-08T21:21:05.439153+0000","last_fullsized":"2024-05-08T21:21:05.439153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:26.219955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.727219+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T21:21:05.727219+0000","last_peered":"2024-05-08T21:21:05.727219+0000","last_clean":"2024-05-08T21:21:05.727219+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:21:05.727219+0000","last_undegraded":"2024-05-08T21:21:05.727219+0000","last_fullsized":"2024-05-08T21:21:05.727219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4547","reported_seq":4574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.852319+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T21:21:06.852319+0000","last_peered":"2024-05-08T21:21:06.852319+0000","last_clean":"2024-05-08T21:21:06.852319+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:06.852319+0000","last_undegraded":"2024-05-08T21:21:06.852319+0000","last_fullsized":"2024-05-08T21:21:06.852319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'799","reported_seq":825,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.712819+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T21:21:05.712819+0000","last_peered":"2024-05-08T21:21:05.712819+0000","last_clean":"2024-05-08T21:21:05.712819+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:21:05.712819+0000","last_undegraded":"2024-05-08T21:21:05.712819+0000","last_fullsized":"2024-05-08T21:21:05.712819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.897454+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T21:21:06.897454+0000","last_peered":"2024-05-08T21:21:06.897454+0000","last_clean":"2024-05-08T21:21:06.897454+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:21:06.897454+0000","last_undegraded":"2024-05-08T21:21:06.897454+0000","last_fullsized":"2024-05-08T21:21:06.897454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2508","reported_seq":2536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.874597+0000","last_change":"2024-05-08T20:54:59.629962+0000","last_active":"2024-05-08T21:21:06.874597+0000","last_peered":"2024-05-08T21:21:06.874597+0000","last_clean":"2024-05-08T21:21:06.874597+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:06.874597+0000","last_undegraded":"2024-05-08T21:21:06.874597+0000","last_fullsized":"2024-05-08T21:21:06.874597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2508,"log_dups_size":0,"ondisk_log_size":2508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'791","reported_seq":811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.654638+0000","last_change":"2024-05-08T20:55:41.595254+0000","last_active":"2024-05-08T21:21:05.654638+0000","last_peered":"2024-05-08T21:21:05.654638+0000","last_clean":"2024-05-08T21:21:05.654638+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:05.654638+0000","last_undegraded":"2024-05-08T21:21:05.654638+0000","last_fullsized":"2024-05-08T21:21:05.654638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:41.183338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.547382+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T21:21:05.547382+0000","last_peered":"2024-05-08T21:21:05.547382+0000","last_clean":"2024-05-08T21:21:05.547382+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:21:05.547382+0000","last_undegraded":"2024-05-08T21:21:05.547382+0000","last_fullsized":"2024-05-08T21:21:05.547382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:11.959849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788155+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T21:21:07.788155+0000","last_peered":"2024-05-08T21:21:07.788155+0000","last_clean":"2024-05-08T21:21:07.788155+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:07.788155+0000","last_undegraded":"2024-05-08T21:21:07.788155+0000","last_fullsized":"2024-05-08T21:21:07.788155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'819","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.651411+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T21:21:05.651411+0000","last_peered":"2024-05-08T21:21:05.651411+0000","last_clean":"2024-05-08T21:21:05.651411+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:05.651411+0000","last_undegraded":"2024-05-08T21:21:05.651411+0000","last_fullsized":"2024-05-08T21:21:05.651411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3549,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.827287+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T21:21:06.827287+0000","last_peered":"2024-05-08T21:21:06.827287+0000","last_clean":"2024-05-08T21:21:06.827287+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:21:06.827287+0000","last_undegraded":"2024-05-08T21:21:06.827287+0000","last_fullsized":"2024-05-08T21:21:06.827287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:34.555272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1099","reported_seq":1126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794753+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T21:21:07.794753+0000","last_peered":"2024-05-08T21:21:07.794753+0000","last_clean":"2024-05-08T21:21:07.794753+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:07.794753+0000","last_undegraded":"2024-05-08T21:21:07.794753+0000","last_fullsized":"2024-05-08T21:21:07.794753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'813","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.412989+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T21:21:05.412989+0000","last_peered":"2024-05-08T21:21:05.412989+0000","last_clean":"2024-05-08T21:21:05.412989+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:05.412989+0000","last_undegraded":"2024-05-08T21:21:05.412989+0000","last_fullsized":"2024-05-08T21:21:05.412989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.715442+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T21:21:05.715442+0000","last_peered":"2024-05-08T21:21:05.715442+0000","last_clean":"2024-05-08T21:21:05.715442+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:21:05.715442+0000","last_undegraded":"2024-05-08T21:21:05.715442+0000","last_fullsized":"2024-05-08T21:21:05.715442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1824","reported_seq":1852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.790327+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T21:21:07.790327+0000","last_peered":"2024-05-08T21:21:07.790327+0000","last_clean":"2024-05-08T21:21:07.790327+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:07.790327+0000","last_undegraded":"2024-05-08T21:21:07.790327+0000","last_fullsized":"2024-05-08T21:21:07.790327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:47.695642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'852","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.816819+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T21:21:06.816819+0000","last_peered":"2024-05-08T21:21:06.816819+0000","last_clean":"2024-05-08T21:21:06.816819+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:06.816819+0000","last_undegraded":"2024-05-08T21:21:06.816819+0000","last_fullsized":"2024-05-08T21:21:06.816819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.903427+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T21:21:06.903427+0000","last_peered":"2024-05-08T21:21:06.903427+0000","last_clean":"2024-05-08T21:21:06.903427+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:21:06.903427+0000","last_undegraded":"2024-05-08T21:21:06.903427+0000","last_fullsized":"2024-05-08T21:21:06.903427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1830","reported_seq":1858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.877172+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T21:21:06.877172+0000","last_peered":"2024-05-08T21:21:06.877172+0000","last_clean":"2024-05-08T21:21:06.877172+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:06.877172+0000","last_undegraded":"2024-05-08T21:21:06.877172+0000","last_fullsized":"2024-05-08T21:21:06.877172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:17.737238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860634+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T21:21:06.860634+0000","last_peered":"2024-05-08T21:21:06.860634+0000","last_clean":"2024-05-08T21:21:06.860634+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:06.860634+0000","last_undegraded":"2024-05-08T21:21:06.860634+0000","last_fullsized":"2024-05-08T21:21:06.860634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4241,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.816432+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T21:21:06.816432+0000","last_peered":"2024-05-08T21:21:06.816432+0000","last_clean":"2024-05-08T21:21:06.816432+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:06.816432+0000","last_undegraded":"2024-05-08T21:21:06.816432+0000","last_fullsized":"2024-05-08T21:21:06.816432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:36:10.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1214","reported_seq":1242,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786415+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T21:21:07.786415+0000","last_peered":"2024-05-08T21:21:07.786415+0000","last_clean":"2024-05-08T21:21:07.786415+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:07.786415+0000","last_undegraded":"2024-05-08T21:21:07.786415+0000","last_fullsized":"2024-05-08T21:21:07.786415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'818","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.666674+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T21:21:05.666674+0000","last_peered":"2024-05-08T21:21:05.666674+0000","last_clean":"2024-05-08T21:21:05.666674+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:05.666674+0000","last_undegraded":"2024-05-08T21:21:05.666674+0000","last_fullsized":"2024-05-08T21:21:05.666674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.878575+0000","last_change":"2024-05-08T20:55:41.599810+0000","last_active":"2024-05-08T21:21:06.878575+0000","last_peered":"2024-05-08T21:21:06.878575+0000","last_clean":"2024-05-08T21:21:06.878575+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:21:06.878575+0000","last_undegraded":"2024-05-08T21:21:06.878575+0000","last_fullsized":"2024-05-08T21:21:06.878575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:59.058826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5314","reported_seq":5342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:08.308765+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T21:21:08.308765+0000","last_peered":"2024-05-08T21:21:08.308765+0000","last_clean":"2024-05-08T21:21:08.308765+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:08.308765+0000","last_undegraded":"2024-05-08T21:21:08.308765+0000","last_fullsized":"2024-05-08T21:21:08.308765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5314,"log_dups_size":0,"ondisk_log_size":5314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24002075,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5312,"num_write_kb":42290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'808","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.408322+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T21:21:05.408322+0000","last_peered":"2024-05-08T21:21:05.408322+0000","last_clean":"2024-05-08T21:21:05.408322+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:05.408322+0000","last_undegraded":"2024-05-08T21:21:05.408322+0000","last_fullsized":"2024-05-08T21:21:05.408322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:30.883278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3417","reported_seq":3443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.905261+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T21:21:06.905261+0000","last_peered":"2024-05-08T21:21:06.905261+0000","last_clean":"2024-05-08T21:21:06.905261+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:21:06.905261+0000","last_undegraded":"2024-05-08T21:21:06.905261+0000","last_fullsized":"2024-05-08T21:21:06.905261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3417,"log_dups_size":0,"ondisk_log_size":3417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:01.643413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2633,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'836","reported_seq":864,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.908775+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T21:21:06.908775+0000","last_peered":"2024-05-08T21:21:06.908775+0000","last_clean":"2024-05-08T21:21:06.908775+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:06.908775+0000","last_undegraded":"2024-05-08T21:21:06.908775+0000","last_fullsized":"2024-05-08T21:21:06.908775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.904083+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T21:21:06.904083+0000","last_peered":"2024-05-08T21:21:06.904083+0000","last_clean":"2024-05-08T21:21:06.904083+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:06.904083+0000","last_undegraded":"2024-05-08T21:21:06.904083+0000","last_fullsized":"2024-05-08T21:21:06.904083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.675819+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T21:21:05.675819+0000","last_peered":"2024-05-08T21:21:05.675819+0000","last_clean":"2024-05-08T21:21:05.675819+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:21:05.675819+0000","last_undegraded":"2024-05-08T21:21:05.675819+0000","last_fullsized":"2024-05-08T21:21:05.675819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'836","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.806709+0000","last_change":"2024-05-08T20:55:41.599436+0000","last_active":"2024-05-08T21:21:06.806709+0000","last_peered":"2024-05-08T21:21:06.806709+0000","last_clean":"2024-05-08T21:21:06.806709+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:06.806709+0000","last_undegraded":"2024-05-08T21:21:06.806709+0000","last_fullsized":"2024-05-08T21:21:06.806709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:12.873685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2354","reported_seq":2382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.817404+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T21:21:06.817404+0000","last_peered":"2024-05-08T21:21:06.817404+0000","last_clean":"2024-05-08T21:21:06.817404+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:06.817404+0000","last_undegraded":"2024-05-08T21:21:06.817404+0000","last_fullsized":"2024-05-08T21:21:06.817404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:18:52.697136+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T21:18:52.697136+0000","last_peered":"2024-05-08T21:18:52.697136+0000","last_clean":"2024-05-08T21:18:52.697136+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:18:52.697136+0000","last_undegraded":"2024-05-08T21:18:52.697136+0000","last_fullsized":"2024-05-08T21:18:52.697136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3603,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853507+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T21:21:06.853507+0000","last_peered":"2024-05-08T21:21:06.853507+0000","last_clean":"2024-05-08T21:21:06.853507+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:21:06.853507+0000","last_undegraded":"2024-05-08T21:21:06.853507+0000","last_fullsized":"2024-05-08T21:21:06.853507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:59.212426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'783","reported_seq":811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.409284+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T21:21:05.409284+0000","last_peered":"2024-05-08T21:21:05.409284+0000","last_clean":"2024-05-08T21:21:05.409284+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:05.409284+0000","last_undegraded":"2024-05-08T21:21:05.409284+0000","last_fullsized":"2024-05-08T21:21:05.409284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:16.831824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4039","reported_seq":4069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.907119+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T21:21:06.907119+0000","last_peered":"2024-05-08T21:21:06.907119+0000","last_clean":"2024-05-08T21:21:06.907119+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:06.907119+0000","last_undegraded":"2024-05-08T21:21:06.907119+0000","last_fullsized":"2024-05-08T21:21:06.907119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4039,"log_dups_size":0,"ondisk_log_size":4039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.657426+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T21:21:05.657426+0000","last_peered":"2024-05-08T21:21:05.657426+0000","last_clean":"2024-05-08T21:21:05.657426+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:21:05.657426+0000","last_undegraded":"2024-05-08T21:21:05.657426+0000","last_fullsized":"2024-05-08T21:21:05.657426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2955","reported_seq":2984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.785687+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T21:21:07.785687+0000","last_peered":"2024-05-08T21:21:07.785687+0000","last_clean":"2024-05-08T21:21:07.785687+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:07.785687+0000","last_undegraded":"2024-05-08T21:21:07.785687+0000","last_fullsized":"2024-05-08T21:21:07.785687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'830","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853241+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T21:21:06.853241+0000","last_peered":"2024-05-08T21:21:06.853241+0000","last_clean":"2024-05-08T21:21:06.853241+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:06.853241+0000","last_undegraded":"2024-05-08T21:21:06.853241+0000","last_fullsized":"2024-05-08T21:21:06.853241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3593,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.910008+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T21:21:06.910008+0000","last_peered":"2024-05-08T21:21:06.910008+0000","last_clean":"2024-05-08T21:21:06.910008+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:06.910008+0000","last_undegraded":"2024-05-08T21:21:06.910008+0000","last_fullsized":"2024-05-08T21:21:06.910008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:18.488629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2156","reported_seq":2184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.792986+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T21:21:07.792986+0000","last_peered":"2024-05-08T21:21:07.792986+0000","last_clean":"2024-05-08T21:21:07.792986+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:07.792986+0000","last_undegraded":"2024-05-08T21:21:07.792986+0000","last_fullsized":"2024-05-08T21:21:07.792986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2744,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'774","reported_seq":802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.829556+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T21:21:06.829556+0000","last_peered":"2024-05-08T21:21:06.829556+0000","last_clean":"2024-05-08T21:21:06.829556+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:06.829556+0000","last_undegraded":"2024-05-08T21:21:06.829556+0000","last_fullsized":"2024-05-08T21:21:06.829556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.806135+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T21:21:06.806135+0000","last_peered":"2024-05-08T21:21:06.806135+0000","last_clean":"2024-05-08T21:21:06.806135+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:06.806135+0000","last_undegraded":"2024-05-08T21:21:06.806135+0000","last_fullsized":"2024-05-08T21:21:06.806135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:13:59.610624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1265","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.792632+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T21:21:07.792632+0000","last_peered":"2024-05-08T21:21:07.792632+0000","last_clean":"2024-05-08T21:21:07.792632+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:07.792632+0000","last_undegraded":"2024-05-08T21:21:07.792632+0000","last_fullsized":"2024-05-08T21:21:07.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'812","reported_seq":840,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.656810+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T21:21:05.656810+0000","last_peered":"2024-05-08T21:21:05.656810+0000","last_clean":"2024-05-08T21:21:05.656810+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:05.656810+0000","last_undegraded":"2024-05-08T21:21:05.656810+0000","last_fullsized":"2024-05-08T21:21:05.656810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3658,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.853943+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T21:21:06.853943+0000","last_peered":"2024-05-08T21:21:06.853943+0000","last_clean":"2024-05-08T21:21:06.853943+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:21:06.853943+0000","last_undegraded":"2024-05-08T21:21:06.853943+0000","last_fullsized":"2024-05-08T21:21:06.853943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:03.446819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1126","reported_seq":1155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788639+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T21:21:07.788639+0000","last_peered":"2024-05-08T21:21:07.788639+0000","last_clean":"2024-05-08T21:21:07.788639+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:07.788639+0000","last_undegraded":"2024-05-08T21:21:07.788639+0000","last_fullsized":"2024-05-08T21:21:07.788639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'838","reported_seq":866,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.817352+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T21:21:06.817352+0000","last_peered":"2024-05-08T21:21:06.817352+0000","last_clean":"2024-05-08T21:21:06.817352+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:06.817352+0000","last_undegraded":"2024-05-08T21:21:06.817352+0000","last_fullsized":"2024-05-08T21:21:06.817352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:11.899173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.833211+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T21:21:06.833211+0000","last_peered":"2024-05-08T21:21:06.833211+0000","last_clean":"2024-05-08T21:21:06.833211+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:06.833211+0000","last_undegraded":"2024-05-08T21:21:06.833211+0000","last_fullsized":"2024-05-08T21:21:06.833211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2225","reported_seq":2253,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.789335+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T21:21:07.789335+0000","last_peered":"2024-05-08T21:21:07.789335+0000","last_clean":"2024-05-08T21:21:07.789335+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:07.789335+0000","last_undegraded":"2024-05-08T21:21:07.789335+0000","last_fullsized":"2024-05-08T21:21:07.789335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'879","reported_seq":907,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.831261+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T21:21:06.831261+0000","last_peered":"2024-05-08T21:21:06.831261+0000","last_clean":"2024-05-08T21:21:06.831261+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:06.831261+0000","last_undegraded":"2024-05-08T21:21:06.831261+0000","last_fullsized":"2024-05-08T21:21:06.831261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":879,"log_dups_size":0,"ondisk_log_size":879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:11.668952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3781,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.693049+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T21:21:05.693049+0000","last_peered":"2024-05-08T21:21:05.693049+0000","last_clean":"2024-05-08T21:21:05.693049+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:05.693049+0000","last_undegraded":"2024-05-08T21:21:05.693049+0000","last_fullsized":"2024-05-08T21:21:05.693049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:27.059976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3678","reported_seq":3706,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.790462+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T21:21:07.790462+0000","last_peered":"2024-05-08T21:21:07.790462+0000","last_clean":"2024-05-08T21:21:07.790462+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:07.790462+0000","last_undegraded":"2024-05-08T21:21:07.790462+0000","last_fullsized":"2024-05-08T21:21:07.790462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.601675+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T21:21:05.601675+0000","last_peered":"2024-05-08T21:21:05.601675+0000","last_clean":"2024-05-08T21:21:05.601675+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:05.601675+0000","last_undegraded":"2024-05-08T21:21:05.601675+0000","last_fullsized":"2024-05-08T21:21:05.601675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:49.443442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3512,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714540+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T21:21:05.714540+0000","last_peered":"2024-05-08T21:21:05.714540+0000","last_clean":"2024-05-08T21:21:05.714540+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:21:05.714540+0000","last_undegraded":"2024-05-08T21:21:05.714540+0000","last_fullsized":"2024-05-08T21:21:05.714540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:55.865290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4106","reported_seq":4134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889069+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T21:21:06.889069+0000","last_peered":"2024-05-08T21:21:06.889069+0000","last_clean":"2024-05-08T21:21:06.889069+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:06.889069+0000","last_undegraded":"2024-05-08T21:21:06.889069+0000","last_fullsized":"2024-05-08T21:21:06.889069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4106,"log_dups_size":0,"ondisk_log_size":4106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'805","reported_seq":832,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714591+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T21:21:05.714591+0000","last_peered":"2024-05-08T21:21:05.714591+0000","last_clean":"2024-05-08T21:21:05.714591+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:05.714591+0000","last_undegraded":"2024-05-08T21:21:05.714591+0000","last_fullsized":"2024-05-08T21:21:05.714591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.797861+0000","last_change":"2024-05-08T20:55:41.605046+0000","last_active":"2024-05-08T21:21:06.797861+0000","last_peered":"2024-05-08T21:21:06.797861+0000","last_clean":"2024-05-08T21:21:06.797861+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:21:06.797861+0000","last_undegraded":"2024-05-08T21:21:06.797861+0000","last_fullsized":"2024-05-08T21:21:06.797861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:10.838870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3436","reported_seq":3464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794034+0000","last_change":"2024-05-08T20:54:59.625358+0000","last_active":"2024-05-08T21:21:07.794034+0000","last_peered":"2024-05-08T21:21:07.794034+0000","last_clean":"2024-05-08T21:21:07.794034+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:07.794034+0000","last_undegraded":"2024-05-08T21:21:07.794034+0000","last_fullsized":"2024-05-08T21:21:07.794034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3436,"log_dups_size":0,"ondisk_log_size":3436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'803","reported_seq":830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.557872+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T21:21:05.557872+0000","last_peered":"2024-05-08T21:21:05.557872+0000","last_clean":"2024-05-08T21:21:05.557872+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:05.557872+0000","last_undegraded":"2024-05-08T21:21:05.557872+0000","last_fullsized":"2024-05-08T21:21:05.557872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855224+0000","last_change":"2024-05-08T20:55:41.613686+0000","last_active":"2024-05-08T21:21:06.855224+0000","last_peered":"2024-05-08T21:21:06.855224+0000","last_clean":"2024-05-08T21:21:06.855224+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:21:06.855224+0000","last_undegraded":"2024-05-08T21:21:06.855224+0000","last_fullsized":"2024-05-08T21:21:06.855224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:43.286175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3909","reported_seq":3936,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786269+0000","last_change":"2024-05-08T20:54:59.618192+0000","last_active":"2024-05-08T21:21:07.786269+0000","last_peered":"2024-05-08T21:21:07.786269+0000","last_clean":"2024-05-08T21:21:07.786269+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:07.786269+0000","last_undegraded":"2024-05-08T21:21:07.786269+0000","last_fullsized":"2024-05-08T21:21:07.786269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'813","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.666784+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T21:21:05.666784+0000","last_peered":"2024-05-08T21:21:05.666784+0000","last_clean":"2024-05-08T21:21:05.666784+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:05.666784+0000","last_undegraded":"2024-05-08T21:21:05.666784+0000","last_fullsized":"2024-05-08T21:21:05.666784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.849896+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T21:21:06.849896+0000","last_peered":"2024-05-08T21:21:06.849896+0000","last_clean":"2024-05-08T21:21:06.849896+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:21:06.849896+0000","last_undegraded":"2024-05-08T21:21:06.849896+0000","last_fullsized":"2024-05-08T21:21:06.849896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1801","reported_seq":1829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.855668+0000","last_change":"2024-05-08T20:54:59.623921+0000","last_active":"2024-05-08T21:21:06.855668+0000","last_peered":"2024-05-08T21:21:06.855668+0000","last_clean":"2024-05-08T21:21:06.855668+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:06.855668+0000","last_undegraded":"2024-05-08T21:21:06.855668+0000","last_fullsized":"2024-05-08T21:21:06.855668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1801,"log_dups_size":0,"ondisk_log_size":1801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:10.898861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'809","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.568249+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T21:21:05.568249+0000","last_peered":"2024-05-08T21:21:05.568249+0000","last_clean":"2024-05-08T21:21:05.568249+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:05.568249+0000","last_undegraded":"2024-05-08T21:21:05.568249+0000","last_fullsized":"2024-05-08T21:21:05.568249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.685344+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T21:21:05.685344+0000","last_peered":"2024-05-08T21:21:05.685344+0000","last_clean":"2024-05-08T21:21:05.685344+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:05.685344+0000","last_undegraded":"2024-05-08T21:21:05.685344+0000","last_fullsized":"2024-05-08T21:21:05.685344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'857","reported_seq":893,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.784291+0000","last_change":"2024-05-08T20:55:42.115166+0000","last_active":"2024-05-08T21:21:06.784291+0000","last_peered":"2024-05-08T21:21:06.784291+0000","last_clean":"2024-05-08T21:21:06.784291+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:06.784291+0000","last_undegraded":"2024-05-08T21:21:06.784291+0000","last_fullsized":"2024-05-08T21:21:06.784291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:55.110706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'809","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.687798+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T21:21:05.687798+0000","last_peered":"2024-05-08T21:21:05.687798+0000","last_clean":"2024-05-08T21:21:05.687798+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:05.687798+0000","last_undegraded":"2024-05-08T21:21:05.687798+0000","last_fullsized":"2024-05-08T21:21:05.687798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'841","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.671360+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T21:21:05.671360+0000","last_peered":"2024-05-08T21:21:05.671360+0000","last_clean":"2024-05-08T21:21:05.671360+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:05.671360+0000","last_undegraded":"2024-05-08T21:21:05.671360+0000","last_fullsized":"2024-05-08T21:21:05.671360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'810","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.592695+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T21:21:05.592695+0000","last_peered":"2024-05-08T21:21:05.592695+0000","last_clean":"2024-05-08T21:21:05.592695+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:05.592695+0000","last_undegraded":"2024-05-08T21:21:05.592695+0000","last_fullsized":"2024-05-08T21:21:05.592695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:43.072266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'812","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.657863+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T21:21:05.657863+0000","last_peered":"2024-05-08T21:21:05.657863+0000","last_clean":"2024-05-08T21:21:05.657863+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:05.657863+0000","last_undegraded":"2024-05-08T21:21:05.657863+0000","last_fullsized":"2024-05-08T21:21:05.657863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'867","reported_seq":894,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.579556+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T21:21:05.579556+0000","last_peered":"2024-05-08T21:21:05.579556+0000","last_clean":"2024-05-08T21:21:05.579556+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:21:05.579556+0000","last_undegraded":"2024-05-08T21:21:05.579556+0000","last_fullsized":"2024-05-08T21:21:05.579556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'805","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.520599+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T21:21:05.520599+0000","last_peered":"2024-05-08T21:21:05.520599+0000","last_clean":"2024-05-08T21:21:05.520599+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:05.520599+0000","last_undegraded":"2024-05-08T21:21:05.520599+0000","last_fullsized":"2024-05-08T21:21:05.520599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'802","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.696312+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T21:21:05.696312+0000","last_peered":"2024-05-08T21:21:05.696312+0000","last_clean":"2024-05-08T21:21:05.696312+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:05.696312+0000","last_undegraded":"2024-05-08T21:21:05.696312+0000","last_fullsized":"2024-05-08T21:21:05.696312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'790","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.583744+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T21:21:05.583744+0000","last_peered":"2024-05-08T21:21:05.583744+0000","last_clean":"2024-05-08T21:21:05.583744+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:05.583744+0000","last_undegraded":"2024-05-08T21:21:05.583744+0000","last_fullsized":"2024-05-08T21:21:05.583744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'823","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.558131+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T21:21:05.558131+0000","last_peered":"2024-05-08T21:21:05.558131+0000","last_clean":"2024-05-08T21:21:05.558131+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:05.558131+0000","last_undegraded":"2024-05-08T21:21:05.558131+0000","last_fullsized":"2024-05-08T21:21:05.558131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'830","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.845663+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T21:21:06.845663+0000","last_peered":"2024-05-08T21:21:06.845663+0000","last_clean":"2024-05-08T21:21:06.845663+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:06.845663+0000","last_undegraded":"2024-05-08T21:21:06.845663+0000","last_fullsized":"2024-05-08T21:21:06.845663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:35.944147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'828","reported_seq":854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.066170+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T21:21:05.066170+0000","last_peered":"2024-05-08T21:21:05.066170+0000","last_clean":"2024-05-08T21:21:05.066170+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:05.066170+0000","last_undegraded":"2024-05-08T21:21:05.066170+0000","last_fullsized":"2024-05-08T21:21:05.066170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86559,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113555,"ondisk_log_size":113555,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52259,"ondisk_log_size":52259,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243559552,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2930,"num_read_kb":7529,"num_write":91796,"num_write_kb":660226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487178240,"data_stored":487119104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91041,"ondisk_log_size":91041,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575169,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516716,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":450302,"kb_avail":93855124,"statfs":{"total":96636764160,"available":96107646976,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":461109707},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.65200000000000002,"15min":0.44700000000000001},"min":{"1min":0.22500000000000001,"5min":0.216,"15min":0.191},"max":{"1min":9.2940000000000005,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.65700000000000003,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":11.170999999999999,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.70999999999999996,"15min":0.48399999999999999},"min":{"1min":0.254,"5min":0.22,"15min":0.20599999999999999},"max":{"1min":11.247999999999999,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.64600000000000002,"15min":0.505},"min":{"1min":0.251,"5min":0.22,"15min":0.20499999999999999},"max":{"1min":11.425000000000001,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56899999999999995,"15min":0.48399999999999999},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":2.1160000000000001,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.58299999999999996,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.9450000000000003,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.73799999999999999,"15min":0.53900000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.218,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":2.081,"5min":7.9459999999999997,"15min":7.9459999999999997},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.58899999999999997,"15min":0.498},"min":{"1min":0.253,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":0.65100000000000002,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.64900000000000002,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.254},"max":{"1min":1.109,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.40100000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.67500000000000004,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":8.9849999999999994,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.755,"15min":0.57499999999999996},"min":{"1min":0.44500000000000001,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":2.681,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.47099999999999997}]},{"osd":6,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.67600000000000005,"15min":0.54900000000000004},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":9.1050000000000004,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.58499999999999996},"min":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":1.599,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575169,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.45500000000000002,"15min":0.42099999999999999},"min":{"1min":0.23000000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59199999999999997,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.372,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53200000000000003,"5min":2.1080000000000001,"15min":3.839},"last":0.621}]},{"osd":1,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.63600000000000001,"15min":0.49399999999999999},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":1.4370000000000001,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.53600000000000003,"15min":0.47999999999999998},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.56499999999999995,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.48599999999999999},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.3089999999999999,"5min":3.694,"15min":3.694},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60399999999999998,"15min":0.497},"min":{"1min":0.28699999999999998,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":1.2709999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56599999999999995,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":1.661,"5min":3.218,"15min":3.8250000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":1.4770000000000001,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":3.077,"15min":7.3810000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.72899999999999998,"15min":0.56399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.222},"max":{"1min":0.66600000000000004,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.68700000000000006}]},{"osd":5,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.495},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.4039999999999999,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.56499999999999995},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.3420000000000001,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.40899999999999997,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.70499999999999996,"5min":3.1909999999999998,"15min":3.8100000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":1.5009999999999999,"5min":2.919,"15min":3.8780000000000001},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575169,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581440,"kb_used_data":81080,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790400,"statfs":{"total":96636764160,"available":96041369600,"internally_reserved":0,"allocated":83025920,"data_stored":82844999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.46300000000000002,"15min":0.35899999999999999},"min":{"1min":0.189,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":2.0699999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.45400000000000001,"15min":0.38100000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.653,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.189},"max":{"1min":0.56599999999999995,"5min":5.141,"15min":5.141},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53600000000000003,"15min":0.45400000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.1179999999999999,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.628,"15min":0.49099999999999999},"min":{"1min":0.249,"5min":0.216,"15min":0.215},"max":{"1min":2.1890000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.53100000000000003,"15min":0.45700000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.19},"max":{"1min":1.6890000000000001,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.443}]},{"osd":4,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.55400000000000005,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":2.1709999999999998,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55500000000000005,"15min":0.499},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.7090000000000001,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.56299999999999994,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.66000000000000003}]},{"osd":6,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.67100000000000004,"15min":0.55100000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.7310000000000001,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.28499999999999998},"max":{"1min":2.4830000000000001,"5min":6.766,"15min":6.766},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.72799999999999998,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":2.3100000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69199999999999995,"15min":0.60999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33900000000000002},"max":{"1min":1.7529999999999999,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834575170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375608,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996232,"statfs":{"total":96636764160,"available":96252141568,"internally_reserved":0,"allocated":30261248,"data_stored":30073642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":1.1559999999999999,"5min":3.823,"15min":3.823},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.41099999999999998,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.224,"15min":0.19},"max":{"1min":1.179,"5min":3.879,"15min":4.5919999999999996},"last":0.30099999999999999}]},{"osd":2,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.39400000000000002,"15min":0.35499999999999998},"min":{"1min":0.22800000000000001,"5min":0.20699999999999999,"15min":0.17399999999999999},"max":{"1min":0.59999999999999998,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.41999999999999998,"5min":1.752,"15min":3.9870000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"min":{"1min":0.27300000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":0.74199999999999999,"5min":3.7160000000000002,"15min":3.895},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.45600000000000002,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":1.7509999999999999,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.254},"max":{"1min":0.77400000000000002,"5min":3.794,"15min":5.6559999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.45000000000000001},"min":{"1min":0.32200000000000001,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.68799999999999994,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.373}]},{"osd":5,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.89700000000000002,"5min":4.0019999999999998,"15min":4.165},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.73899999999999999,"15min":0.59299999999999997},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":2.8799999999999999,"5min":14.901,"15min":14.901},"last":0.46500000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56599999999999995,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.998,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.443}]},{"osd":7,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.36499999999999999,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.927,"15min":5.0220000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65400000000000003,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":2.9980000000000002,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834575169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.39600000000000002,"15min":0.34200000000000003},"min":{"1min":0.20799999999999999,"5min":0.17899999999999999,"15min":0.17000000000000001},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.443,"15min":0.40200000000000002},"min":{"1min":0.22500000000000001,"5min":0.187,"15min":0.187},"max":{"1min":5.7359999999999998,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.314}]},{"osd":1,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.45700000000000002,"15min":0.39600000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.194,"5min":0.58999999999999997,"15min":0.47199999999999998},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.90200000000000002,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.26500000000000001,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":1.484,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":16.651},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.997,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.38,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":5.7039999999999997,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.47499999999999998}]},{"osd":5,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":0.65600000000000003,"15min":0.53400000000000003},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70899999999999996,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.4550000000000001,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.44400000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.60299999999999998,"15min":0.57899999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.27400000000000002},"max":{"1min":2.4689999999999999,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.309},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":0.73599999999999999,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34200000000000003},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":0.71599999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.35099999999999998},"max":{"1min":11.736000000000001,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575169,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505456,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866384,"statfs":{"total":96636764160,"available":96119177216,"internally_reserved":0,"allocated":38051840,"data_stored":37871916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.53100000000000003,"15min":0.41999999999999998},"min":{"1min":0.218,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":6.407,"5min":6.407,"15min":6.407},"last":0.5},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.753,"15min":0.496},"min":{"1min":0.246,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":4.2949999999999999,"5min":16.724,"15min":16.724},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86099999999999999,"15min":0.57999999999999996},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":4.4809999999999999,"5min":13.058,"15min":15.259},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63200000000000001,"15min":0.51400000000000001},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.192},"max":{"1min":6.1109999999999998,"5min":9.5370000000000008,"15min":10.831},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55700000000000005,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.222,"15min":0.214},"max":{"1min":4.3739999999999997,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.48299999999999998},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":2.2639999999999998,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.96099999999999997,"15min":0.70499999999999996},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.3200000000000003,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":0.76400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":4.5039999999999996,"5min":11.755000000000001,"15min":15.224},"last":0.86799999999999999}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.59799999999999998,"15min":0.53900000000000003},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.61899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2549999999999999,"5min":5.548,"15min":5.548},"last":0.77500000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89300000000000002,"15min":0.65700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":4.4180000000000001,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.75},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.61399999999999999},"min":{"1min":0.374,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.978,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.88300000000000001}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.876,"15min":0.67500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.3490000000000002,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.97899999999999998,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":4.4560000000000004,"5min":12.939,"15min":12.939},"last":0.83499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575169,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.64100000000000001,"15min":0.48499999999999999},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.68300000000000005,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.58899999999999997,"15min":0.45900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.73299999999999998,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.61599999999999999,"15min":0.48999999999999999},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":10.222,"15min":10.222},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.58199999999999996,"15min":0.52500000000000002},"min":{"1min":0.25,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":0.624,"5min":7.343,"15min":7.4370000000000003},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.61299999999999999,"15min":0.503},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.64300000000000002,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.63900000000000001,"15min":0.54400000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":2.1179999999999999,"5min":3.9900000000000002,"15min":6.617},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.75800000000000001,"15min":0.56799999999999995},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":1.9259999999999999,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.323,"5min":5.6609999999999996,"15min":5.6609999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57599999999999996,"15min":0.50900000000000001},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.78000000000000003,"5min":4.0190000000000001,"15min":6.4340000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.65700000000000003,"15min":0.54800000000000004},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.23100000000000001},"max":{"1min":0.80200000000000005,"5min":4.8040000000000003,"15min":5.2990000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.60999999999999999,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":0.68899999999999995,"5min":5.6340000000000003,"15min":7.0039999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.72999999999999998,"15min":0.62},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":9.4550000000000001,"15min":9.4550000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.73599999999999999,"15min":0.59199999999999997},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.27300000000000002},"max":{"1min":0.89500000000000002,"5min":4.8280000000000003,"15min":4.8280000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.71799999999999997,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.372,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":5.6890000000000001,"15min":12.691000000000001},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575169,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544968,"kb_used_data":98880,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826872,"statfs":{"total":96636764160,"available":96078716928,"internally_reserved":0,"allocated":101253120,"data_stored":101074344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.56299999999999994,"15min":0.47799999999999998},"min":{"1min":0.22500000000000001,"5min":0.21199999999999999,"15min":0.17899999999999999},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.038,"5min":0.878,"15min":0.61099999999999999},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":9.2059999999999995,"5min":24.800000000000001,"15min":24.800000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.60999999999999999},"min":{"1min":0.28199999999999997,"5min":0.218,"15min":0.215},"max":{"1min":7.343,"5min":27.719000000000001,"15min":27.719000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.89600000000000002,"15min":0.61399999999999999},"min":{"1min":0.246,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":6.6150000000000002,"5min":24.826000000000001,"15min":24.826000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.62,"15min":0.52000000000000002},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.24099999999999999},"max":{"1min":7.4779999999999998,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.65500000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.28699999999999998,"15min":0.24199999999999999},"max":{"1min":7.4009999999999998,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.93899999999999995,"15min":0.66700000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":6.6559999999999997,"5min":24.606000000000002,"15min":24.606000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.751,"15min":0.60299999999999998},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.253},"max":{"1min":7.9909999999999997,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.3069999999999999,"15min":0.79800000000000004},"min":{"1min":0.32400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.319000000000001,"5min":71.634,"15min":71.634},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.762,"15min":0.98399999999999999},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.24199999999999999},"max":{"1min":10.032,"5min":101.794,"15min":101.794},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":0.77300000000000002,"15min":0.61399999999999999},"min":{"1min":0.34200000000000003,"5min":0.254,"15min":0.254},"max":{"1min":14.997,"5min":14.997,"15min":14.997},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.073,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.26500000000000001},"max":{"1min":19.137,"5min":28.053999999999998,"15min":28.053999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":4.7690000000000001,"5min":1.79,"15min":1.0089999999999999},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":67.849999999999994,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.53600000000000003},{"interface":"front","average":{"1min":5.2670000000000003,"5min":1.845,"15min":0.99199999999999999},"min":{"1min":0.39400000000000002,"5min":0.31,"15min":0.31},"max":{"1min":67.561000000000007,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82731008,"data_stored":82722491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100958208,"data_stored":100951836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:21:18.619 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:21:18.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.773+0000 7fd156e50700 1 Processor -- start 2024-05-08T21:21:18.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.773+0000 7fd156e50700 1 -- start start 2024-05-08T21:21:18.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd156e50700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1500c9e80 0x7fd15015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd156e50700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd1500c1f70 0x7fd1500c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd156e50700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15015b620 con 0x7fd150151400 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd156e50700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1500c1b20 con 0x7fd1500c1f70 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd156e50700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500cd8e0 con 0x7fd1500c9e80 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd1553ed700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fd1500c1f70 0x7fd1500c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd154bec700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fd150151400 0x7fd150070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45214/0 (socket says 172.21.15.135:45214) 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd154bec700 1 -- 172.21.15.135:0/1566867289 learned_addr learned my addr 172.21.15.135:0/1566867289 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd14ffff700 1 --2- 172.21.15.135:0/1566867289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1500c9e80 0x7fd15015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd1553ed700 1 -- 172.21.15.135:0/1566867289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1500c9e80 msgr2=0x7fd15015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd1553ed700 1 --2- 172.21.15.135:0/1566867289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1500c9e80 0x7fd15015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd1553ed700 1 -- 172.21.15.135:0/1566867289 >> v1:172.21.15.135:6789/0 conn(0x7fd150151400 legacy=0x7fd150070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd1553ed700 1 -- 172.21.15.135:0/1566867289 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500ccd60 con 0x7fd1500c1f70 2024-05-08T21:21:18.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.774+0000 7fd14f7fe700 1 -- 172.21.15.135:0/1566867289 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531001217 0 0) 0x7fd15015b620 con 0x7fd150151400 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd1553ed700 1 --2- 172.21.15.135:0/1566867289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd1500c2380 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd148009d90 tx=0x7fd14800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6547a778f16b041c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd14f7fe700 1 -- 172.21.15.135:0/1566867289 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800e070 con 0x7fd1500c1f70 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd14f7fe700 1 -- 172.21.15.135:0/1566867289 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14800bb20 con 0x7fd1500c1f70 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd14f7fe700 1 -- 172.21.15.135:0/1566867289 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148012430 con 0x7fd1500c1f70 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 -- 172.21.15.135:0/1566867289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 msgr2=0x7fd1500c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 --2- 172.21.15.135:0/1566867289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd1500c2380 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd148009d90 tx=0x7fd14800b330 comp rx=0 tx=0).stop 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 -- 172.21.15.135:0/1566867289 shutdown_connections 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 --2- 172.21.15.135:0/1566867289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd1500c2380 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 --2- 172.21.15.135:0/1566867289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1500c9e80 0x7fd15015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 -- 172.21.15.135:0/1566867289 >> 172.21.15.135:0/1566867289 conn(0x7fd150066d70 msgr2=0x7fd15006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 -- 172.21.15.135:0/1566867289 shutdown_connections 2024-05-08T21:21:18.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.775+0000 7fd156e50700 1 -- 172.21.15.135:0/1566867289 wait complete. 2024-05-08T21:21:18.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 Processor -- start 2024-05-08T21:21:18.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 -- start start 2024-05-08T21:21:18.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd150159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1500c9e80 0x7fd150159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd150151400 0x7fd15006c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500cb740 con 0x7fd1500c1f70 2024-05-08T21:21:18.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1501ef830 con 0x7fd1500c9e80 2024-05-08T21:21:18.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd156e50700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1501efd60 con 0x7fd150151400 2024-05-08T21:21:18.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.777+0000 7fd154bec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd150159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd150159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47768/0 (socket says 172.21.15.135:47768) 2024-05-08T21:21:18.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 -- 172.21.15.135:0/398680383 learned_addr learned my addr 172.21.15.135:0/398680383 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:18.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd1553ed700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd150151400 0x7fd15006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd14ffff700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1500c9e80 0x7fd150159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 -- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd150151400 msgr2=0x7fd15006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd150151400 0x7fd15006c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 -- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1500c9e80 msgr2=0x7fd150159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1500c9e80 0x7fd150159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 -- 172.21.15.135:0/398680383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd148009a70 con 0x7fd1500c1f70 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd14ffff700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1500c9e80 0x7fd150159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd154bec700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd150159520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd1440011e0 tx=0x7fd14400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd14d7fa700 1 -- 172.21.15.135:0/398680383 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144004c80 con 0x7fd1500c1f70 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd14d7fa700 1 -- 172.21.15.135:0/398680383 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144004e00 con 0x7fd1500c1f70 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15006c1f0 con 0x7fd1500c1f70 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd14d7fa700 1 -- 172.21.15.135:0/398680383 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144007310 con 0x7fd1500c1f70 2024-05-08T21:21:18.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.778+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1501efa80 con 0x7fd1500c1f70 2024-05-08T21:21:18.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.779+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15006c4d0 con 0x7fd1500c1f70 2024-05-08T21:21:18.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.780+0000 7fd14d7fa700 1 -- 172.21.15.135:0/398680383 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd144007470 con 0x7fd1500c1f70 2024-05-08T21:21:18.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.780+0000 7fd14d7fa700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd13406ac90 0x7fd13406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:18.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.780+0000 7fd14d7fa700 1 -- 172.21.15.135:0/398680383 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd144089470 con 0x7fd1500c1f70 2024-05-08T21:21:18.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.780+0000 7fd14ffff700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd13406ac90 0x7fd13406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:18.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.781+0000 7fd14ffff700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd13406ac90 0x7fd13406d150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1500c6890 tx=0x7fd13c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:18.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.785+0000 7fd14d7fa700 1 -- 172.21.15.135:0/398680383 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd144054290 con 0x7fd1500c1f70 2024-05-08T21:21:18.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.983+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1500c2860 con 0x7fd1500c1f70 2024-05-08T21:21:18.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.984+0000 7fd14d7fa700 1 -- 172.21.15.135:0/398680383 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18313 (secure 0 0 0) 0x7fd1440578b0 con 0x7fd1500c1f70 2024-05-08T21:21:18.987 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:18.987 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:41.588092+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:21:18.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd13406ac90 msgr2=0x7fd13406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd13406ac90 0x7fd13406d150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1500c6890 tx=0x7fd13c008040 comp rx=0 tx=0).stop 2024-05-08T21:21:18.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 msgr2=0x7fd150159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:18.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd150159520 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd1440011e0 tx=0x7fd14400cae0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 shutdown_connections 2024-05-08T21:21:18.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fd13406ac90 0x7fd13406d150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd150151400 0x7fd15006c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1500c1f70 0x7fd150159520 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 --2- 172.21.15.135:0/398680383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1500c9e80 0x7fd150159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:18.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 >> 172.21.15.135:0/398680383 conn(0x7fd150066d70 msgr2=0x7fd1500c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:18.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 shutdown_connections 2024-05-08T21:21:18.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:18.986+0000 7fd156e50700 1 -- 172.21.15.135:0/398680383 wait complete. 2024-05-08T21:21:20.001 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T21:21:20.002 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:20.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.137+0000 7f1275247700 1 Processor -- start 2024-05-08T21:21:20.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.137+0000 7f1275247700 1 -- start start 2024-05-08T21:21:20.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.137+0000 7f1275247700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12700c81d0 0x7f12700c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.137+0000 7f1275247700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f127013b180 0x7f127006fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.137+0000 7f1275247700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12700c3840 con 0x7f12700c3cd0 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.137+0000 7f1275247700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127013c160 con 0x7f127013b180 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.137+0000 7f1275247700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700c9550 con 0x7f12700c81d0 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126f59e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f127013b180 0x7f127006fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126e59c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f12700c3cd0 0x7f1270156010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45220/0 (socket says 172.21.15.135:45220) 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126e59c700 1 -- 172.21.15.135:0/1641735156 learned_addr learned my addr 172.21.15.135:0/1641735156 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126ed9d700 1 --2- 172.21.15.135:0/1641735156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12700c81d0 0x7f12700c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126f59e700 1 -- 172.21.15.135:0/1641735156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12700c81d0 msgr2=0x7f12700c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126f59e700 1 --2- 172.21.15.135:0/1641735156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12700c81d0 0x7f12700c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126f59e700 1 -- 172.21.15.135:0/1641735156 >> v1:172.21.15.135:6789/0 conn(0x7f12700c3cd0 legacy=0x7f1270156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126dd9b700 1 -- 172.21.15.135:0/1641735156 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671119526 0 0) 0x7f12700c3840 con 0x7f12700c3cd0 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126f59e700 1 -- 172.21.15.135:0/1641735156 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700c3230 con 0x7f127013b180 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126ed9d700 1 --2- 172.21.15.135:0/1641735156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12700c81d0 0x7f12700c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:20.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126f59e700 1 --2- 172.21.15.135:0/1641735156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127013b180 0x7f127006fa50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1268009d90 tx=0x7f126800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2a555c39ee7283 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126dd9b700 1 -- 172.21.15.135:0/1641735156 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126800e070 con 0x7f127013b180 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126dd9b700 1 -- 172.21.15.135:0/1641735156 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126800bbd0 con 0x7f127013b180 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.138+0000 7f126dd9b700 1 -- 172.21.15.135:0/1641735156 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268012430 con 0x7f127013b180 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 -- 172.21.15.135:0/1641735156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127013b180 msgr2=0x7f127006fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 --2- 172.21.15.135:0/1641735156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127013b180 0x7f127006fa50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1268009d90 tx=0x7f126800b330 comp rx=0 tx=0).stop 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 -- 172.21.15.135:0/1641735156 shutdown_connections 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 --2- 172.21.15.135:0/1641735156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12700c81d0 0x7f12700c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 --2- 172.21.15.135:0/1641735156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127013b180 0x7f127006fa50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 -- 172.21.15.135:0/1641735156 >> 172.21.15.135:0/1641735156 conn(0x7f1270072600 msgr2=0x7f127006db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 -- 172.21.15.135:0/1641735156 shutdown_connections 2024-05-08T21:21:20.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.139+0000 7f1275247700 1 -- 172.21.15.135:0/1641735156 wait complete. 2024-05-08T21:21:20.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.140+0000 7f1275247700 1 Processor -- start 2024-05-08T21:21:20.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.140+0000 7f1275247700 1 -- start start 2024-05-08T21:21:20.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f1275247700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12700c3cd0 0x7f12701531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f1275247700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12700c81d0 0x7f1270151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f1275247700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127013b180 0x7f1270152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f1275247700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12701ecac0 con 0x7f12700c81d0 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f1275247700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1270151640 con 0x7f12700c3cd0 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f1275247700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1270150a30 con 0x7f127013b180 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f126e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12700c81d0 0x7f1270151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f126e59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12700c81d0 0x7f1270151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47794/0 (socket says 172.21.15.135:47794) 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f126e59c700 1 -- 172.21.15.135:0/3667569730 learned_addr learned my addr 172.21.15.135:0/3667569730 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f126ed9d700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12700c3cd0 0x7f12701531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.141+0000 7f126f59e700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127013b180 0x7f1270152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f126e59c700 1 -- 172.21.15.135:0/3667569730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127013b180 msgr2=0x7f1270152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f126e59c700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127013b180 0x7f1270152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f126e59c700 1 -- 172.21.15.135:0/3667569730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12700c3cd0 msgr2=0x7f12701531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f126e59c700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12700c3cd0 0x7f12701531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f126e59c700 1 -- 172.21.15.135:0/3667569730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1268009a70 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f126e59c700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12700c81d0 0x7f1270151ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f126400c520 tx=0x7f126400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264004c80 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264004de0 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1270150d10 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640072d0 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.142+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12701512d0 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.143+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1270153e10 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.143+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1264007430 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f12577fe700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06acc0 0x7f125c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1264089a00 con 0x7f12700c81d0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f126ed9d700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06acc0 0x7f125c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f12577fe700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f125c0745a0 0x7f125c076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 --> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f125c077110 con 0x7f125c0745a0 2024-05-08T21:21:20.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1264089e50 con 0x7f12700c81d0 2024-05-08T21:21:20.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f126f59e700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f125c0745a0 0x7f125c076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f126ed9d700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06acc0 0x7f125c06d180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1260006fd0 tx=0x7f1260008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.144+0000 7f126f59e700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f125c0745a0 0x7f125c076a40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.145+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== osd.0 v2:172.21.15.135:6824/47109 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f125c077110 con 0x7f125c0745a0 2024-05-08T21:21:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 --> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12700c34d0 con 0x7f125c0745a0 2024-05-08T21:21:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f12577fe700 1 -- 172.21.15.135:0/3667569730 <== osd.0 v2:172.21.15.135:6824/47109 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1268003c40 con 0x7f125c0745a0 2024-05-08T21:21:20.163 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:20.164 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:20.164 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f125c0745a0 msgr2=0x7f125c076a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f1275247700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6824/47109,v1:172.21.15.135:6825/47109] conn(0x7f125c0745a0 0x7f125c076a40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06acc0 msgr2=0x7f125c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f1275247700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06acc0 0x7f125c06d180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1260006fd0 tx=0x7f1260008040 comp rx=0 tx=0).stop 2024-05-08T21:21:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12700c81d0 msgr2=0x7f1270151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.161+0000 7f1275247700 1 --2- 172.21.15.135:0/3667569730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12700c81d0 0x7f1270151ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f126400c520 tx=0x7f126400c830 comp rx=0 tx=0).stop 2024-05-08T21:21:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.162+0000 7f126f59e700 1 -- 172.21.15.135:0/3667569730 reap_dead start 2024-05-08T21:21:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.162+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 shutdown_connections 2024-05-08T21:21:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.162+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 >> 172.21.15.135:0/3667569730 conn(0x7f1270072600 msgr2=0x7f127006db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.162+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 shutdown_connections 2024-05-08T21:21:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.162+0000 7f1275247700 1 -- 172.21.15.135:0/3667569730 wait complete. 2024-05-08T21:21:20.176 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T21:21:20.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.298+0000 7f586d4d2700 1 Processor -- start 2024-05-08T21:21:20.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.298+0000 7f586d4d2700 1 -- start start 2024-05-08T21:21:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f586d4d2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 0x7f586806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f586d4d2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f58680ca0e0 0x7f58680c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f586d4d2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5868159590 con 0x7f58680c9b50 2024-05-08T21:21:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f586d4d2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586806c350 con 0x7f58680ca0e0 2024-05-08T21:21:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f586d4d2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5868159850 con 0x7f58680ce380 2024-05-08T21:21:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f58677fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f58680c9b50 0x7f58680cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45230/0 (socket says 172.21.15.135:45230) 2024-05-08T21:21:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f58677fe700 1 -- 172.21.15.135:0/1368019042 learned_addr learned my addr 172.21.15.135:0/1368019042 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f5866ffd700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 0x7f586806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450390332 0 0) 0x7f5868159590 con 0x7f58680c9b50 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f58667fc700 1 --2- 172.21.15.135:0/1368019042 >> v2:172.21.15.183:3300/0 conn(0x7f58680ca0e0 0x7f58680c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.299+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58500035b0 con 0x7f58680c9b50 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3875611049 0 0) 0x7f58500035b0 con 0x7f58680c9b50 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 msgr2=0x7f586806baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 0x7f586806baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 >> v2:172.21.15.183:3300/0 conn(0x7f58680ca0e0 msgr2=0x7f58680c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 --2- 172.21.15.135:0/1368019042 >> v2:172.21.15.183:3300/0 conn(0x7f58680ca0e0 0x7f58680c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868159b30 con 0x7f58680c9b50 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f58600019f0 con 0x7f58680c9b50 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 >> v1:172.21.15.135:6789/0 conn(0x7f58680c9b50 legacy=0x7f58680cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5850003a00 0x7f5850003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 0x7f5850004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5850004d90 0x7f5850005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586806c350 con 0x7f5850004d90 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868159850 con 0x7f5850003a00 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585000ba10 con 0x7f58680ce380 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58677fe700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5850004d90 0x7f5850005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58667fc700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 0x7f5850004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5866ffd700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5850003a00 0x7f5850003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58677fe700 1 -- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 msgr2=0x7f5850004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58677fe700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680ce380 0x7f5850004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58677fe700 1 -- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5850003a00 msgr2=0x7f5850003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58677fe700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5850003a00 0x7f5850003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58677fe700 1 -- 172.21.15.135:0/1368019042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500035b0 con 0x7f5850004d90 2024-05-08T21:21:20.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f58677fe700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5850004d90 0x7f5850005210 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f586000a860 tx=0x7f5850005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8fc3d79cc8919a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012600 con 0x7f5850004d90 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860012780 con 0x7f5850004d90 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.300+0000 7f5865ffb700 1 -- 172.21.15.135:0/1368019042 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012b30 con 0x7f5850004d90 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.301+0000 7f586d4d2700 1 -- 172.21.15.135:0/1368019042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5850004d90 msgr2=0x7f5850005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.301+0000 7f586d4d2700 1 --2- 172.21.15.135:0/1368019042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5850004d90 0x7f5850005210 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f586000a860 tx=0x7f5850005880 comp rx=0 tx=0).stop 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.301+0000 7f58677fe700 1 -- 172.21.15.135:0/1368019042 reap_dead start 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.301+0000 7f586d4d2700 1 -- 172.21.15.135:0/1368019042 shutdown_connections 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.301+0000 7f586d4d2700 1 -- 172.21.15.135:0/1368019042 >> 172.21.15.135:0/1368019042 conn(0x7f58680cec90 msgr2=0x7f58680cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.301+0000 7f586d4d2700 1 -- 172.21.15.135:0/1368019042 shutdown_connections 2024-05-08T21:21:20.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.301+0000 7f586d4d2700 1 -- 172.21.15.135:0/1368019042 wait complete. 2024-05-08T21:21:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.303+0000 7f586d4d2700 1 Processor -- start 2024-05-08T21:21:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.303+0000 7f586d4d2700 1 -- start start 2024-05-08T21:21:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680b2ad0 0x7f5868151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58680b2eb0 0x7f586814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5868151ba0 0x7f58680afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680af750 con 0x7f5868151ba0 2024-05-08T21:21:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680b14b0 con 0x7f58680b2eb0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5868151890 con 0x7f58680b2ad0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5868151ba0 0x7f58680afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5868151ba0 0x7f58680afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47812/0 (socket says 172.21.15.135:47812) 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 -- 172.21.15.135:0/1428658298 learned_addr learned my addr 172.21.15.135:0/1428658298 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f5866ffd700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680b2ad0 0x7f5868151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58667fc700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58680b2eb0 0x7f586814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 -- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680b2ad0 msgr2=0x7f5868151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680b2ad0 0x7f5868151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 -- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58680b2eb0 msgr2=0x7f586814fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58680b2eb0 0x7f586814fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 -- 172.21.15.135:0/1428658298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868150560 con 0x7f5868151ba0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f58677fe700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5868151ba0 0x7f58680afbe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5860001cb0 tx=0x7f5860001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f584f7fe700 1 -- 172.21.15.135:0/1428658298 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860026660 con 0x7f5868151ba0 2024-05-08T21:21:20.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f584f7fe700 1 -- 172.21.15.135:0/1428658298 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58600267e0 con 0x7f5868151ba0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f584f7fe700 1 -- 172.21.15.135:0/1428658298 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860026b90 con 0x7f5868151ba0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5868150840 con 0x7f5868151ba0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.304+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58680af100 con 0x7f5868151ba0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.305+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586806b830 con 0x7f5868151ba0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.306+0000 7f584f7fe700 1 -- 172.21.15.135:0/1428658298 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5860019070 con 0x7f5868151ba0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.306+0000 7f584f7fe700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f585406ac90 0x7f585406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.306+0000 7f584f7fe700 1 -- 172.21.15.135:0/1428658298 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f586008ad40 con 0x7f5868151ba0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.306+0000 7f5866ffd700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f585406ac90 0x7f585406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.307+0000 7f5866ffd700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f585406ac90 0x7f585406d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f585c009be0 tx=0x7f585c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.311+0000 7f584f7fe700 1 -- 172.21.15.135:0/1428658298 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5860055cb0 con 0x7f5868151ba0 2024-05-08T21:21:20.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.513+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f586815a0f0 con 0x7f585406ac90 2024-05-08T21:21:20.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.514+0000 7f584f7fe700 1 -- 172.21.15.135:0/1428658298 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f585c019070 con 0x7f585406ac90 2024-05-08T21:21:20.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f585406ac90 msgr2=0x7f585406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f585406ac90 0x7f585406d150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f585c009be0 tx=0x7f585c009210 comp rx=0 tx=0).stop 2024-05-08T21:21:20.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5868151ba0 msgr2=0x7f58680afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5868151ba0 0x7f58680afbe0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5860001cb0 tx=0x7f5860001d80 comp rx=0 tx=0).stop 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 shutdown_connections 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f585406ac90 0x7f585406d150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5868151ba0 0x7f58680afbe0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58680b2ad0 0x7f5868151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 --2- 172.21.15.135:0/1428658298 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58680b2eb0 0x7f586814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 >> 172.21.15.135:0/1428658298 conn(0x7f58680cec90 msgr2=0x7f58680cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 shutdown_connections 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.516+0000 7f586d4d2700 1 -- 172.21.15.135:0/1428658298 wait complete. 2024-05-08T21:21:20.519 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T21:21:20.531 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T21:21:20.531 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.653+0000 7f157f145700 1 Processor -- start 2024-05-08T21:21:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.653+0000 7f157f145700 1 -- start start 2024-05-08T21:21:20.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f157f145700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15780cbf50 0x7f15780c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f157f145700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157815c990 con 0x7f1578072ae0 2024-05-08T21:21:20.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f157f145700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157815cbc0 con 0x7f15781535a0 2024-05-08T21:21:20.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f157f145700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157815ce60 con 0x7f15780cbf50 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f1577fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f15780cbf50 0x7f15780c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f157d6e2700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1578072ae0 0x7f1578163c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45238/0 (socket says 172.21.15.135:45238) 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f157d6e2700 1 -- 172.21.15.135:0/2412076634 learned_addr learned my addr 172.21.15.135:0/2412076634 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f1577fff700 1 -- 172.21.15.135:0/2412076634 >> v1:172.21.15.183:6789/0 conn(0x7f15781535a0 legacy=0x7f157806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f1577fff700 1 -- 172.21.15.135:0/2412076634 >> v1:172.21.15.135:6789/0 conn(0x7f1578072ae0 legacy=0x7f1578163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f15777fe700 1 -- 172.21.15.135:0/2412076634 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157815322 0 0) 0x7f157815c990 con 0x7f1578072ae0 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f1577fff700 1 -- 172.21.15.135:0/2412076634 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157815d140 con 0x7f15780cbf50 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f1577fff700 1 --2- 172.21.15.135:0/2412076634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15780c40b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1564009840 tx=0x7f1564009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1480add5c627188b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.654+0000 7f15777fe700 1 -- 172.21.15.135:0/2412076634 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564004230 con 0x7f15780cbf50 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f15777fe700 1 -- 172.21.15.135:0/2412076634 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564004390 con 0x7f15780cbf50 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f15777fe700 1 -- 172.21.15.135:0/2412076634 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640036a0 con 0x7f15780cbf50 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f157f145700 1 -- 172.21.15.135:0/2412076634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 msgr2=0x7f15780c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f157f145700 1 --2- 172.21.15.135:0/2412076634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15780c40b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1564009840 tx=0x7f1564009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f157f145700 1 -- 172.21.15.135:0/2412076634 shutdown_connections 2024-05-08T21:21:20.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f157f145700 1 --2- 172.21.15.135:0/2412076634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15780c40b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f157f145700 1 -- 172.21.15.135:0/2412076634 >> 172.21.15.135:0/2412076634 conn(0x7f157806daf0 msgr2=0x7f157806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:20.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f157f145700 1 -- 172.21.15.135:0/2412076634 shutdown_connections 2024-05-08T21:21:20.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.655+0000 7f157f145700 1 -- 172.21.15.135:0/2412076634 wait complete. 2024-05-08T21:21:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.656+0000 7f157f145700 1 Processor -- start 2024-05-08T21:21:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.656+0000 7f157f145700 1 -- start start 2024-05-08T21:21:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157f145700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1578072ae0 0x7f15780c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157f145700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15781e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157f145700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15781535a0 0x7f15781e4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157f145700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15781e5080 con 0x7f15780cbf50 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157f145700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15781e3a50 con 0x7f15781535a0 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157f145700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15781e28d0 con 0x7f1578072ae0 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f1577fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15781e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f1577fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15781e3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47822/0 (socket says 172.21.15.135:47822) 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f1577fff700 1 -- 172.21.15.135:0/3991316135 learned_addr learned my addr 172.21.15.135:0/3991316135 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157d6e2700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15781535a0 0x7f15781e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.657+0000 7f157cee1700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1578072ae0 0x7f15780c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f1577fff700 1 -- 172.21.15.135:0/3991316135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1578072ae0 msgr2=0x7f15780c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f1577fff700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1578072ae0 0x7f15780c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f1577fff700 1 -- 172.21.15.135:0/3991316135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15781535a0 msgr2=0x7f15781e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f1577fff700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15781535a0 0x7f15781e4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f1577fff700 1 -- 172.21.15.135:0/3991316135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640094a0 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f157cee1700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1578072ae0 0x7f15780c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f1577fff700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15781e3ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f15640090b0 tx=0x7f1564004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564011630 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156401e070 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15781ef490 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15640119b0 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.658+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15781e3400 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.659+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15780c2550 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.659+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1564011b10 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f15757fa700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f155c06ac90 0x7f155c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f156408b4a0 con 0x7f15780cbf50 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f157cee1700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f155c06ac90 0x7f155c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f15757fa700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7f155c074570 0x7f155c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 --> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f155c0770e0 con 0x7f155c074570 2024-05-08T21:21:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f156408b8f0 con 0x7f15780cbf50 2024-05-08T21:21:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f157d6e2700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7f155c074570 0x7f155c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f157cee1700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f155c06ac90 0x7f155c06d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f156c009930 tx=0x7f156c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.660+0000 7f157d6e2700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7f155c074570 0x7f155c076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.661+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== osd.1 v2:172.21.15.135:6808/47107 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f155c0770e0 con 0x7f155c074570 2024-05-08T21:21:20.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.675+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 --> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1578153980 con 0x7f155c074570 2024-05-08T21:21:20.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f15757fa700 1 -- 172.21.15.135:0/3991316135 <== osd.1 v2:172.21.15.135:6808/47107 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1570007260 con 0x7f155c074570 2024-05-08T21:21:20.678 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:20.678 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:20.678 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:20.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7f155c074570 msgr2=0x7f155c076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6808/47107,v1:172.21.15.135:6809/47107] conn(0x7f155c074570 0x7f155c076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f155c06ac90 msgr2=0x7f155c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f155c06ac90 0x7f155c06d150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f156c009930 tx=0x7f156c008040 comp rx=0 tx=0).stop 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 msgr2=0x7f15781e3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 --2- 172.21.15.135:0/3991316135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15780cbf50 0x7f15781e3ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f15640090b0 tx=0x7f1564004750 comp rx=0 tx=0).stop 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157d6e2700 1 -- 172.21.15.135:0/3991316135 reap_dead start 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 shutdown_connections 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 >> 172.21.15.135:0/3991316135 conn(0x7f157806daf0 msgr2=0x7f15780c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 shutdown_connections 2024-05-08T21:21:20.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.676+0000 7f157f145700 1 -- 172.21.15.135:0/3991316135 wait complete. 2024-05-08T21:21:20.690 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T21:21:20.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.810+0000 7f50d9167700 1 Processor -- start 2024-05-08T21:21:20.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.810+0000 7f50d9167700 1 -- start start 2024-05-08T21:21:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.810+0000 7f50d9167700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50d40c8980 0x7f50d40c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.810+0000 7f50d9167700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d40cca80 0x7f50d40ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.810+0000 7f50d9167700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40c8780 con 0x7f50d41514b0 2024-05-08T21:21:20.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.810+0000 7f50d9167700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d41571e0 con 0x7f50d40c8980 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.810+0000 7f50d9167700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d415ac10 con 0x7f50d40cca80 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d2d9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f50d41514b0 0x7f50d4157910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45248/0 (socket says 172.21.15.135:45248) 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d2d9d700 1 -- 172.21.15.135:0/1748415053 learned_addr learned my addr 172.21.15.135:0/1748415053 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d259c700 1 --2- 172.21.15.135:0/1748415053 >> v2:172.21.15.183:3300/0 conn(0x7f50d40c8980 0x7f50d40c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d359e700 1 --2- 172.21.15.135:0/1748415053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d40cca80 0x7f50d40ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d1d9b700 1 -- 172.21.15.135:0/1748415053 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456268490 0 0) 0x7f50d40c8780 con 0x7f50d41514b0 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d1d9b700 1 -- 172.21.15.135:0/1748415053 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50bc0035b0 con 0x7f50d41514b0 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d359e700 1 -- 172.21.15.135:0/1748415053 >> v2:172.21.15.183:3300/0 conn(0x7f50d40c8980 msgr2=0x7f50d40c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d359e700 1 --2- 172.21.15.135:0/1748415053 >> v2:172.21.15.183:3300/0 conn(0x7f50d40c8980 0x7f50d40c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d359e700 1 -- 172.21.15.135:0/1748415053 >> v1:172.21.15.135:6789/0 conn(0x7f50d41514b0 legacy=0x7f50d4157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d359e700 1 -- 172.21.15.135:0/1748415053 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d415b790 con 0x7f50d40cca80 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d259c700 1 --2- 172.21.15.135:0/1748415053 >> v2:172.21.15.183:3300/0 conn(0x7f50d40c8980 0x7f50d40c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d359e700 1 --2- 172.21.15.135:0/1748415053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d40cca80 0x7f50d40ccf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009d90 tx=0x7f50cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf59e9b77299dab9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d1d9b700 1 -- 172.21.15.135:0/1748415053 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc00e070 con 0x7f50d40cca80 2024-05-08T21:21:20.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d1d9b700 1 -- 172.21.15.135:0/1748415053 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc00bb20 con 0x7f50d40cca80 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.811+0000 7f50d1d9b700 1 -- 172.21.15.135:0/1748415053 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc00be90 con 0x7f50d40cca80 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 -- 172.21.15.135:0/1748415053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d40cca80 msgr2=0x7f50d40ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 --2- 172.21.15.135:0/1748415053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d40cca80 0x7f50d40ccf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009d90 tx=0x7f50cc00b330 comp rx=0 tx=0).stop 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 -- 172.21.15.135:0/1748415053 shutdown_connections 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 --2- 172.21.15.135:0/1748415053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d40cca80 0x7f50d40ccf10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 --2- 172.21.15.135:0/1748415053 >> v2:172.21.15.183:3300/0 conn(0x7f50d40c8980 0x7f50d40c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 -- 172.21.15.135:0/1748415053 >> 172.21.15.135:0/1748415053 conn(0x7f50d406a960 msgr2=0x7f50d406ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 -- 172.21.15.135:0/1748415053 shutdown_connections 2024-05-08T21:21:20.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.812+0000 7f50d9167700 1 -- 172.21.15.135:0/1748415053 wait complete. 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.813+0000 7f50d9167700 1 Processor -- start 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.813+0000 7f50d9167700 1 -- start start 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d9167700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50d40c8980 0x7f50d4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d9167700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d40cca80 0x7f50d415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d9167700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d41514b0 0x7f50d40cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d9167700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4159600 con 0x7f50d40c8980 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d9167700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41eddb0 con 0x7f50d40cca80 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d9167700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40c3f10 con 0x7f50d41514b0 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50d40c8980 0x7f50d4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50d40c8980 0x7f50d4152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47832/0 (socket says 172.21.15.135:47832) 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d2d9d700 1 -- 172.21.15.135:0/1925558136 learned_addr learned my addr 172.21.15.135:0/1925558136 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d359e700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d41514b0 0x7f50d40cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.814+0000 7f50d259c700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d40cca80 0x7f50d415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d2d9d700 1 -- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d41514b0 msgr2=0x7f50d40cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d2d9d700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d41514b0 0x7f50d40cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d2d9d700 1 -- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d40cca80 msgr2=0x7f50d415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d2d9d700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d40cca80 0x7f50d415a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d2d9d700 1 -- 172.21.15.135:0/1925558136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80094a0 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d2d9d700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50d40c8980 0x7f50d4152970 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c420 tx=0x7f50c400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50bb7fe700 1 -- 172.21.15.135:0/1925558136 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4005d70 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50bb7fe700 1 -- 172.21.15.135:0/1925558136 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c400ce30 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc009a70 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50bb7fe700 1 -- 172.21.15.135:0/1925558136 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c40072d0 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.815+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d4159850 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.816+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d4067fa0 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.816+0000 7f50bb7fe700 1 -- 172.21.15.135:0/1925558136 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50c4007430 con 0x7f50d40c8980 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.817+0000 7f50bb7fe700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f50c006ac90 0x7f50c006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:20.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.817+0000 7f50bb7fe700 1 -- 172.21.15.135:0/1925558136 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50c4088860 con 0x7f50d40c8980 2024-05-08T21:21:20.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.817+0000 7f50d259c700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f50c006ac90 0x7f50c006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:20.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.817+0000 7f50d259c700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f50c006ac90 0x7f50c006d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50d40c6e70 tx=0x7f50c8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:20.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:20.821+0000 7f50bb7fe700 1 -- 172.21.15.135:0/1925558136 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f50c40537c0 con 0x7f50d40c8980 2024-05-08T21:21:21.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.018+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f50d415b4b0 con 0x7f50c006ac90 2024-05-08T21:21:21.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.019+0000 7f50bb7fe700 1 -- 172.21.15.135:0/1925558136 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f50c8011b10 con 0x7f50c006ac90 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f50c006ac90 msgr2=0x7f50c006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f50c006ac90 0x7f50c006d150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50d40c6e70 tx=0x7f50c8009210 comp rx=0 tx=0).stop 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50d40c8980 msgr2=0x7f50d4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50d40c8980 0x7f50d4152970 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c420 tx=0x7f50c400c730 comp rx=0 tx=0).stop 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 shutdown_connections 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f50c006ac90 0x7f50c006d150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d41514b0 0x7f50d40cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50d40c8980 0x7f50d4152970 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 --2- 172.21.15.135:0/1925558136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d40cca80 0x7f50d415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 >> 172.21.15.135:0/1925558136 conn(0x7f50d406a960 msgr2=0x7f50d4155650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 shutdown_connections 2024-05-08T21:21:21.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.021+0000 7f50d9167700 1 -- 172.21.15.135:0/1925558136 wait complete. 2024-05-08T21:21:21.025 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T21:21:21.036 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T21:21:21.036 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:21.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.159+0000 7feed9b40700 1 Processor -- start 2024-05-08T21:21:21.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.159+0000 7feed9b40700 1 -- start start 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed9b40700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feed41536d0 0x7feed4159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed9b40700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 0x7feed40c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed9b40700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feed415d2e0 0x7feed406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed9b40700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed4153ab0 con 0x7feed41536d0 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed9b40700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed40cc8c0 con 0x7feed415d2e0 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed9b40700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed40cc380 con 0x7feed4072b50 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feed41536d0 0x7feed4159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed37fe700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7feed41536d0 0x7feed4159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47836/0 (socket says 172.21.15.135:47836) 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.160+0000 7feed37fe700 1 -- 172.21.15.135:0/1832535881 learned_addr learned my addr 172.21.15.135:0/1832535881 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed3fff700 1 --2- 172.21.15.135:0/1832535881 >> v2:172.21.15.183:3300/0 conn(0x7feed415d2e0 0x7feed406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed2ffd700 1 --2- 172.21.15.135:0/1832535881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 0x7feed40c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed37fe700 1 -- 172.21.15.135:0/1832535881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 msgr2=0x7feed40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed37fe700 1 --2- 172.21.15.135:0/1832535881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 0x7feed40c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed37fe700 1 -- 172.21.15.135:0/1832535881 >> v2:172.21.15.183:3300/0 conn(0x7feed415d2e0 msgr2=0x7feed406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed37fe700 1 --2- 172.21.15.135:0/1832535881 >> v2:172.21.15.183:3300/0 conn(0x7feed415d2e0 0x7feed406a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed37fe700 1 -- 172.21.15.135:0/1832535881 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed40cc620 con 0x7feed41536d0 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed3fff700 1 --2- 172.21.15.135:0/1832535881 >> v2:172.21.15.183:3300/0 conn(0x7feed415d2e0 0x7feed406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed37fe700 1 --2- 172.21.15.135:0/1832535881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4159f90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feed406f020 tx=0x7feec8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed5799f86f31e11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed27fc700 1 -- 172.21.15.135:0/1832535881 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec800b870 con 0x7feed41536d0 2024-05-08T21:21:21.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed27fc700 1 -- 172.21.15.135:0/1832535881 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec800b9d0 con 0x7feed41536d0 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed27fc700 1 -- 172.21.15.135:0/1832535881 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec800bd60 con 0x7feed41536d0 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed9b40700 1 -- 172.21.15.135:0/1832535881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 msgr2=0x7feed4159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed9b40700 1 --2- 172.21.15.135:0/1832535881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4159f90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feed406f020 tx=0x7feec8009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed9b40700 1 -- 172.21.15.135:0/1832535881 shutdown_connections 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed9b40700 1 --2- 172.21.15.135:0/1832535881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4159f90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed9b40700 1 --2- 172.21.15.135:0/1832535881 >> v2:172.21.15.183:3300/0 conn(0x7feed415d2e0 0x7feed406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.161+0000 7feed9b40700 1 --2- 172.21.15.135:0/1832535881 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 0x7feed40c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.162+0000 7feed9b40700 1 -- 172.21.15.135:0/1832535881 >> 172.21.15.135:0/1832535881 conn(0x7feed406daf0 msgr2=0x7feed406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.162+0000 7feed9b40700 1 -- 172.21.15.135:0/1832535881 shutdown_connections 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.162+0000 7feed9b40700 1 -- 172.21.15.135:0/1832535881 wait complete. 2024-05-08T21:21:21.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.163+0000 7feed9b40700 1 Processor -- start 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.163+0000 7feed9b40700 1 -- start start 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed9b40700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 0x7feed415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed9b40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed9b40700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed415d2e0 0x7feed414bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed9b40700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed415ab20 con 0x7feed41536d0 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed9b40700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed415a4f0 con 0x7feed415d2e0 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed9b40700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed41f0040 con 0x7feed4072b50 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47842/0 (socket says 172.21.15.135:47842) 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 -- 172.21.15.135:0/517352113 learned_addr learned my addr 172.21.15.135:0/517352113 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed37fe700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 0x7feed415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed3fff700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed415d2e0 0x7feed414bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 -- 172.21.15.135:0/517352113 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 msgr2=0x7feed415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feed4072b50 0x7feed415af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 -- 172.21.15.135:0/517352113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed415d2e0 msgr2=0x7feed414bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feed415d2e0 0x7feed414bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 -- 172.21.15.135:0/517352113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8009550 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed2ffd700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4151f00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feec400c7f0 tx=0x7feec400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4004220 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec4004380 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40036a0 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.164+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed4153d50 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.165+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed415a740 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.165+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feed415a350 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.166+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feec4003800 con 0x7feed41536d0 2024-05-08T21:21:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.166+0000 7feebbfff700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feec006ac90 0x7feec006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.166+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feec4089710 con 0x7feed41536d0 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.166+0000 7feed37fe700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feec006ac90 0x7feec006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.166+0000 7feebbfff700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7feec0074570 0x7feec0076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.166+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 --> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feec00770e0 con 0x7feec0074570 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.166+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec4089b60 con 0x7feed41536d0 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.167+0000 7feed3fff700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7feec0074570 0x7feec0076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.167+0000 7feed37fe700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feec006ac90 0x7feec006d150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feec8000c00 tx=0x7feec8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.167+0000 7feed3fff700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7feec0074570 0x7feec0076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.168+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== osd.2 v2:172.21.15.135:6813/47110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7feec00770e0 con 0x7feec0074570 2024-05-08T21:21:21.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.182+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 --> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feed4159a70 con 0x7feec0074570 2024-05-08T21:21:21.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.182+0000 7feebbfff700 1 -- 172.21.15.135:0/517352113 <== osd.2 v2:172.21.15.135:6813/47110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feecc00f450 con 0x7feec0074570 2024-05-08T21:21:21.185 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:21.185 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:21.185 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7feec0074570 msgr2=0x7feec0076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6813/47110,v1:172.21.15.135:6815/47110] conn(0x7feec0074570 0x7feec0076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feec006ac90 msgr2=0x7feec006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7feec006ac90 0x7feec006d150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feec8000c00 tx=0x7feec8008030 comp rx=0 tx=0).stop 2024-05-08T21:21:21.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 msgr2=0x7feed4151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 --2- 172.21.15.135:0/517352113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feed41536d0 0x7feed4151f00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feec400c7f0 tx=0x7feec400cb00 comp rx=0 tx=0).stop 2024-05-08T21:21:21.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed3fff700 1 -- 172.21.15.135:0/517352113 reap_dead start 2024-05-08T21:21:21.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 shutdown_connections 2024-05-08T21:21:21.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 >> 172.21.15.135:0/517352113 conn(0x7feed406daf0 msgr2=0x7feed40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 shutdown_connections 2024-05-08T21:21:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.183+0000 7feed9b40700 1 -- 172.21.15.135:0/517352113 wait complete. 2024-05-08T21:21:21.197 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T21:21:21.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.317+0000 7f1ca5e50700 1 Processor -- start 2024-05-08T21:21:21.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.317+0000 7f1ca5e50700 1 -- start start 2024-05-08T21:21:21.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1ca5e50700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca006bf30 0x7f1ca01611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1ca5e50700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00c2b20 con 0x7f1ca014fcd0 2024-05-08T21:21:21.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1ca5e50700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00c5d30 con 0x7f1ca00c43c0 2024-05-08T21:21:21.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1ca5e50700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00c65d0 con 0x7f1ca006bf30 2024-05-08T21:21:21.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1c9f7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f1ca014fcd0 0x7f1ca006b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:45256/0 (socket says 172.21.15.135:45256) 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1c9f7fe700 1 -- 172.21.15.135:0/604149213 learned_addr learned my addr 172.21.15.135:0/604149213 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1c9ffff700 1 --2- 172.21.15.135:0/604149213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca006bf30 0x7f1ca01611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1c9e7fc700 1 -- 172.21.15.135:0/604149213 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560084976 0 0) 0x7f1ca00c2b20 con 0x7f1ca014fcd0 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.318+0000 7f1c9e7fc700 1 -- 172.21.15.135:0/604149213 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c8c0035b0 con 0x7f1ca014fcd0 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9e7fc700 1 -- 172.21.15.135:0/604149213 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829294726 0 0) 0x7f1ca00c5d30 con 0x7f1ca00c43c0 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9e7fc700 1 -- 172.21.15.135:0/604149213 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca00c2b20 con 0x7f1ca00c43c0 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9ffff700 1 -- 172.21.15.135:0/604149213 >> v1:172.21.15.183:6789/0 conn(0x7f1ca00c43c0 legacy=0x7f1ca00cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9ffff700 1 -- 172.21.15.135:0/604149213 >> v1:172.21.15.135:6789/0 conn(0x7f1ca014fcd0 legacy=0x7f1ca006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9ffff700 1 -- 172.21.15.135:0/604149213 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00c6010 con 0x7f1ca006bf30 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9ffff700 1 --2- 172.21.15.135:0/604149213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca006bf30 0x7f1ca01611c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800aed0 tx=0x7f1c9800c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e996608b78f2f2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9e7fc700 1 -- 172.21.15.135:0/604149213 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800f070 con 0x7f1ca006bf30 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9e7fc700 1 -- 172.21.15.135:0/604149213 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9800a2e0 con 0x7f1ca006bf30 2024-05-08T21:21:21.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.319+0000 7f1c9e7fc700 1 -- 172.21.15.135:0/604149213 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800cbd0 con 0x7f1ca006bf30 2024-05-08T21:21:21.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.320+0000 7f1ca5e50700 1 -- 172.21.15.135:0/604149213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca006bf30 msgr2=0x7f1ca01611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.320+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/604149213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca006bf30 0x7f1ca01611c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800aed0 tx=0x7f1c9800c330 comp rx=0 tx=0).stop 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.320+0000 7f1ca5e50700 1 -- 172.21.15.135:0/604149213 shutdown_connections 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.320+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/604149213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca006bf30 0x7f1ca01611c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.320+0000 7f1ca5e50700 1 -- 172.21.15.135:0/604149213 >> 172.21.15.135:0/604149213 conn(0x7f1ca006d3e0 msgr2=0x7f1ca006d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.320+0000 7f1ca5e50700 1 -- 172.21.15.135:0/604149213 shutdown_connections 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.320+0000 7f1ca5e50700 1 -- 172.21.15.135:0/604149213 wait complete. 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.321+0000 7f1ca5e50700 1 Processor -- start 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.321+0000 7f1ca5e50700 1 -- start start 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca006bf30 0x7f1ca0147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca00c43c0 0x7f1ca01f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca014fcd0 0x7f1ca01384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00c8550 con 0x7f1ca014fcd0 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0149300 con 0x7f1ca006bf30 2024-05-08T21:21:21.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca01495e0 con 0x7f1ca00c43c0 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca014fcd0 0x7f1ca01384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca014fcd0 0x7f1ca01384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47858/0 (socket says 172.21.15.135:47858) 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 -- 172.21.15.135:0/352759079 learned_addr learned my addr 172.21.15.135:0/352759079 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9f7fe700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca006bf30 0x7f1ca0147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9effd700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca00c43c0 0x7f1ca01f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 -- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca00c43c0 msgr2=0x7f1ca01f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca00c43c0 0x7f1ca01f0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 -- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca006bf30 msgr2=0x7f1ca0147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca006bf30 0x7f1ca0147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 -- 172.21.15.135:0/352759079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9800ab80 con 0x7f1ca014fcd0 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9effd700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca00c43c0 0x7f1ca01f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c9ffff700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca014fcd0 0x7f1ca01384c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800af80 tx=0x7f1c98004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c97fff700 1 -- 172.21.15.135:0/352759079 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98008d70 con 0x7f1ca014fcd0 2024-05-08T21:21:21.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c97fff700 1 -- 172.21.15.135:0/352759079 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9800aa00 con 0x7f1ca014fcd0 2024-05-08T21:21:21.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca01498c0 con 0x7f1ca014fcd0 2024-05-08T21:21:21.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1c97fff700 1 -- 172.21.15.135:0/352759079 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98003c40 con 0x7f1ca014fcd0 2024-05-08T21:21:21.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.322+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca01f0790 con 0x7f1ca014fcd0 2024-05-08T21:21:21.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.323+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca01f0310 con 0x7f1ca014fcd0 2024-05-08T21:21:21.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.324+0000 7f1c97fff700 1 -- 172.21.15.135:0/352759079 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1c98004030 con 0x7f1ca014fcd0 2024-05-08T21:21:21.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.324+0000 7f1c97fff700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1c8006ac90 0x7f1c8006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.324+0000 7f1c97fff700 1 -- 172.21.15.135:0/352759079 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c9808ab60 con 0x7f1ca014fcd0 2024-05-08T21:21:21.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.324+0000 7f1c9f7fe700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1c8006ac90 0x7f1c8006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.325+0000 7f1c9f7fe700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1c8006ac90 0x7f1c8006d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1c90001000 tx=0x7f1c90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.329+0000 7f1c97fff700 1 -- 172.21.15.135:0/352759079 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1ca01f0310 con 0x7f1ca014fcd0 2024-05-08T21:21:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.527+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ca00c2e00 con 0x7f1c8006ac90 2024-05-08T21:21:21.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.527+0000 7f1c97fff700 1 -- 172.21.15.135:0/352759079 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c9000f690 con 0x7f1c8006ac90 2024-05-08T21:21:21.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1c8006ac90 msgr2=0x7f1c8006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1c8006ac90 0x7f1c8006d150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1c90001000 tx=0x7f1c90009040 comp rx=0 tx=0).stop 2024-05-08T21:21:21.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca014fcd0 msgr2=0x7f1ca01384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca014fcd0 0x7f1ca01384c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1c9800af80 tx=0x7f1c98004ad0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 shutdown_connections 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f1c8006ac90 0x7f1c8006d150 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ca006bf30 0x7f1ca0147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ca014fcd0 0x7f1ca01384c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 --2- 172.21.15.135:0/352759079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ca00c43c0 0x7f1ca01f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 >> 172.21.15.135:0/352759079 conn(0x7f1ca006d3e0 msgr2=0x7f1ca013ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 shutdown_connections 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.530+0000 7f1ca5e50700 1 -- 172.21.15.135:0/352759079 wait complete. 2024-05-08T21:21:21.533 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T21:21:21.544 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T21:21:21.544 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.669+0000 7face047c700 1 Processor -- start 2024-05-08T21:21:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.669+0000 7face047c700 1 -- start start 2024-05-08T21:21:21.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7face047c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072370 0x7facd8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7face047c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7facd8072750 0x7facd8153460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7face047c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd8159650 con 0x7facd815ce70 2024-05-08T21:21:21.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7face047c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd8159930 con 0x7facd8072750 2024-05-08T21:21:21.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7face047c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd8159c10 con 0x7facd8072370 2024-05-08T21:21:21.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7facdda17700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7facd8072750 0x7facd8153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7facdda17700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7facd8072750 0x7facd8153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47862/0 (socket says 172.21.15.135:47862) 2024-05-08T21:21:21.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.670+0000 7facdda17700 1 -- 172.21.15.135:0/1884684123 learned_addr learned my addr 172.21.15.135:0/1884684123 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:21.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facde218700 1 --2- 172.21.15.135:0/1884684123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072370 0x7facd8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdda17700 1 -- 172.21.15.135:0/1884684123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072370 msgr2=0x7facd8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:21.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdda17700 1 --2- 172.21.15.135:0/1884684123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072370 0x7facd8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdda17700 1 -- 172.21.15.135:0/1884684123 >> v1:172.21.15.183:6789/0 conn(0x7facd815ce70 legacy=0x7facd815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdda17700 1 -- 172.21.15.135:0/1884684123 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8159ef0 con 0x7facd8072750 2024-05-08T21:21:21.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdda17700 1 --2- 172.21.15.135:0/1884684123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072750 0x7facd8153460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7facd40098f0 tx=0x7facd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efef3f7d48a95b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdd216700 1 -- 172.21.15.135:0/1884684123 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400b8a0 con 0x7facd8072750 2024-05-08T21:21:21.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdd216700 1 -- 172.21.15.135:0/1884684123 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd400ba00 con 0x7facd8072750 2024-05-08T21:21:21.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.671+0000 7facdd216700 1 -- 172.21.15.135:0/1884684123 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400bd90 con 0x7facd8072750 2024-05-08T21:21:21.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 -- 172.21.15.135:0/1884684123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072750 msgr2=0x7facd8153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 --2- 172.21.15.135:0/1884684123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072750 0x7facd8153460 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7facd40098f0 tx=0x7facd4009c00 comp rx=0 tx=0).stop 2024-05-08T21:21:21.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 -- 172.21.15.135:0/1884684123 shutdown_connections 2024-05-08T21:21:21.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 --2- 172.21.15.135:0/1884684123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072370 0x7facd8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 --2- 172.21.15.135:0/1884684123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072750 0x7facd8153460 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 -- 172.21.15.135:0/1884684123 >> 172.21.15.135:0/1884684123 conn(0x7facd806eb30 msgr2=0x7facd806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 -- 172.21.15.135:0/1884684123 shutdown_connections 2024-05-08T21:21:21.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.672+0000 7face047c700 1 -- 172.21.15.135:0/1884684123 wait complete. 2024-05-08T21:21:21.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.673+0000 7face047c700 1 Processor -- start 2024-05-08T21:21:21.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.673+0000 7face047c700 1 -- start start 2024-05-08T21:21:21.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.673+0000 7face047c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072370 0x7facd806b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.673+0000 7face047c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072750 0x7facd81e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7face047c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd815ce70 0x7facd81e3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7face047c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd81e4840 con 0x7facd8072370 2024-05-08T21:21:21.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7face047c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd81ef340 con 0x7facd815ce70 2024-05-08T21:21:21.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7face047c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd81ef870 con 0x7facd8072750 2024-05-08T21:21:21.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072370 0x7facd806b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072370 0x7facd806b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47864/0 (socket says 172.21.15.135:47864) 2024-05-08T21:21:21.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 -- 172.21.15.135:0/3042563685 learned_addr learned my addr 172.21.15.135:0/3042563685 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:21.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facdda17700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072750 0x7facd81e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facdea19700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd815ce70 0x7facd81e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 -- 172.21.15.135:0/3042563685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072750 msgr2=0x7facd81e2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072750 0x7facd81e2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 -- 172.21.15.135:0/3042563685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd815ce70 msgr2=0x7facd81e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facd815ce70 0x7facd81e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 -- 172.21.15.135:0/3042563685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009550 con 0x7facd8072370 2024-05-08T21:21:21.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facdda17700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facd8072750 0x7facd81e2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:21.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facde218700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072370 0x7facd806b3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7facc800e840 tx=0x7facc800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8013610 con 0x7facd8072370 2024-05-08T21:21:21.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8013770 con 0x7facd8072370 2024-05-08T21:21:21.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd815c170 con 0x7facd8072370 2024-05-08T21:21:21.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8013b20 con 0x7facd8072370 2024-05-08T21:21:21.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.674+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd81e24c0 con 0x7facd8072370 2024-05-08T21:21:21.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.675+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facd8159360 con 0x7facd8072370 2024-05-08T21:21:21.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7facc8013c80 con 0x7facd8072370 2024-05-08T21:21:21.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facceffd700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7facbc06ac90 0x7facbc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7facc80893d0 con 0x7facd8072370 2024-05-08T21:21:21.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facdda17700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7facbc06ac90 0x7facbc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facceffd700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7facbc074570 0x7facbc076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 --> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facbc0770e0 con 0x7facbc074570 2024-05-08T21:21:21.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7facc808b9b0 con 0x7facd8072370 2024-05-08T21:21:21.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.676+0000 7facdea19700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7facbc074570 0x7facbc076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.677+0000 7facdda17700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7facbc06ac90 0x7facbc06d150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7facd4009c40 tx=0x7facd4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.677+0000 7facdea19700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7facbc074570 0x7facbc076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.677+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== osd.3 v2:172.21.15.135:6800/47105 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7facbc0770e0 con 0x7facbc074570 2024-05-08T21:21:21.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 --> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7facd815c950 con 0x7facbc074570 2024-05-08T21:21:21.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7facceffd700 1 -- 172.21.15.135:0/3042563685 <== osd.3 v2:172.21.15.135:6800/47105 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7facd0003a00 con 0x7facbc074570 2024-05-08T21:21:21.695 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:21.695 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:21.695 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:21.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7facbc074570 msgr2=0x7facbc076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6800/47105,v1:172.21.15.135:6801/47105] conn(0x7facbc074570 0x7facbc076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7facbc06ac90 msgr2=0x7facbc06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7facbc06ac90 0x7facbc06d150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7facd4009c40 tx=0x7facd4008030 comp rx=0 tx=0).stop 2024-05-08T21:21:21.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072370 msgr2=0x7facd806b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 --2- 172.21.15.135:0/3042563685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7facd8072370 0x7facd806b3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7facc800e840 tx=0x7facc800ec00 comp rx=0 tx=0).stop 2024-05-08T21:21:21.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7facdea19700 1 -- 172.21.15.135:0/3042563685 reap_dead start 2024-05-08T21:21:21.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 shutdown_connections 2024-05-08T21:21:21.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 >> 172.21.15.135:0/3042563685 conn(0x7facd806eb30 msgr2=0x7facd80c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 shutdown_connections 2024-05-08T21:21:21.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.692+0000 7face047c700 1 -- 172.21.15.135:0/3042563685 wait complete. 2024-05-08T21:21:21.706 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T21:21:21.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.827+0000 7fdcdcb1c700 1 Processor -- start 2024-05-08T21:21:21.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.827+0000 7fdcdcb1c700 1 -- start start 2024-05-08T21:21:21.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcdcb1c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdcd80c5c30 0x7fdcd806bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcdcb1c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdcd806f2e0 0x7fdcd806f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcdcb1c700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd80c7630 con 0x7fdcd8150410 2024-05-08T21:21:21.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcdcb1c700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd806fc30 con 0x7fdcd80c5c30 2024-05-08T21:21:21.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcdcb1c700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd80c2e40 con 0x7fdcd806f2e0 2024-05-08T21:21:21.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdcd80c5c30 0x7fdcd806bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fdcd80c5c30 0x7fdcd806bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47872/0 (socket says 172.21.15.135:47872) 2024-05-08T21:21:21.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 -- 172.21.15.135:0/2931074923 learned_addr learned my addr 172.21.15.135:0/2931074923 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:21.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd6d9d700 1 --2- 172.21.15.135:0/2931074923 >> v2:172.21.15.183:3300/0 conn(0x7fdcd806f2e0 0x7fdcd806f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 -- 172.21.15.135:0/2931074923 >> v2:172.21.15.183:3300/0 conn(0x7fdcd806f2e0 msgr2=0x7fdcd806f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:21.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 --2- 172.21.15.135:0/2931074923 >> v2:172.21.15.183:3300/0 conn(0x7fdcd806f2e0 0x7fdcd806f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 -- 172.21.15.135:0/2931074923 >> v1:172.21.15.183:6789/0 conn(0x7fdcd8150410 legacy=0x7fdcd80c2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 -- 172.21.15.135:0/2931074923 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd81507f0 con 0x7fdcd80c5c30 2024-05-08T21:21:21.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd5d9b700 1 --2- 172.21.15.135:0/2931074923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd80c5c30 0x7fdcd806bb20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80c6820 tx=0x7fdccc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5540fbe4e82acc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.828+0000 7fdcd559a700 1 -- 172.21.15.135:0/2931074923 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc011830 con 0x7fdcd80c5c30 2024-05-08T21:21:21.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcd559a700 1 -- 172.21.15.135:0/2931074923 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc011990 con 0x7fdcd80c5c30 2024-05-08T21:21:21.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcd559a700 1 -- 172.21.15.135:0/2931074923 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc011d20 con 0x7fdcd80c5c30 2024-05-08T21:21:21.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2931074923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd80c5c30 msgr2=0x7fdcd806bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2931074923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd80c5c30 0x7fdcd806bb20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80c6820 tx=0x7fdccc009c00 comp rx=0 tx=0).stop 2024-05-08T21:21:21.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2931074923 shutdown_connections 2024-05-08T21:21:21.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2931074923 >> v2:172.21.15.183:3300/0 conn(0x7fdcd806f2e0 0x7fdcd806f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2931074923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd80c5c30 0x7fdcd806bb20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2931074923 >> 172.21.15.135:0/2931074923 conn(0x7fdcd806d620 msgr2=0x7fdcd806da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:21.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2931074923 shutdown_connections 2024-05-08T21:21:21.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.829+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2931074923 wait complete. 2024-05-08T21:21:21.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.830+0000 7fdcdcb1c700 1 Processor -- start 2024-05-08T21:21:21.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcdcb1c700 1 -- start start 2024-05-08T21:21:21.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcdcb1c700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806f2e0 0x7fdcd8153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcdcb1c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd80c5c30 0x7fdcd81ea950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcdcb1c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd8150410 0x7fdcd81485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcdcb1c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8153990 con 0x7fdcd8150410 2024-05-08T21:21:21.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcdcb1c700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd81ee860 con 0x7fdcd80c5c30 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcdcb1c700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd81ef6c0 con 0x7fdcd806f2e0 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcd6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd8150410 0x7fdcd81485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcd6d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd8150410 0x7fdcd81485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47880/0 (socket says 172.21.15.135:47880) 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.831+0000 7fdcd6d9d700 1 -- 172.21.15.135:0/2752988036 learned_addr learned my addr 172.21.15.135:0/2752988036 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd659c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806f2e0 0x7fdcd8153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd5d9b700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd80c5c30 0x7fdcd81ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd6d9d700 1 -- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806f2e0 msgr2=0x7fdcd8153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd6d9d700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806f2e0 0x7fdcd8153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd6d9d700 1 -- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd80c5c30 msgr2=0x7fdcd81ea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd6d9d700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd80c5c30 0x7fdcd81ea950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd6d9d700 1 -- 172.21.15.135:0/2752988036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc009550 con 0x7fdcd8150410 2024-05-08T21:21:21.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcd6d9d700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd8150410 0x7fdcd81485f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000efc0 tx=0x7fdcd000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcc6ffd700 1 -- 172.21.15.135:0/2752988036 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000cd40 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcc6ffd700 1 -- 172.21.15.135:0/2752988036 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd81eeab0 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcc6ffd700 1 -- 172.21.15.135:0/2752988036 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00146c0 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.832+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd81ef070 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.833+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd8067fa0 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.833+0000 7fdcc6ffd700 1 -- 172.21.15.135:0/2752988036 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdcd0014820 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.834+0000 7fdcc6ffd700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdcb806ac90 0x7fdcb806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.834+0000 7fdcc6ffd700 1 -- 172.21.15.135:0/2752988036 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdcd008a030 con 0x7fdcd8150410 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.834+0000 7fdcd659c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdcb806ac90 0x7fdcb806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.834+0000 7fdcd659c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdcb806ac90 0x7fdcb806d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000f60 tx=0x7fdcc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:21.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:21.838+0000 7fdcc6ffd700 1 -- 172.21.15.135:0/2752988036 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdcd0054ee0 con 0x7fdcd8150410 2024-05-08T21:21:22.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.039+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcd814d870 con 0x7fdcb806ac90 2024-05-08T21:21:22.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.039+0000 7fdcc6ffd700 1 -- 172.21.15.135:0/2752988036 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdcd814d870 con 0x7fdcb806ac90 2024-05-08T21:21:22.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.041+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdcb806ac90 msgr2=0x7fdcb806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.041+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdcb806ac90 0x7fdcb806d150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000f60 tx=0x7fdcc8009040 comp rx=0 tx=0).stop 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.041+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd8150410 msgr2=0x7fdcd81485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.041+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd8150410 0x7fdcd81485f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000efc0 tx=0x7fdcd000c3a0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 shutdown_connections 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdcb806ac90 0x7fdcb806d150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd8150410 0x7fdcd81485f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdcd806f2e0 0x7fdcd8153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 --2- 172.21.15.135:0/2752988036 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdcd80c5c30 0x7fdcd81ea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 >> 172.21.15.135:0/2752988036 conn(0x7fdcd806d620 msgr2=0x7fdcd806da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 shutdown_connections 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.042+0000 7fdcdcb1c700 1 -- 172.21.15.135:0/2752988036 wait complete. 2024-05-08T21:21:22.045 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T21:21:22.056 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T21:21:22.056 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.180+0000 7f7f5d888700 1 Processor -- start 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.180+0000 7f7f5d888700 1 -- start start 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f5d888700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f580cb5a0 0x7f7f580cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f5d888700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f580cae30 0x7f7f580cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f5d888700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5815a220 con 0x7f7f580ce090 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f5d888700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f580ce520 con 0x7f7f580cae30 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f5d888700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f58159400 con 0x7f7f580cb5a0 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f580cae30 0x7f7f580cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f7f580cae30 0x7f7f580cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47886/0 (socket says 172.21.15.135:47886) 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 -- 172.21.15.135:0/42902012 learned_addr learned my addr 172.21.15.135:0/42902012 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:22.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 -- 172.21.15.135:0/42902012 >> v2:172.21.15.183:3300/0 conn(0x7f7f580cb5a0 msgr2=0x7f7f580cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 --2- 172.21.15.135:0/42902012 >> v2:172.21.15.183:3300/0 conn(0x7f7f580cb5a0 0x7f7f580cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 -- 172.21.15.135:0/42902012 >> v1:172.21.15.183:6789/0 conn(0x7f7f580ce090 legacy=0x7f7f580ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 -- 172.21.15.135:0/42902012 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58159610 con 0x7f7f580cae30 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f567fc700 1 --2- 172.21.15.135:0/42902012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cae30 0x7f7f580cdb50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f5806dc50 tx=0x7f7f48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d770b71574485a31 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.181+0000 7f7f55ffb700 1 -- 172.21.15.135:0/42902012 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48004230 con 0x7f7f580cae30 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f55ffb700 1 -- 172.21.15.135:0/42902012 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48004390 con 0x7f7f580cae30 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f55ffb700 1 -- 172.21.15.135:0/42902012 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480036a0 con 0x7f7f580cae30 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 -- 172.21.15.135:0/42902012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cae30 msgr2=0x7f7f580cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 --2- 172.21.15.135:0/42902012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cae30 0x7f7f580cdb50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f5806dc50 tx=0x7f7f48009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 -- 172.21.15.135:0/42902012 shutdown_connections 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 --2- 172.21.15.135:0/42902012 >> v2:172.21.15.183:3300/0 conn(0x7f7f580cb5a0 0x7f7f580cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 --2- 172.21.15.135:0/42902012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cae30 0x7f7f580cdb50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 -- 172.21.15.135:0/42902012 >> 172.21.15.135:0/42902012 conn(0x7f7f580726c0 msgr2=0x7f7f580ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 -- 172.21.15.135:0/42902012 shutdown_connections 2024-05-08T21:21:22.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.182+0000 7f7f5d888700 1 -- 172.21.15.135:0/42902012 wait complete. 2024-05-08T21:21:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.183+0000 7f7f5d888700 1 Processor -- start 2024-05-08T21:21:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f5d888700 1 -- start start 2024-05-08T21:21:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f5d888700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580cae30 0x7f7f581f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f5d888700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cb5a0 0x7f7f581ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f5d888700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580b2480 0x7f7f5814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f5d888700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f581eef60 con 0x7f7f580cb5a0 2024-05-08T21:21:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f5d888700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f581f3420 con 0x7f7f580b2480 2024-05-08T21:21:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f5d888700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f581ef4e0 con 0x7f7f580cae30 2024-05-08T21:21:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f567fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cb5a0 0x7f7f581ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f567fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cb5a0 0x7f7f581ef970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:47892/0 (socket says 172.21.15.135:47892) 2024-05-08T21:21:22.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.184+0000 7f7f567fc700 1 -- 172.21.15.135:0/1717186522 learned_addr learned my addr 172.21.15.135:0/1717186522 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f577fe700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580b2480 0x7f7f5814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f56ffd700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580cae30 0x7f7f581f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f567fc700 1 -- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580cae30 msgr2=0x7f7f581f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f567fc700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580cae30 0x7f7f581f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f567fc700 1 -- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580b2480 msgr2=0x7f7f5814bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f567fc700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580b2480 0x7f7f5814bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f567fc700 1 -- 172.21.15.135:0/1717186522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48009550 con 0x7f7f580cb5a0 2024-05-08T21:21:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f567fc700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cb5a0 0x7f7f581ef970 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7f580cc3f0 tx=0x7f7f48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48003dd0 con 0x7f7f580cb5a0 2024-05-08T21:21:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48011630 con 0x7f7f580cb5a0 2024-05-08T21:21:22.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f480119e0 con 0x7f7f580cb5a0 2024-05-08T21:21:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f581efeb0 con 0x7f7f580cb5a0 2024-05-08T21:21:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.185+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f580b1d90 con 0x7f7f580cb5a0 2024-05-08T21:21:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.186+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f58159eb0 con 0x7f7f580cb5a0 2024-05-08T21:21:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.186+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f48011b40 con 0x7f7f580cb5a0 2024-05-08T21:21:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f3ffff700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7f4406ac90 0x7f7f4406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7f4808acd0 con 0x7f7f580cb5a0 2024-05-08T21:21:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f56ffd700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7f4406ac90 0x7f7f4406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f3ffff700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f7f44074570 0x7f7f44076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 --> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f440770e0 con 0x7f7f44074570 2024-05-08T21:21:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f4808d330 con 0x7f7f580cb5a0 2024-05-08T21:21:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f56ffd700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7f4406ac90 0x7f7f4406d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c006fd0 tx=0x7f7f4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.187+0000 7f7f577fe700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f7f44074570 0x7f7f44076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.188+0000 7f7f577fe700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f7f44074570 0x7f7f44076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.188+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== osd.4 v2:172.21.15.183:6800/47308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7f440770e0 con 0x7f7f44074570 2024-05-08T21:21:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.203+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 --> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7f58159bd0 con 0x7f7f44074570 2024-05-08T21:21:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.203+0000 7f7f3ffff700 1 -- 172.21.15.135:0/1717186522 <== osd.4 v2:172.21.15.183:6800/47308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7f50001e40 con 0x7f7f44074570 2024-05-08T21:21:22.206 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:22.206 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:22.206 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f7f44074570 msgr2=0x7f7f44076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.183:6800/47308,v1:172.21.15.183:6801/47308] conn(0x7f7f44074570 0x7f7f44076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7f4406ac90 msgr2=0x7f7f4406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f7f4406ac90 0x7f7f4406d150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c006fd0 tx=0x7f7f4c008040 comp rx=0 tx=0).stop 2024-05-08T21:21:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cb5a0 msgr2=0x7f7f581ef970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 --2- 172.21.15.135:0/1717186522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f580cb5a0 0x7f7f581ef970 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7f580cc3f0 tx=0x7f7f48004750 comp rx=0 tx=0).stop 2024-05-08T21:21:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f577fe700 1 -- 172.21.15.135:0/1717186522 reap_dead start 2024-05-08T21:21:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 shutdown_connections 2024-05-08T21:21:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 >> 172.21.15.135:0/1717186522 conn(0x7f7f580726c0 msgr2=0x7f7f5814dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 shutdown_connections 2024-05-08T21:21:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.204+0000 7f7f5d888700 1 -- 172.21.15.135:0/1717186522 wait complete. 2024-05-08T21:21:22.218 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T21:21:22.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.338+0000 7f8403b8f700 1 Processor -- start 2024-05-08T21:21:22.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.339+0000 7f8403b8f700 1 -- start start 2024-05-08T21:21:22.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.339+0000 7f8403b8f700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f83fc0c8650 0x7f83fc0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f8403b8f700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f83fc0c7590 0x7f83fc0c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f8403b8f700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc0c84a0 con 0x7f83fc1536d0 2024-05-08T21:21:22.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f8403b8f700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0c7ee0 con 0x7f83fc0c7590 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f8403b8f700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc159400 con 0x7f83fc0c8650 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f83fc0c7590 0x7f83fc0c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f83fc0c7590 0x7f83fc0c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53846/0 (socket says 172.21.15.135:53846) 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 -- 172.21.15.135:0/924266911 learned_addr learned my addr 172.21.15.135:0/924266911 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840112a700 1 --2- 172.21.15.135:0/924266911 >> v2:172.21.15.183:3300/0 conn(0x7f83fc0c8650 0x7f83fc0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 -- 172.21.15.135:0/924266911 >> v2:172.21.15.183:3300/0 conn(0x7f83fc0c8650 msgr2=0x7f83fc0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 --2- 172.21.15.135:0/924266911 >> v2:172.21.15.183:3300/0 conn(0x7f83fc0c8650 0x7f83fc0c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 -- 172.21.15.135:0/924266911 >> v1:172.21.15.183:6789/0 conn(0x7f83fc1536d0 legacy=0x7f83fc159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 -- 172.21.15.135:0/924266911 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc15d9b0 con 0x7f83fc0c7590 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f840212c700 1 --2- 172.21.15.135:0/924266911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc0c79a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f83fc072cd0 tx=0x7f83f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c655e77cca4cfb6b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f8400929700 1 -- 172.21.15.135:0/924266911 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400e070 con 0x7f83fc0c7590 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f8400929700 1 -- 172.21.15.135:0/924266911 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4003a20 con 0x7f83fc0c7590 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.340+0000 7f8400929700 1 -- 172.21.15.135:0/924266911 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4003dd0 con 0x7f83fc0c7590 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 -- 172.21.15.135:0/924266911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 msgr2=0x7f83fc0c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 --2- 172.21.15.135:0/924266911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc0c79a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f83fc072cd0 tx=0x7f83f400b330 comp rx=0 tx=0).stop 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 -- 172.21.15.135:0/924266911 shutdown_connections 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 --2- 172.21.15.135:0/924266911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc0c79a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 --2- 172.21.15.135:0/924266911 >> v2:172.21.15.183:3300/0 conn(0x7f83fc0c8650 0x7f83fc0c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 -- 172.21.15.135:0/924266911 >> 172.21.15.135:0/924266911 conn(0x7f83fc06a960 msgr2=0x7f83fc06ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 -- 172.21.15.135:0/924266911 shutdown_connections 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.341+0000 7f8403b8f700 1 -- 172.21.15.135:0/924266911 wait complete. 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.342+0000 7f8403b8f700 1 Processor -- start 2024-05-08T21:21:22.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.342+0000 7f8403b8f700 1 -- start start 2024-05-08T21:21:22.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f8403b8f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f8403b8f700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83fc0c8650 0x7f83fc1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f8403b8f700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83fc1536d0 0x7f83fc1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f8403b8f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc14dc00 con 0x7f83fc0c7590 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f8403b8f700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0acb70 con 0x7f83fc1536d0 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f8403b8f700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0adaa0 con 0x7f83fc0c8650 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53852/0 (socket says 172.21.15.135:53852) 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 -- 172.21.15.135:0/1602631120 learned_addr learned my addr 172.21.15.135:0/1602631120 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840112a700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83fc0c8650 0x7f83fc1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840212c700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83fc1536d0 0x7f83fc1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 -- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83fc0c8650 msgr2=0x7f83fc1505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83fc0c8650 0x7f83fc1505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 -- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83fc1536d0 msgr2=0x7f83fc1435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83fc1536d0 0x7f83fc1435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 -- 172.21.15.135:0/1602631120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009b30 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.343+0000 7f840192b700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc150060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f83f000b4a0 tx=0x7f83f000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.344+0000 7f83ee7fc700 1 -- 172.21.15.135:0/1602631120 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0011830 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.344+0000 7f83ee7fc700 1 -- 172.21.15.135:0/1602631120 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0011990 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.344+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc0acd80 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.344+0000 7f83ee7fc700 1 -- 172.21.15.135:0/1602631120 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0011d40 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.344+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc0adcf0 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.344+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc14fbd0 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.345+0000 7f83ee7fc700 1 -- 172.21.15.135:0/1602631120 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f83f001a400 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.345+0000 7f83ee7fc700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f83e006ac90 0x7f83e006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.345+0000 7f83ee7fc700 1 -- 172.21.15.135:0/1602631120 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83f0089390 con 0x7f83fc0c7590 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.345+0000 7f840112a700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f83e006ac90 0x7f83e006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.346+0000 7f840112a700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f83e006ac90 0x7f83e006d150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83fc15c8a0 tx=0x7f83f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.350+0000 7f83ee7fc700 1 -- 172.21.15.135:0/1602631120 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f83f00541b0 con 0x7f83fc0c7590 2024-05-08T21:21:22.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.546+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f83fc15d3f0 con 0x7f83e006ac90 2024-05-08T21:21:22.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.546+0000 7f83ee7fc700 1 -- 172.21.15.135:0/1602631120 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83f8009e40 con 0x7f83e006ac90 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f83e006ac90 msgr2=0x7f83e006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f83e006ac90 0x7f83e006d150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83fc15c8a0 tx=0x7f83f8008040 comp rx=0 tx=0).stop 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 msgr2=0x7f83fc150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc150060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f83f000b4a0 tx=0x7f83f000b7b0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 shutdown_connections 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f83e006ac90 0x7f83e006d150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83fc1536d0 0x7f83fc1435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83fc0c7590 0x7f83fc150060 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 --2- 172.21.15.135:0/1602631120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83fc0c8650 0x7f83fc1505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 >> 172.21.15.135:0/1602631120 conn(0x7f83fc06a960 msgr2=0x7f83fc06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 shutdown_connections 2024-05-08T21:21:22.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.548+0000 7f8403b8f700 1 -- 172.21.15.135:0/1602631120 wait complete. 2024-05-08T21:21:22.553 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T21:21:22.563 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T21:21:22.563 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:22.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.687+0000 7f654f8f0700 1 Processor -- start 2024-05-08T21:21:22.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.687+0000 7f654f8f0700 1 -- start start 2024-05-08T21:21:22.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654f8f0700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f654813d110 0x7f65480c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654f8f0700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65480c8480 0x7f65480c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654f8f0700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65480c6bf0 con 0x7f654806a960 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654f8f0700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6548158110 con 0x7f65480c8480 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654f8f0700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654815a6b0 con 0x7f654813d110 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654ce8b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65480c8480 0x7f65480c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654ce8b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f65480c8480 0x7f65480c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53860/0 (socket says 172.21.15.135:53860) 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654ce8b700 1 -- 172.21.15.135:0/3940455883 learned_addr learned my addr 172.21.15.135:0/3940455883 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.688+0000 7f654d68c700 1 --2- 172.21.15.135:0/3940455883 >> v2:172.21.15.183:3300/0 conn(0x7f654813d110 0x7f65480c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654ce8b700 1 -- 172.21.15.135:0/3940455883 >> v2:172.21.15.183:3300/0 conn(0x7f654813d110 msgr2=0x7f65480c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654ce8b700 1 --2- 172.21.15.135:0/3940455883 >> v2:172.21.15.183:3300/0 conn(0x7f654813d110 0x7f65480c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654ce8b700 1 -- 172.21.15.135:0/3940455883 >> v1:172.21.15.183:6789/0 conn(0x7f654806a960 legacy=0x7f654815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654ce8b700 1 -- 172.21.15.135:0/3940455883 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65481572b0 con 0x7f65480c8480 2024-05-08T21:21:22.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654ce8b700 1 --2- 172.21.15.135:0/3940455883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65480c8480 0x7f65480c4910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f65480cc2a0 tx=0x7f6544009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d2efeca9c31ec4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f653ffff700 1 -- 172.21.15.135:0/3940455883 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544004230 con 0x7f65480c8480 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f653ffff700 1 -- 172.21.15.135:0/3940455883 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6544004390 con 0x7f65480c8480 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f653ffff700 1 -- 172.21.15.135:0/3940455883 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65440036a0 con 0x7f65480c8480 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654f8f0700 1 -- 172.21.15.135:0/3940455883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65480c8480 msgr2=0x7f65480c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654f8f0700 1 --2- 172.21.15.135:0/3940455883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65480c8480 0x7f65480c4910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f65480cc2a0 tx=0x7f6544009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654f8f0700 1 -- 172.21.15.135:0/3940455883 shutdown_connections 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654f8f0700 1 --2- 172.21.15.135:0/3940455883 >> v2:172.21.15.183:3300/0 conn(0x7f654813d110 0x7f65480c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654f8f0700 1 --2- 172.21.15.135:0/3940455883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65480c8480 0x7f65480c4910 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.689+0000 7f654f8f0700 1 -- 172.21.15.135:0/3940455883 >> 172.21.15.135:0/3940455883 conn(0x7f654806d6f0 msgr2=0x7f654806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.690+0000 7f654f8f0700 1 -- 172.21.15.135:0/3940455883 shutdown_connections 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.690+0000 7f654f8f0700 1 -- 172.21.15.135:0/3940455883 wait complete. 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.691+0000 7f654f8f0700 1 Processor -- start 2024-05-08T21:21:22.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.691+0000 7f654f8f0700 1 -- start start 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654f8f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654806a960 0x7f6548156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654f8f0700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65480c8480 0x7f65480c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654f8f0700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f654813d110 0x7f654814cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654f8f0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654814e6e0 con 0x7f654806a960 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654f8f0700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654814e9a0 con 0x7f65480c8480 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654f8f0700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65481564f0 con 0x7f654813d110 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654806a960 0x7f6548156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654806a960 0x7f6548156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53872/0 (socket says 172.21.15.135:53872) 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 -- 172.21.15.135:0/1723813453 learned_addr learned my addr 172.21.15.135:0/1723813453 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654ce8b700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65480c8480 0x7f65480c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654de8d700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f654813d110 0x7f654814cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 -- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f654813d110 msgr2=0x7f654814cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f654813d110 0x7f654814cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 -- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65480c8480 msgr2=0x7f65480c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65480c8480 0x7f65480c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.692+0000 7f654d68c700 1 -- 172.21.15.135:0/1723813453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6544009550 con 0x7f654806a960 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.693+0000 7f654d68c700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654806a960 0x7f6548156980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f653800d800 tx=0x7f653800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.693+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380125f0 con 0x7f654806a960 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.693+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538012750 con 0x7f654806a960 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.693+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65481561c0 con 0x7f654806a960 2024-05-08T21:21:22.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.693+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538012b00 con 0x7f654806a960 2024-05-08T21:21:22.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.693+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654814eed0 con 0x7f654806a960 2024-05-08T21:21:22.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.694+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6548157b50 con 0x7f654806a960 2024-05-08T21:21:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6538012c60 con 0x7f654806a960 2024-05-08T21:21:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f653dffb700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f652c06ac90 0x7f652c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f653808a420 con 0x7f654806a960 2024-05-08T21:21:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f654ce8b700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f652c06ac90 0x7f652c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f653dffb700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f652c074570 0x7f652c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 --> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f652c0770e0 con 0x7f652c074570 2024-05-08T21:21:22.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f653808a870 con 0x7f654806a960 2024-05-08T21:21:22.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f654de8d700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f652c074570 0x7f652c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.695+0000 7f654ce8b700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f652c06ac90 0x7f652c06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f65480c8890 tx=0x7f6544008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.696+0000 7f654de8d700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f652c074570 0x7f652c076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.697+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== osd.5 v2:172.21.15.183:6824/47320 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f652c0770e0 con 0x7f652c074570 2024-05-08T21:21:22.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.711+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 --> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6548157870 con 0x7f652c074570 2024-05-08T21:21:22.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f653dffb700 1 -- 172.21.15.135:0/1723813453 <== osd.5 v2:172.21.15.183:6824/47320 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f65400049e0 con 0x7f652c074570 2024-05-08T21:21:22.714 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:22.714 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:22.714 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f652c074570 msgr2=0x7f652c076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.183:6824/47320,v1:172.21.15.183:6825/47320] conn(0x7f652c074570 0x7f652c076a10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f652c06ac90 msgr2=0x7f652c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f652c06ac90 0x7f652c06d150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f65480c8890 tx=0x7f6544008030 comp rx=0 tx=0).stop 2024-05-08T21:21:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654806a960 msgr2=0x7f6548156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 --2- 172.21.15.135:0/1723813453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f654806a960 0x7f6548156980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f653800d800 tx=0x7f653800dbc0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654de8d700 1 -- 172.21.15.135:0/1723813453 reap_dead start 2024-05-08T21:21:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 shutdown_connections 2024-05-08T21:21:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 >> 172.21.15.135:0/1723813453 conn(0x7f654806d6f0 msgr2=0x7f654806f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 shutdown_connections 2024-05-08T21:21:22.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.712+0000 7f654f8f0700 1 -- 172.21.15.135:0/1723813453 wait complete. 2024-05-08T21:21:22.726 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T21:21:22.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.845+0000 7fb646690700 1 Processor -- start 2024-05-08T21:21:22.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.845+0000 7fb646690700 1 -- start start 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.846+0000 7fb646690700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 0x7fb640157160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.846+0000 7fb646690700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6400c2360 0x7fb6400cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.846+0000 7fb646690700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb640157750 con 0x7fb6401585d0 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.846+0000 7fb646690700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb640070400 con 0x7fb6400c2360 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.846+0000 7fb646690700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400c35d0 con 0x7fb640151370 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.846+0000 7fb63f7fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fb6401585d0 0x7fb64006fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:56214/0 (socket says 172.21.15.135:56214) 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.846+0000 7fb63f7fe700 1 -- 172.21.15.135:0/2244357004 learned_addr learned my addr 172.21.15.135:0/2244357004 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb644c2d700 1 --2- 172.21.15.135:0/2244357004 >> v2:172.21.15.183:3300/0 conn(0x7fb6400c2360 0x7fb6400cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63ffff700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 0x7fb640157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198047073 0 0) 0x7fb640157750 con 0x7fb6401585d0 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb62c0035b0 con 0x7fb6401585d0 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231660708 0 0) 0x7fb62c0035b0 con 0x7fb6401585d0 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 msgr2=0x7fb640157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 0x7fb640157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 >> v2:172.21.15.183:3300/0 conn(0x7fb6400c2360 msgr2=0x7fb6400cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 --2- 172.21.15.135:0/2244357004 >> v2:172.21.15.183:3300/0 conn(0x7fb6400c2360 0x7fb6400cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640157a10 con 0x7fb6401585d0 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7fb630001670 con 0x7fb6401585d0 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 >> v1:172.21.15.135:6789/0 conn(0x7fb6401585d0 legacy=0x7fb64006fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb62c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c004850 0x7fb62c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 0x7fb62c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640070400 con 0x7fb62c003a00 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00ba10 con 0x7fb62c004850 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c00bb50 con 0x7fb640151370 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63ffff700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb62c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63f7fe700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c004850 0x7fb62c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb644c2d700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 0x7fb62c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63ffff700 1 -- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 msgr2=0x7fb62c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63ffff700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb640151370 0x7fb62c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63ffff700 1 -- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c004850 msgr2=0x7fb62c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:22.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63ffff700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c004850 0x7fb62c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.847+0000 7fb63ffff700 1 -- 172.21.15.135:0/2244357004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0035b0 con 0x7fb62c003a00 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb63ffff700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb62c003e20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb628009b60 tx=0x7fb62c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c588af440b40960 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800e6c0 con 0x7fb62c003a00 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800e820 con 0x7fb62c003a00 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb63effd700 1 -- 172.21.15.135:0/2244357004 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800eb90 con 0x7fb62c003a00 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb646690700 1 -- 172.21.15.135:0/2244357004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 msgr2=0x7fb62c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb646690700 1 --2- 172.21.15.135:0/2244357004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb62c003e20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb628009b60 tx=0x7fb62c005880 comp rx=0 tx=0).stop 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb644c2d700 1 -- 172.21.15.135:0/2244357004 reap_dead start 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb646690700 1 -- 172.21.15.135:0/2244357004 shutdown_connections 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb646690700 1 -- 172.21.15.135:0/2244357004 >> 172.21.15.135:0/2244357004 conn(0x7fb64006ad50 msgr2=0x7fb64006b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb646690700 1 -- 172.21.15.135:0/2244357004 shutdown_connections 2024-05-08T21:21:22.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.848+0000 7fb646690700 1 -- 172.21.15.135:0/2244357004 wait complete. 2024-05-08T21:21:22.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.849+0000 7fb646690700 1 Processor -- start 2024-05-08T21:21:22.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb646690700 1 -- start start 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb646690700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb6400c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb646690700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6400cb490 0x7fb6400c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb646690700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6400c6b30 0x7fb6401430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb646690700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400c64e0 con 0x7fb62c003a00 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb646690700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400c5630 con 0x7fb6400cb490 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb646690700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401f07d0 con 0x7fb6400c6b30 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb6400c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb63ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb6400c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53890/0 (socket says 172.21.15.135:53890) 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.850+0000 7fb63ffff700 1 -- 172.21.15.135:0/3375943640 learned_addr learned my addr 172.21.15.135:0/3375943640 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb644c2d700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6400c6b30 0x7fb6401430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63f7fe700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6400cb490 0x7fb6400c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63ffff700 1 -- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6400c6b30 msgr2=0x7fb6401430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63ffff700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6400c6b30 0x7fb6401430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63ffff700 1 -- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6400cb490 msgr2=0x7fb6400c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63ffff700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6400cb490 0x7fb6400c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63ffff700 1 -- 172.21.15.135:0/3375943640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6401efbc0 con 0x7fb62c003a00 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb644c2d700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6400c6b30 0x7fb6401430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63f7fe700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6400cb490 0x7fb6400c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63ffff700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb6400c9450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb62c004730 tx=0x7fb6280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63cff9700 1 -- 172.21.15.135:0/3375943640 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800e6c0 con 0x7fb62c003a00 2024-05-08T21:21:22.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63cff9700 1 -- 172.21.15.135:0/3375943640 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628003ab0 con 0x7fb62c003a00 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6401efea0 con 0x7fb62c003a00 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb63cff9700 1 -- 172.21.15.135:0/3375943640 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628003e60 con 0x7fb62c003a00 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.851+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6401f0460 con 0x7fb62c003a00 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.852+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6401f0620 con 0x7fb62c003a00 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.852+0000 7fb63cff9700 1 -- 172.21.15.135:0/3375943640 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb628013470 con 0x7fb62c003a00 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.853+0000 7fb63cff9700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb62006acc0 0x7fb62006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.853+0000 7fb63cff9700 1 -- 172.21.15.135:0/3375943640 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb62808b070 con 0x7fb62c003a00 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.853+0000 7fb63f7fe700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb62006acc0 0x7fb62006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:22.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.853+0000 7fb63f7fe700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb62006acc0 0x7fb62006d180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ca930 tx=0x7fb630009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:22.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:22.857+0000 7fb63cff9700 1 -- 172.21.15.135:0/3375943640 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb628056040 con 0x7fb62c003a00 2024-05-08T21:21:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.060+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6400c1880 con 0x7fb62006acc0 2024-05-08T21:21:23.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.061+0000 7fb63cff9700 1 -- 172.21.15.135:0/3375943640 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb630001ba0 con 0x7fb62006acc0 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb62006acc0 msgr2=0x7fb62006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb62006acc0 0x7fb62006d180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ca930 tx=0x7fb630009040 comp rx=0 tx=0).stop 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 msgr2=0x7fb6400c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb6400c9450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb62c004730 tx=0x7fb6280047c0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 shutdown_connections 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fb62006acc0 0x7fb62006d180 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6400c6b30 0x7fb6401430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb62c003a00 0x7fb6400c9450 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 --2- 172.21.15.135:0/3375943640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6400cb490 0x7fb6400c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 >> 172.21.15.135:0/3375943640 conn(0x7fb64006ad50 msgr2=0x7fb64006f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 shutdown_connections 2024-05-08T21:21:23.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.063+0000 7fb646690700 1 -- 172.21.15.135:0/3375943640 wait complete. 2024-05-08T21:21:23.067 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T21:21:23.077 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T21:21:23.078 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:23.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.201+0000 7f5b74f7d700 1 Processor -- start 2024-05-08T21:21:23.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.201+0000 7f5b74f7d700 1 -- start start 2024-05-08T21:21:23.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b74f7d700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5b70072390 0x7f5b700b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b74f7d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5b70156050 0x7f5b701564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b74f7d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700c1540 con 0x7f5b70072770 2024-05-08T21:21:23.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b74f7d700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700c6670 con 0x7f5b70156050 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b74f7d700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700c19d0 con 0x7f5b70072390 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5b70156050 0x7f5b701564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5b70156050 0x7f5b701564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53900/0 (socket says 172.21.15.135:53900) 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 -- 172.21.15.135:0/3115091909 learned_addr learned my addr 172.21.15.135:0/3115091909 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6e59c700 1 --2- 172.21.15.135:0/3115091909 >> v2:172.21.15.183:3300/0 conn(0x7f5b70072390 0x7f5b700b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 -- 172.21.15.135:0/3115091909 >> v2:172.21.15.183:3300/0 conn(0x7f5b70072390 msgr2=0x7f5b700b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 --2- 172.21.15.135:0/3115091909 >> v2:172.21.15.183:3300/0 conn(0x7f5b70072390 0x7f5b700b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 -- 172.21.15.135:0/3115091909 >> v1:172.21.15.183:6789/0 conn(0x7f5b70072770 legacy=0x7f5b700cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 -- 172.21.15.135:0/3115091909 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700c6930 con 0x7f5b70156050 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6ed9d700 1 --2- 172.21.15.135:0/3115091909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70156050 0x7f5b701564c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5b700cbca0 tx=0x7f5b6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49f56171f1f5db3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6d59a700 1 -- 172.21.15.135:0/3115091909 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6800e070 con 0x7f5b70156050 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6d59a700 1 -- 172.21.15.135:0/3115091909 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6800b910 con 0x7f5b70156050 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.202+0000 7f5b6d59a700 1 -- 172.21.15.135:0/3115091909 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6800bcc0 con 0x7f5b70156050 2024-05-08T21:21:23.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 -- 172.21.15.135:0/3115091909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70156050 msgr2=0x7f5b701564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 --2- 172.21.15.135:0/3115091909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70156050 0x7f5b701564c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5b700cbca0 tx=0x7f5b6800b330 comp rx=0 tx=0).stop 2024-05-08T21:21:23.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 -- 172.21.15.135:0/3115091909 shutdown_connections 2024-05-08T21:21:23.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 --2- 172.21.15.135:0/3115091909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70156050 0x7f5b701564c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 --2- 172.21.15.135:0/3115091909 >> v2:172.21.15.183:3300/0 conn(0x7f5b70072390 0x7f5b700b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 -- 172.21.15.135:0/3115091909 >> 172.21.15.135:0/3115091909 conn(0x7f5b7006ec40 msgr2=0x7f5b7006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 -- 172.21.15.135:0/3115091909 shutdown_connections 2024-05-08T21:21:23.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.203+0000 7f5b74f7d700 1 -- 172.21.15.135:0/3115091909 wait complete. 2024-05-08T21:21:23.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.204+0000 7f5b74f7d700 1 Processor -- start 2024-05-08T21:21:23.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.204+0000 7f5b74f7d700 1 -- start start 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b74f7d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b70072390 0x7f5b701512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b74f7d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70072770 0x7f5b700c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b74f7d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b70156050 0x7f5b700c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b74f7d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b701535d0 con 0x7f5b70072770 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b74f7d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b70152ea0 con 0x7f5b70156050 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b74f7d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700cb8d0 con 0x7f5b70072390 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b6dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70072770 0x7f5b700c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b6dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70072770 0x7f5b700c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53904/0 (socket says 172.21.15.135:53904) 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b6dd9b700 1 -- 172.21.15.135:0/1398917841 learned_addr learned my addr 172.21.15.135:0/1398917841 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b6ed9d700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b70156050 0x7f5b700c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.205+0000 7f5b6e59c700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b70072390 0x7f5b701512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b6dd9b700 1 -- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b70072390 msgr2=0x7f5b701512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b6dd9b700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5b70072390 0x7f5b701512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b6dd9b700 1 -- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b70156050 msgr2=0x7f5b700c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b6dd9b700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5b70156050 0x7f5b700c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b6dd9b700 1 -- 172.21.15.135:0/1398917841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68009b30 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b6dd9b700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70072770 0x7f5b700c4090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c4b0 tx=0x7f5b6400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b640052d0 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b64005430 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b700cadb0 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b640038c0 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.206+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b700cb5f0 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.207+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b700c11d0 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.207+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b64003a20 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b5effd700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5b5006ac90 0x7f5b5006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5b64088a40 con 0x7f5b70072770 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b6e59c700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5b5006ac90 0x7f5b5006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b5effd700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7f5b50074570 0x7f5b50076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 --> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b500770e0 con 0x7f5b50074570 2024-05-08T21:21:23.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b6408d2c0 con 0x7f5b70072770 2024-05-08T21:21:23.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b6e59c700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5b5006ac90 0x7f5b5006d150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009be0 tx=0x7f5b60009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.208+0000 7f5b6ed9d700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7f5b50074570 0x7f5b50076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.209+0000 7f5b6ed9d700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7f5b50074570 0x7f5b50076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.209+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== osd.6 v2:172.21.15.183:6816/47323 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5b500770e0 con 0x7f5b50074570 2024-05-08T21:21:23.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.224+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 --> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5b700c0ef0 con 0x7f5b50074570 2024-05-08T21:21:23.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.224+0000 7f5b5effd700 1 -- 172.21.15.135:0/1398917841 <== osd.6 v2:172.21.15.183:6816/47323 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5b680099b0 con 0x7f5b50074570 2024-05-08T21:21:23.226 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:23.227 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:23.227 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:23.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.224+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7f5b50074570 msgr2=0x7f5b50076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.224+0000 7f5b74f7d700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.183:6816/47323,v1:172.21.15.183:6817/47323] conn(0x7f5b50074570 0x7f5b50076a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5b5006ac90 msgr2=0x7f5b5006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5b5006ac90 0x7f5b5006d150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009be0 tx=0x7f5b60009210 comp rx=0 tx=0).stop 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70072770 msgr2=0x7f5b700c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 --2- 172.21.15.135:0/1398917841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b70072770 0x7f5b700c4090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400c4b0 tx=0x7f5b6400c7c0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b6ed9d700 1 -- 172.21.15.135:0/1398917841 reap_dead start 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 shutdown_connections 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 >> 172.21.15.135:0/1398917841 conn(0x7f5b7006ec40 msgr2=0x7f5b7014fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 shutdown_connections 2024-05-08T21:21:23.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.225+0000 7f5b74f7d700 1 -- 172.21.15.135:0/1398917841 wait complete. 2024-05-08T21:21:23.239 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T21:21:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.360+0000 7f127f025700 1 Processor -- start 2024-05-08T21:21:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.360+0000 7f127f025700 1 -- start start 2024-05-08T21:21:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127f025700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127814fcd0 0x7f127806b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127f025700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f12780c43c0 0x7f12780cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127f025700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127806baf0 con 0x7f127806bf30 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127f025700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12780c65d0 con 0x7f12780c43c0 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127f025700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12780c2b20 con 0x7f127814fcd0 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f1277fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f12780c43c0 0x7f12780cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127cdc1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127814fcd0 0x7f127806b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127cdc1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127814fcd0 0x7f127806b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:56646/0 (socket says 172.21.15.135:56646) 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f1277fff700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f12780c43c0 0x7f12780cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:54652/0 (socket says 172.21.15.135:54652) 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.361+0000 7f127d5c2700 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f127806bf30 0x7f12780c7c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.135:41314/0 (socket says 172.21.15.135:41314) 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f127cdc1700 1 -- 172.21.15.135:0/429182807 learned_addr learned my addr 172.21.15.135:0/429182807 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f1277fff700 1 -- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127814fcd0 msgr2=0x7f127806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f1277fff700 1 --2- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127814fcd0 0x7f127806b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f1277fff700 1 -- 172.21.15.135:0/429182807 >> v1:172.21.15.183:6789/0 conn(0x7f127806bf30 legacy=0x7f12780c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f1277fff700 1 -- 172.21.15.135:0/429182807 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12780c5d30 con 0x7f12780c43c0 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f127cdc1700 1 --2- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127814fcd0 0x7f127806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f12777fe700 1 -- 172.21.15.135:0/429182807 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234374758 0 0) 0x7f127806baf0 con 0x7f127806bf30 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f1277fff700 1 --2- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12780c43c0 0x7f12780cb190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1264009840 tx=0x7f1264009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=191e5d90cca89a55 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f12777fe700 1 -- 172.21.15.135:0/429182807 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264011830 con 0x7f12780c43c0 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f12777fe700 1 -- 172.21.15.135:0/429182807 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264011990 con 0x7f12780c43c0 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.362+0000 7f12777fe700 1 -- 172.21.15.135:0/429182807 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264011d20 con 0x7f12780c43c0 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 -- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12780c43c0 msgr2=0x7f12780cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 --2- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12780c43c0 0x7f12780cb190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1264009840 tx=0x7f1264009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 -- 172.21.15.135:0/429182807 shutdown_connections 2024-05-08T21:21:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 --2- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f127814fcd0 0x7f127806b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 --2- 172.21.15.135:0/429182807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12780c43c0 0x7f12780cb190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 -- 172.21.15.135:0/429182807 >> 172.21.15.135:0/429182807 conn(0x7f127806d3e0 msgr2=0x7f127806d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 -- 172.21.15.135:0/429182807 shutdown_connections 2024-05-08T21:21:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.363+0000 7f127f025700 1 -- 172.21.15.135:0/429182807 wait complete. 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.364+0000 7f127f025700 1 Processor -- start 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.364+0000 7f127f025700 1 -- start start 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127f025700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f127806bf30 0x7f127806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127f025700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12780c43c0 0x7f1278155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127f025700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127814fcd0 0x7f1278155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127f025700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12780cb110 con 0x7f127814fcd0 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127f025700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1278154820 con 0x7f127806bf30 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127f025700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12781de7a0 con 0x7f12780c43c0 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127814fcd0 0x7f1278155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127814fcd0 0x7f1278155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53910/0 (socket says 172.21.15.135:53910) 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 -- 172.21.15.135:0/1926266623 learned_addr learned my addr 172.21.15.135:0/1926266623 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f1277fff700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12780c43c0 0x7f1278155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127cdc1700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f127806bf30 0x7f127806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 -- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12780c43c0 msgr2=0x7f1278155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12780c43c0 0x7f1278155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 -- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f127806bf30 msgr2=0x7f127806f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f127806bf30 0x7f127806f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 -- 172.21.15.135:0/1926266623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c00b7a0 con 0x7f127814fcd0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f127d5c2700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127814fcd0 0x7f1278155aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f127000cca0 tx=0x7f127000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.365+0000 7f12757fa700 1 -- 172.21.15.135:0/1926266623 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127000aad0 con 0x7f127814fcd0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.366+0000 7f12757fa700 1 -- 172.21.15.135:0/1926266623 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127000ac50 con 0x7f127814fcd0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.366+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12640094a0 con 0x7f127814fcd0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.366+0000 7f12757fa700 1 -- 172.21.15.135:0/1926266623 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12700070d0 con 0x7f127814fcd0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.366+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12780c9d60 con 0x7f127814fcd0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.367+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127814e9f0 con 0x7f127814fcd0 2024-05-08T21:21:23.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.367+0000 7f12757fa700 1 -- 172.21.15.135:0/1926266623 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1270007230 con 0x7f127814fcd0 2024-05-08T21:21:23.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.367+0000 7f12757fa700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06ac90 0x7f125c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.368+0000 7f12757fa700 1 -- 172.21.15.135:0/1926266623 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f12700893f0 con 0x7f127814fcd0 2024-05-08T21:21:23.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.368+0000 7f127cdc1700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06ac90 0x7f125c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.368+0000 7f127cdc1700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06ac90 0x7f125c06d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c00f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.372+0000 7f12757fa700 1 -- 172.21.15.135:0/1926266623 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f12700542a0 con 0x7f127814fcd0 2024-05-08T21:21:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.569+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f12780c2e00 con 0x7f125c06ac90 2024-05-08T21:21:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.569+0000 7f12757fa700 1 -- 172.21.15.135:0/1926266623 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f126c00bb50 con 0x7f125c06ac90 2024-05-08T21:21:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06ac90 msgr2=0x7f125c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06ac90 0x7f125c06d150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f126c006fd0 tx=0x7f126c00f040 comp rx=0 tx=0).stop 2024-05-08T21:21:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127814fcd0 msgr2=0x7f1278155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127814fcd0 0x7f1278155aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f127000cca0 tx=0x7f127000a060 comp rx=0 tx=0).stop 2024-05-08T21:21:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 shutdown_connections 2024-05-08T21:21:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f125c06ac90 0x7f125c06d150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f127806bf30 0x7f127806f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f127814fcd0 0x7f1278155aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 --2- 172.21.15.135:0/1926266623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12780c43c0 0x7f1278155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.571+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 >> 172.21.15.135:0/1926266623 conn(0x7f127806d3e0 msgr2=0x7f127814e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.572+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 shutdown_connections 2024-05-08T21:21:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.572+0000 7f127f025700 1 -- 172.21.15.135:0/1926266623 wait complete. 2024-05-08T21:21:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T21:21:23.586 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T21:21:23.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:21:23.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.711+0000 7fcac0968700 1 Processor -- start 2024-05-08T21:21:23.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.712+0000 7fcac0968700 1 -- start start 2024-05-08T21:21:23.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.712+0000 7fcac0968700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcabc15a800 0x7fcabc0c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.712+0000 7fcac0968700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc0c4e80 0x7fcabc06f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.712+0000 7fcac0968700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcabc06ace0 con 0x7fcabc13ceb0 2024-05-08T21:21:23.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.712+0000 7fcac0968700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcabc157210 con 0x7fcabc15a800 2024-05-08T21:21:23.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.712+0000 7fcac0968700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc15acb0 con 0x7fcabc0c4e80 2024-05-08T21:21:23.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcabad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc0c4e80 0x7fcabc06f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab9d9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcabc15a800 0x7fcabc0c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcabad9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc0c4e80 0x7fcabc06f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:56664/0 (socket says 172.21.15.135:56664) 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab9d9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcabc15a800 0x7fcabc0c4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:54668/0 (socket says 172.21.15.135:54668) 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcabad9d700 1 -- 172.21.15.135:0/1110504769 learned_addr learned my addr 172.21.15.135:0/1110504769 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab9d9b700 1 -- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc0c4e80 msgr2=0x7fcabc06f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab9d9b700 1 --2- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc0c4e80 0x7fcabc06f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab9d9b700 1 -- 172.21.15.135:0/1110504769 >> v1:172.21.15.183:6789/0 conn(0x7fcabc13ceb0 legacy=0x7fcabc157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab9d9b700 1 -- 172.21.15.135:0/1110504769 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc15af90 con 0x7fcabc15a800 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab959a700 1 -- 172.21.15.135:0/1110504769 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594512076 0 0) 0x7fcabc06ace0 con 0x7fcabc13ceb0 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcabad9d700 1 --2- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc0c4e80 0x7fcabc06f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:23.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.713+0000 7fcab9d9b700 1 --2- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc15a800 0x7fcabc0c4940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009840 tx=0x7fcaac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c5673cd8e4052ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcab959a700 1 -- 172.21.15.135:0/1110504769 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac011830 con 0x7fcabc15a800 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcab959a700 1 -- 172.21.15.135:0/1110504769 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac011990 con 0x7fcabc15a800 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcab959a700 1 -- 172.21.15.135:0/1110504769 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac011d20 con 0x7fcabc15a800 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 -- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc15a800 msgr2=0x7fcabc0c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 --2- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc15a800 0x7fcabc0c4940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009840 tx=0x7fcaac009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 -- 172.21.15.135:0/1110504769 shutdown_connections 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 --2- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc0c4e80 0x7fcabc06f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 --2- 172.21.15.135:0/1110504769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc15a800 0x7fcabc0c4940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 -- 172.21.15.135:0/1110504769 >> 172.21.15.135:0/1110504769 conn(0x7fcabc06d620 msgr2=0x7fcabc06da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 -- 172.21.15.135:0/1110504769 shutdown_connections 2024-05-08T21:21:23.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.714+0000 7fcac0968700 1 -- 172.21.15.135:0/1110504769 wait complete. 2024-05-08T21:21:23.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.715+0000 7fcac0968700 1 Processor -- start 2024-05-08T21:21:23.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcac0968700 1 -- start start 2024-05-08T21:21:23.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcac0968700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcabc0c4e80 0x7fcabc06b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcac0968700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc13ceb0 0x7fcabc1ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcac0968700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc15a800 0x7fcabc1ef280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcac0968700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc13ef40 con 0x7fcabc0c4e80 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcac0968700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc1edcf0 con 0x7fcabc13ceb0 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcac0968700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc153da0 con 0x7fcabc15a800 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcaba59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcabc0c4e80 0x7fcabc06b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcaba59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcabc0c4e80 0x7fcabc06b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53926/0 (socket says 172.21.15.135:53926) 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcaba59c700 1 -- 172.21.15.135:0/1052543356 learned_addr learned my addr 172.21.15.135:0/1052543356 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcabad9d700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc15a800 0x7fcabc1ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.716+0000 7fcab9d9b700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc13ceb0 0x7fcabc1ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaba59c700 1 -- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc15a800 msgr2=0x7fcabc1ef280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaba59c700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcabc15a800 0x7fcabc1ef280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaba59c700 1 -- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc13ceb0 msgr2=0x7fcabc1ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaba59c700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcabc13ceb0 0x7fcabc1ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaba59c700 1 -- 172.21.15.135:0/1052543356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4009b30 con 0x7fcabc0c4e80 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaba59c700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcabc0c4e80 0x7fcabc06b710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c750 tx=0x7fcab000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab00054e0 con 0x7fcabc0c4e80 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab0003680 con 0x7fcabc0c4e80 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac0094a0 con 0x7fcabc0c4e80 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab0003a30 con 0x7fcabc0c4e80 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.717+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcabc1f0d40 con 0x7fcabc0c4e80 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.718+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcabc140750 con 0x7fcabc0c4e80 2024-05-08T21:21:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.718+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcab0003b90 con 0x7fcabc0c4e80 2024-05-08T21:21:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcaaaffd700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fca9c06ac90 0x7fca9c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcab0088a90 con 0x7fcabc0c4e80 2024-05-08T21:21:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcab9d9b700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fca9c06ac90 0x7fca9c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcaaaffd700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7fca9c0744f0 0x7fca9c076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 --> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca9c077060 con 0x7fca9c0744f0 2024-05-08T21:21:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab008d2c0 con 0x7fcabc0c4e80 2024-05-08T21:21:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcabad9d700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7fca9c0744f0 0x7fca9c076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.719+0000 7fcab9d9b700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fca9c06ac90 0x7fca9c06d150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcabc15abe0 tx=0x7fcaac01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.720+0000 7fcabad9d700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7fca9c0744f0 0x7fca9c076990 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.720+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== osd.7 v2:172.21.15.183:6808/47309 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fca9c077060 con 0x7fca9c0744f0 2024-05-08T21:21:23.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.735+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 --> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcabc157400 con 0x7fca9c0744f0 2024-05-08T21:21:23.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.735+0000 7fcaaaffd700 1 -- 172.21.15.135:0/1052543356 <== osd.7 v2:172.21.15.183:6808/47309 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcab400f040 con 0x7fca9c0744f0 2024-05-08T21:21:23.739 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-05-08T21:21:23.739 INFO:teuthology.orchestra.run.smithi135.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:21:23.739 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-05-08T21:21:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7fca9c0744f0 msgr2=0x7fca9c076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.183:6808/47309,v1:172.21.15.183:6809/47309] conn(0x7fca9c0744f0 0x7fca9c076990 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fca9c06ac90 msgr2=0x7fca9c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fca9c06ac90 0x7fca9c06d150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcabc15abe0 tx=0x7fcaac01c040 comp rx=0 tx=0).stop 2024-05-08T21:21:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcabc0c4e80 msgr2=0x7fcabc06b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 --2- 172.21.15.135:0/1052543356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcabc0c4e80 0x7fcabc06b710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c750 tx=0x7fcab000ca60 comp rx=0 tx=0).stop 2024-05-08T21:21:23.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcabad9d700 1 -- 172.21.15.135:0/1052543356 reap_dead start 2024-05-08T21:21:23.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 shutdown_connections 2024-05-08T21:21:23.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 >> 172.21.15.135:0/1052543356 conn(0x7fcabc06d620 msgr2=0x7fcabc157820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 shutdown_connections 2024-05-08T21:21:23.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.736+0000 7fcac0968700 1 -- 172.21.15.135:0/1052543356 wait complete. 2024-05-08T21:21:23.750 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T21:21:23.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.871+0000 7f8cd49c3700 1 Processor -- start 2024-05-08T21:21:23.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.871+0000 7f8cd49c3700 1 -- start start 2024-05-08T21:21:23.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.871+0000 7f8cd49c3700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cd00c8650 0x7f8cd00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cd49c3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c7590 0x7f8cd00c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cd49c3700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00c84a0 con 0x7f8cd01536d0 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cd49c3700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd0159400 con 0x7f8cd00c8650 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cd49c3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd015ce30 con 0x7f8cd00c7590 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cced9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c7590 0x7f8cd00c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccdd9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cd00c8650 0x7f8cd00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cced9d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c7590 0x7f8cd00c79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.135:56674/0 (socket says 172.21.15.135:56674) 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cced9d700 1 -- 172.21.15.135:0/3164975362 learned_addr learned my addr 172.21.15.135:0/3164975362 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccdd9b700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cd00c8650 0x7f8cd00c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.135:54694/0 (socket says 172.21.15.135:54694) 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccdd9b700 1 -- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c7590 msgr2=0x7f8cd00c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:23.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccdd9b700 1 --2- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c7590 0x7f8cd00c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccdd9b700 1 -- 172.21.15.135:0/3164975362 >> v1:172.21.15.183:6789/0 conn(0x7f8cd01536d0 legacy=0x7f8cd0159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccd59a700 1 -- 172.21.15.135:0/3164975362 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72943788 0 0) 0x7f8cd00c84a0 con 0x7f8cd01536d0 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccdd9b700 1 -- 172.21.15.135:0/3164975362 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd015d9b0 con 0x7f8cd00c8650 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8cced9d700 1 --2- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c7590 0x7f8cd00c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.872+0000 7f8ccdd9b700 1 --2- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c8650 0x7f8cd00c8e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009840 tx=0x7f8cc4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3071829a19fa2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8ccd59a700 1 -- 172.21.15.135:0/3164975362 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4011830 con 0x7f8cd00c8650 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8ccd59a700 1 -- 172.21.15.135:0/3164975362 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc4011990 con 0x7f8cd00c8650 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8ccd59a700 1 -- 172.21.15.135:0/3164975362 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4011d20 con 0x7f8cd00c8650 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c8650 msgr2=0x7f8cd00c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c8650 0x7f8cd00c8e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009840 tx=0x7f8cc4009b50 comp rx=0 tx=0).stop 2024-05-08T21:21:23.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3164975362 shutdown_connections 2024-05-08T21:21:23.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c7590 0x7f8cd00c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3164975362 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c8650 0x7f8cd00c8e50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3164975362 >> 172.21.15.135:0/3164975362 conn(0x7f8cd006a960 msgr2=0x7f8cd006ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:23.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3164975362 shutdown_connections 2024-05-08T21:21:23.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.873+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3164975362 wait complete. 2024-05-08T21:21:23.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 Processor -- start 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 -- start start 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c7590 0x7f8cd015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c8650 0x7f8cd015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd01536d0 0x7f8cd00b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b2a90 con 0x7f8cd01536d0 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0152e90 con 0x7f8cd00c7590 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cd49c3700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd01eefd0 con 0x7f8cd00c8650 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.875+0000 7f8cced9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd01536d0 0x7f8cd00b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cce59c700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c7590 0x7f8cd015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cced9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd01536d0 0x7f8cd00b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53938/0 (socket says 172.21.15.135:53938) 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cced9d700 1 -- 172.21.15.135:0/3504996716 learned_addr learned my addr 172.21.15.135:0/3504996716 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8ccdd9b700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c8650 0x7f8cd015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cce59c700 1 -- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c8650 msgr2=0x7f8cd015b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cce59c700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c8650 0x7f8cd015b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cce59c700 1 -- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd01536d0 msgr2=0x7f8cd00b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cce59c700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd01536d0 0x7f8cd00b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cce59c700 1 -- 172.21.15.135:0/3504996716 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009b30 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cced9d700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd01536d0 0x7f8cd00b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cce59c700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c7590 0x7f8cd015b360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c520 tx=0x7f8cc000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cbeffd700 1 -- 172.21.15.135:0/3504996716 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00054e0 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cbeffd700 1 -- 172.21.15.135:0/3504996716 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0003680 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc40094a0 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cbeffd700 1 -- 172.21.15.135:0/3504996716 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0003a30 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.876+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd00afe70 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.877+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd0067fa0 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.878+0000 7f8cbeffd700 1 -- 172.21.15.135:0/3504996716 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8cc0003b90 con 0x7f8cd00c7590 2024-05-08T21:21:23.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.878+0000 7f8cbeffd700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8cb006ac90 0x7f8cb006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:23.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.878+0000 7f8cbeffd700 1 -- 172.21.15.135:0/3504996716 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8cc0088e70 con 0x7f8cd00c7590 2024-05-08T21:21:23.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.878+0000 7f8ccdd9b700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8cb006ac90 0x7f8cb006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:23.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.879+0000 7f8ccdd9b700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8cb006ac90 0x7f8cb006d150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40090b0 tx=0x7f8cc4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:23.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:23.883+0000 7f8cbeffd700 1 -- 172.21.15.135:0/3504996716 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8cc0053c10 con 0x7f8cd00c7590 2024-05-08T21:21:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.078+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cd00afa10 con 0x7f8cb006ac90 2024-05-08T21:21:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.078+0000 7f8cbeffd700 1 -- 172.21.15.135:0/3504996716 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8cc4011c00 con 0x7f8cb006ac90 2024-05-08T21:21:24.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.080+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8cb006ac90 msgr2=0x7f8cb006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:24.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.080+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8cb006ac90 0x7f8cb006d150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40090b0 tx=0x7f8cc4008030 comp rx=0 tx=0).stop 2024-05-08T21:21:24.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.080+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c7590 msgr2=0x7f8cd015b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:24.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.080+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c7590 0x7f8cd015b360 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c520 tx=0x7f8cc000c830 comp rx=0 tx=0).stop 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 shutdown_connections 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f8cb006ac90 0x7f8cb006d150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cd00c7590 0x7f8cd015b360 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cd01536d0 0x7f8cd00b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 --2- 172.21.15.135:0/3504996716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cd00c8650 0x7f8cd015b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 >> 172.21.15.135:0/3504996716 conn(0x7f8cd006a960 msgr2=0x7f8cd006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 shutdown_connections 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.081+0000 7f8cd49c3700 1 -- 172.21.15.135:0/3504996716 wait complete. 2024-05-08T21:21:24.084 INFO:teuthology.orchestra.run.smithi135.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T21:21:24.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:21:24.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.216+0000 7f5e1927e700 1 Processor -- start 2024-05-08T21:21:24.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.216+0000 7f5e1927e700 1 -- start start 2024-05-08T21:21:24.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e1927e700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5e140cb5a0 0x7f5e140cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:24.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e1927e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cae30 0x7f5e140cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:24.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e1927e700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5e140ce090 0x7f5e140ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e1927e700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e140ce520 con 0x7f5e140cb5a0 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e1927e700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e14159400 con 0x7f5e140ce090 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e1927e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140cbec0 con 0x7f5e140cae30 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5e140cb5a0 0x7f5e140cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f5e140cb5a0 0x7f5e140cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53954/0 (socket says 172.21.15.135:53954) 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 -- 172.21.15.135:0/1077571796 learned_addr learned my addr 172.21.15.135:0/1077571796 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e137fe700 1 --2- 172.21.15.135:0/1077571796 >> v2:172.21.15.183:3300/0 conn(0x7f5e140ce090 0x7f5e140ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e127fc700 1 --2- 172.21.15.135:0/1077571796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cae30 0x7f5e140cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:24.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 -- 172.21.15.135:0/1077571796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cae30 msgr2=0x7f5e140cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 --2- 172.21.15.135:0/1077571796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cae30 0x7f5e140cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 -- 172.21.15.135:0/1077571796 >> v2:172.21.15.183:3300/0 conn(0x7f5e140ce090 msgr2=0x7f5e140ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 --2- 172.21.15.135:0/1077571796 >> v2:172.21.15.183:3300/0 conn(0x7f5e140ce090 0x7f5e140ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 -- 172.21.15.135:0/1077571796 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1415a220 con 0x7f5e140cb5a0 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.217+0000 7f5e12ffd700 1 --2- 172.21.15.135:0/1077571796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140cb5a0 0x7f5e140cb980 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e140ceb40 tx=0x7f5e08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f52a6af996d04e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e11ffb700 1 -- 172.21.15.135:0/1077571796 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800b870 con 0x7f5e140cb5a0 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e11ffb700 1 -- 172.21.15.135:0/1077571796 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0800b9d0 con 0x7f5e140cb5a0 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e11ffb700 1 -- 172.21.15.135:0/1077571796 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800bd60 con 0x7f5e140cb5a0 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 -- 172.21.15.135:0/1077571796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140cb5a0 msgr2=0x7f5e140cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 --2- 172.21.15.135:0/1077571796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140cb5a0 0x7f5e140cb980 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e140ceb40 tx=0x7f5e08009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 -- 172.21.15.135:0/1077571796 shutdown_connections 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 --2- 172.21.15.135:0/1077571796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140cb5a0 0x7f5e140cb980 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 --2- 172.21.15.135:0/1077571796 >> v2:172.21.15.183:3300/0 conn(0x7f5e140ce090 0x7f5e140ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 --2- 172.21.15.135:0/1077571796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cae30 0x7f5e140cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 -- 172.21.15.135:0/1077571796 >> 172.21.15.135:0/1077571796 conn(0x7f5e140726c0 msgr2=0x7f5e140ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:24.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 -- 172.21.15.135:0/1077571796 shutdown_connections 2024-05-08T21:21:24.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.218+0000 7f5e1927e700 1 -- 172.21.15.135:0/1077571796 wait complete. 2024-05-08T21:21:24.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 Processor -- start 2024-05-08T21:21:24.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 -- start start 2024-05-08T21:21:24.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e140cae30 0x7f5e140af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cb5a0 0x7f5e141f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140c42d0 0x7f5e14154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e141f2ed0 con 0x7f5e140c42d0 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e141f2c10 con 0x7f5e140cae30 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e1927e700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140c2860 con 0x7f5e140cb5a0 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e137fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140c42d0 0x7f5e14154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e137fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140c42d0 0x7f5e14154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53960/0 (socket says 172.21.15.135:53960) 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e137fe700 1 -- 172.21.15.135:0/720314000 learned_addr learned my addr 172.21.15.135:0/720314000 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.220+0000 7f5e12ffd700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e140cae30 0x7f5e140af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e127fc700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cb5a0 0x7f5e141f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e137fe700 1 -- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cb5a0 msgr2=0x7f5e141f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e137fe700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cb5a0 0x7f5e141f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e137fe700 1 -- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e140cae30 msgr2=0x7f5e140af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e137fe700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e140cae30 0x7f5e140af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e137fe700 1 -- 172.21.15.135:0/720314000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e08009550 con 0x7f5e140c42d0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e127fc700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cb5a0 0x7f5e141f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e137fe700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140c42d0 0x7f5e14154080 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009fd0 tx=0x7f5e0c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5dfb7fe700 1 -- 172.21.15.135:0/720314000 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c007ea0 con 0x7f5e140c42d0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5dfb7fe700 1 -- 172.21.15.135:0/720314000 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c00ede0 con 0x7f5e140c42d0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5dfb7fe700 1 -- 172.21.15.135:0/720314000 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c014660 con 0x7f5e140c42d0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e140c3ad0 con 0x7f5e140c42d0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.221+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e140c2b40 con 0x7f5e140c42d0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.222+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e140c3ff0 con 0x7f5e140c42d0 2024-05-08T21:21:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.222+0000 7f5dfb7fe700 1 -- 172.21.15.135:0/720314000 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e0c0147c0 con 0x7f5e140c42d0 2024-05-08T21:21:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.223+0000 7f5dfb7fe700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e0006ac90 0x7f5e0006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.223+0000 7f5dfb7fe700 1 -- 172.21.15.135:0/720314000 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e0c089df0 con 0x7f5e140c42d0 2024-05-08T21:21:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.223+0000 7f5e12ffd700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e0006ac90 0x7f5e0006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.223+0000 7f5e12ffd700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e0006ac90 0x7f5e0006d150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e08000c00 tx=0x7f5e08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.227+0000 7f5dfb7fe700 1 -- 172.21.15.135:0/720314000 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5e0c054b80 con 0x7f5e140c42d0 2024-05-08T21:21:24.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.421+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e140c2290 con 0x7f5e0006ac90 2024-05-08T21:21:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.431+0000 7f5dfb7fe700 1 -- 172.21.15.135:0/720314000 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368979 (secure 0 0 0) 0x7f5e140c2290 con 0x7f5e0006ac90 2024-05-08T21:21:24.437 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:24.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e0006ac90 msgr2=0x7f5e0006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:24.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e0006ac90 0x7f5e0006d150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e08000c00 tx=0x7f5e08008030 comp rx=0 tx=0).stop 2024-05-08T21:21:24.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140c42d0 msgr2=0x7f5e14154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:24.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140c42d0 0x7f5e14154080 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009fd0 tx=0x7f5e0c00e3c0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 shutdown_connections 2024-05-08T21:21:24.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e0006ac90 0x7f5e0006d150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e140cae30 0x7f5e140af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e140c42d0 0x7f5e14154080 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 --2- 172.21.15.135:0/720314000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e140cb5a0 0x7f5e141f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:24.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 >> 172.21.15.135:0/720314000 conn(0x7f5e140726c0 msgr2=0x7f5e14157cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:24.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 shutdown_connections 2024-05-08T21:21:24.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:24.435+0000 7f5e1927e700 1 -- 172.21.15.135:0/720314000 wait complete. 2024-05-08T21:21:24.442 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:21:24.450 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":818,"stamp":"2024-05-08T21:21:22.812613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244155444,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3047,"num_read_kb":7630,"num_write":179646,"num_write_kb":3998170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257494,"ondisk_log_size":257494,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3864680,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3385395,"kb_avail":751110040,"statfs":{"total":773094113280,"available":769136680960,"internally_reserved":0,"allocated":490708992,"data_stored":489258184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3466645049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4351876,"num_objects":-72,"num_object_clones":0,"num_object_copies":-160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-72,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":95,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002716"},"pg_stats":[{"pgid":"3.3f","version":"27'774","reported_seq":802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.361318+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T21:21:13.361318+0000","last_peered":"2024-05-08T21:21:13.361318+0000","last_clean":"2024-05-08T21:21:13.361318+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:21:13.361318+0000","last_undegraded":"2024-05-08T21:21:13.361318+0000","last_fullsized":"2024-05-08T21:21:13.361318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'772","reported_seq":800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355259+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T21:21:13.355259+0000","last_peered":"2024-05-08T21:21:13.355259+0000","last_clean":"2024-05-08T21:21:13.355259+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:13.355259+0000","last_undegraded":"2024-05-08T21:21:13.355259+0000","last_fullsized":"2024-05-08T21:21:13.355259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'862","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.354221+0000","last_change":"2024-05-08T20:55:00.089464+0000","last_active":"2024-05-08T21:21:13.354221+0000","last_peered":"2024-05-08T21:21:13.354221+0000","last_clean":"2024-05-08T21:21:13.354221+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:13.354221+0000","last_undegraded":"2024-05-08T21:21:13.354221+0000","last_fullsized":"2024-05-08T21:21:13.354221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'823","reported_seq":851,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376392+0000","last_change":"2024-05-08T20:55:00.092630+0000","last_active":"2024-05-08T21:21:13.376392+0000","last_peered":"2024-05-08T21:21:13.376392+0000","last_clean":"2024-05-08T21:21:13.376392+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:13.376392+0000","last_undegraded":"2024-05-08T21:21:13.376392+0000","last_fullsized":"2024-05-08T21:21:13.376392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'860","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.356709+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T21:21:13.356709+0000","last_peered":"2024-05-08T21:21:13.356709+0000","last_clean":"2024-05-08T21:21:13.356709+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:21:13.356709+0000","last_undegraded":"2024-05-08T21:21:13.356709+0000","last_fullsized":"2024-05-08T21:21:13.356709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'767","reported_seq":792,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.378447+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T21:21:13.378447+0000","last_peered":"2024-05-08T21:21:13.378447+0000","last_clean":"2024-05-08T21:21:13.378447+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:21:13.378447+0000","last_undegraded":"2024-05-08T21:21:13.378447+0000","last_fullsized":"2024-05-08T21:21:13.378447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'811","reported_seq":837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.345148+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T21:21:13.345148+0000","last_peered":"2024-05-08T21:21:13.345148+0000","last_clean":"2024-05-08T21:21:13.345148+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:13.345148+0000","last_undegraded":"2024-05-08T21:21:13.345148+0000","last_fullsized":"2024-05-08T21:21:13.345148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'788","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.374265+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T21:21:13.374265+0000","last_peered":"2024-05-08T21:21:13.374265+0000","last_clean":"2024-05-08T21:21:13.374265+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:13.374265+0000","last_undegraded":"2024-05-08T21:21:13.374265+0000","last_fullsized":"2024-05-08T21:21:13.374265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'846","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.374551+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T21:21:13.374551+0000","last_peered":"2024-05-08T21:21:13.374551+0000","last_clean":"2024-05-08T21:21:13.374551+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:21:13.374551+0000","last_undegraded":"2024-05-08T21:21:13.374551+0000","last_fullsized":"2024-05-08T21:21:13.374551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:02.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'809","reported_seq":834,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.363564+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T21:21:13.363564+0000","last_peered":"2024-05-08T21:21:13.363564+0000","last_clean":"2024-05-08T21:21:13.363564+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:13.363564+0000","last_undegraded":"2024-05-08T21:21:13.363564+0000","last_fullsized":"2024-05-08T21:21:13.363564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'819","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.353409+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T21:21:13.353409+0000","last_peered":"2024-05-08T21:21:13.353409+0000","last_clean":"2024-05-08T21:21:13.353409+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:13.353409+0000","last_undegraded":"2024-05-08T21:21:13.353409+0000","last_fullsized":"2024-05-08T21:21:13.353409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'794","reported_seq":821,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.363086+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T21:21:13.363086+0000","last_peered":"2024-05-08T21:21:13.363086+0000","last_clean":"2024-05-08T21:21:13.363086+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:13.363086+0000","last_undegraded":"2024-05-08T21:21:13.363086+0000","last_fullsized":"2024-05-08T21:21:13.363086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'813","reported_seq":840,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.363054+0000","last_change":"2024-05-08T20:55:00.088838+0000","last_active":"2024-05-08T21:21:13.363054+0000","last_peered":"2024-05-08T21:21:13.363054+0000","last_clean":"2024-05-08T21:21:13.363054+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:13.363054+0000","last_undegraded":"2024-05-08T21:21:13.363054+0000","last_fullsized":"2024-05-08T21:21:13.363054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'802","reported_seq":830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.354388+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T21:21:13.354388+0000","last_peered":"2024-05-08T21:21:13.354388+0000","last_clean":"2024-05-08T21:21:13.354388+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:13.354388+0000","last_undegraded":"2024-05-08T21:21:13.354388+0000","last_fullsized":"2024-05-08T21:21:13.354388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'853","reported_seq":880,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355173+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T21:21:13.355173+0000","last_peered":"2024-05-08T21:21:13.355173+0000","last_clean":"2024-05-08T21:21:13.355173+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:13.355173+0000","last_undegraded":"2024-05-08T21:21:13.355173+0000","last_fullsized":"2024-05-08T21:21:13.355173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'809","reported_seq":835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.372846+0000","last_change":"2024-05-08T20:55:00.091723+0000","last_active":"2024-05-08T21:21:13.372846+0000","last_peered":"2024-05-08T21:21:13.372846+0000","last_clean":"2024-05-08T21:21:13.372846+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:13.372846+0000","last_undegraded":"2024-05-08T21:21:13.372846+0000","last_fullsized":"2024-05-08T21:21:13.372846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'870","reported_seq":896,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376739+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T21:21:13.376739+0000","last_peered":"2024-05-08T21:21:13.376739+0000","last_clean":"2024-05-08T21:21:13.376739+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:13.376739+0000","last_undegraded":"2024-05-08T21:21:13.376739+0000","last_fullsized":"2024-05-08T21:21:13.376739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'789","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.370527+0000","last_change":"2024-05-08T20:55:00.081101+0000","last_active":"2024-05-08T21:21:13.370527+0000","last_peered":"2024-05-08T21:21:13.370527+0000","last_clean":"2024-05-08T21:21:13.370527+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:13.370527+0000","last_undegraded":"2024-05-08T21:21:13.370527+0000","last_fullsized":"2024-05-08T21:21:13.370527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'839","reported_seq":866,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355944+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T21:21:13.355944+0000","last_peered":"2024-05-08T21:21:13.355944+0000","last_clean":"2024-05-08T21:21:13.355944+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:21:13.355944+0000","last_undegraded":"2024-05-08T21:21:13.355944+0000","last_fullsized":"2024-05-08T21:21:13.355944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:32.803561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3810,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.883056+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T21:21:06.883056+0000","last_peered":"2024-05-08T21:21:06.883056+0000","last_clean":"2024-05-08T21:21:06.883056+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:21:06.883056+0000","last_undegraded":"2024-05-08T21:21:06.883056+0000","last_fullsized":"2024-05-08T21:21:06.883056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1868","reported_seq":1898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.875614+0000","last_change":"2024-05-08T20:54:59.627448+0000","last_active":"2024-05-08T21:21:06.875614+0000","last_peered":"2024-05-08T21:21:06.875614+0000","last_clean":"2024-05-08T21:21:06.875614+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:06.875614+0000","last_undegraded":"2024-05-08T21:21:06.875614+0000","last_fullsized":"2024-05-08T21:21:06.875614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1868,"log_dups_size":0,"ondisk_log_size":1868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'809","reported_seq":839,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.358490+0000","last_change":"2024-05-08T20:55:00.085388+0000","last_active":"2024-05-08T21:21:13.358490+0000","last_peered":"2024-05-08T21:21:13.358490+0000","last_clean":"2024-05-08T21:21:13.358490+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:13.358490+0000","last_undegraded":"2024-05-08T21:21:13.358490+0000","last_fullsized":"2024-05-08T21:21:13.358490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.900786+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T21:21:06.900786+0000","last_peered":"2024-05-08T21:21:06.900786+0000","last_clean":"2024-05-08T21:21:06.900786+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:06.900786+0000","last_undegraded":"2024-05-08T21:21:06.900786+0000","last_fullsized":"2024-05-08T21:21:06.900786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4025","reported_seq":4056,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786233+0000","last_change":"2024-05-08T20:54:59.628054+0000","last_active":"2024-05-08T21:21:07.786233+0000","last_peered":"2024-05-08T21:21:07.786233+0000","last_clean":"2024-05-08T21:21:07.786233+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:07.786233+0000","last_undegraded":"2024-05-08T21:21:07.786233+0000","last_fullsized":"2024-05-08T21:21:07.786233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4025,"log_dups_size":0,"ondisk_log_size":4025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'779","reported_seq":808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.364840+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T21:21:13.364840+0000","last_peered":"2024-05-08T21:21:13.364840+0000","last_clean":"2024-05-08T21:21:13.364840+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:13.364840+0000","last_undegraded":"2024-05-08T21:21:13.364840+0000","last_fullsized":"2024-05-08T21:21:13.364840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3657,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.912070+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T21:21:06.912070+0000","last_peered":"2024-05-08T21:21:06.912070+0000","last_clean":"2024-05-08T21:21:06.912070+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:21:06.912070+0000","last_undegraded":"2024-05-08T21:21:06.912070+0000","last_fullsized":"2024-05-08T21:21:06.912070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4862","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795131+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T21:21:07.795131+0000","last_peered":"2024-05-08T21:21:07.795131+0000","last_clean":"2024-05-08T21:21:07.795131+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:07.795131+0000","last_undegraded":"2024-05-08T21:21:07.795131+0000","last_fullsized":"2024-05-08T21:21:07.795131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4862,"log_dups_size":0,"ondisk_log_size":4862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'861","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376085+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T21:21:13.376085+0000","last_peered":"2024-05-08T21:21:13.376085+0000","last_clean":"2024-05-08T21:21:13.376085+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:21:13.376085+0000","last_undegraded":"2024-05-08T21:21:13.376085+0000","last_fullsized":"2024-05-08T21:21:13.376085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:01.351290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.857628+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T21:21:06.857628+0000","last_peered":"2024-05-08T21:21:06.857628+0000","last_clean":"2024-05-08T21:21:06.857628+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:06.857628+0000","last_undegraded":"2024-05-08T21:21:06.857628+0000","last_fullsized":"2024-05-08T21:21:06.857628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1175","reported_seq":1202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.868441+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T21:21:06.868441+0000","last_peered":"2024-05-08T21:21:06.868441+0000","last_clean":"2024-05-08T21:21:06.868441+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:06.868441+0000","last_undegraded":"2024-05-08T21:21:06.868441+0000","last_fullsized":"2024-05-08T21:21:06.868441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:59.463636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'834","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.375861+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T21:21:13.375861+0000","last_peered":"2024-05-08T21:21:13.375861+0000","last_clean":"2024-05-08T21:21:13.375861+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:21:13.375861+0000","last_undegraded":"2024-05-08T21:21:13.375861+0000","last_fullsized":"2024-05-08T21:21:13.375861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.827198+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T21:21:06.827198+0000","last_peered":"2024-05-08T21:21:06.827198+0000","last_clean":"2024-05-08T21:21:06.827198+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:21:06.827198+0000","last_undegraded":"2024-05-08T21:21:06.827198+0000","last_fullsized":"2024-05-08T21:21:06.827198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2315","reported_seq":2343,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786727+0000","last_change":"2024-05-08T20:54:59.629246+0000","last_active":"2024-05-08T21:21:07.786727+0000","last_peered":"2024-05-08T21:21:07.786727+0000","last_clean":"2024-05-08T21:21:07.786727+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:07.786727+0000","last_undegraded":"2024-05-08T21:21:07.786727+0000","last_fullsized":"2024-05-08T21:21:07.786727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'829","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.344829+0000","last_change":"2024-05-08T20:55:00.074681+0000","last_active":"2024-05-08T21:21:13.344829+0000","last_peered":"2024-05-08T21:21:13.344829+0000","last_clean":"2024-05-08T21:21:13.344829+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:13.344829+0000","last_undegraded":"2024-05-08T21:21:13.344829+0000","last_fullsized":"2024-05-08T21:21:13.344829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.906008+0000","last_change":"2024-05-08T20:55:04.110241+0000","last_active":"2024-05-08T21:21:06.906008+0000","last_peered":"2024-05-08T21:21:06.906008+0000","last_clean":"2024-05-08T21:21:06.906008+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:06.906008+0000","last_undegraded":"2024-05-08T21:21:06.906008+0000","last_fullsized":"2024-05-08T21:21:06.906008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4376","reported_seq":4402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.789539+0000","last_change":"2024-05-08T20:54:59.630303+0000","last_active":"2024-05-08T21:21:07.789539+0000","last_peered":"2024-05-08T21:21:07.789539+0000","last_clean":"2024-05-08T21:21:07.789539+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:07.789539+0000","last_undegraded":"2024-05-08T21:21:07.789539+0000","last_fullsized":"2024-05-08T21:21:07.789539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4376,"log_dups_size":0,"ondisk_log_size":4376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'818","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.365778+0000","last_change":"2024-05-08T20:55:00.093636+0000","last_active":"2024-05-08T21:21:13.365778+0000","last_peered":"2024-05-08T21:21:13.365778+0000","last_clean":"2024-05-08T21:21:13.365778+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:13.365778+0000","last_undegraded":"2024-05-08T21:21:13.365778+0000","last_fullsized":"2024-05-08T21:21:13.365778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3635,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.796652+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T21:21:06.796652+0000","last_peered":"2024-05-08T21:21:06.796652+0000","last_clean":"2024-05-08T21:21:06.796652+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:21:06.796652+0000","last_undegraded":"2024-05-08T21:21:06.796652+0000","last_fullsized":"2024-05-08T21:21:06.796652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:39.362088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1715","reported_seq":1743,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.791674+0000","last_change":"2024-05-08T20:54:59.630424+0000","last_active":"2024-05-08T21:21:07.791674+0000","last_peered":"2024-05-08T21:21:07.791674+0000","last_clean":"2024-05-08T21:21:07.791674+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:07.791674+0000","last_undegraded":"2024-05-08T21:21:07.791674+0000","last_fullsized":"2024-05-08T21:21:07.791674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1715,"log_dups_size":0,"ondisk_log_size":1715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'881","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.370745+0000","last_change":"2024-05-08T20:55:00.086595+0000","last_active":"2024-05-08T21:21:13.370745+0000","last_peered":"2024-05-08T21:21:13.370745+0000","last_clean":"2024-05-08T21:21:13.370745+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:13.370745+0000","last_undegraded":"2024-05-08T21:21:13.370745+0000","last_fullsized":"2024-05-08T21:21:13.370745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:11.837755+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T21:21:11.837755+0000","last_peered":"2024-05-08T21:21:11.837755+0000","last_clean":"2024-05-08T21:21:11.837755+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:11.837755+0000","last_undegraded":"2024-05-08T21:21:11.837755+0000","last_fullsized":"2024-05-08T21:21:11.837755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5269","reported_seq":5295,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:19:12.598466+0000","last_change":"2024-05-08T20:54:59.629730+0000","last_active":"2024-05-08T21:19:12.598466+0000","last_peered":"2024-05-08T21:19:12.598466+0000","last_clean":"2024-05-08T21:19:12.598466+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:19:12.598466+0000","last_undegraded":"2024-05-08T21:19:12.598466+0000","last_fullsized":"2024-05-08T21:19:12.598466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5269,"log_dups_size":0,"ondisk_log_size":5269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:43:01.905407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'827","reported_seq":853,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.352668+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T21:21:13.352668+0000","last_peered":"2024-05-08T21:21:13.352668+0000","last_clean":"2024-05-08T21:21:13.352668+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:13.352668+0000","last_undegraded":"2024-05-08T21:21:13.352668+0000","last_fullsized":"2024-05-08T21:21:13.352668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860335+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T21:21:06.860335+0000","last_peered":"2024-05-08T21:21:06.860335+0000","last_clean":"2024-05-08T21:21:06.860335+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:21:06.860335+0000","last_undegraded":"2024-05-08T21:21:06.860335+0000","last_fullsized":"2024-05-08T21:21:06.860335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2690","reported_seq":3287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.775848+0000","last_change":"2024-05-08T20:54:59.630798+0000","last_active":"2024-05-08T21:21:13.775848+0000","last_peered":"2024-05-08T21:21:13.775848+0000","last_clean":"2024-05-08T21:21:13.775848+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:13.775848+0000","last_undegraded":"2024-05-08T21:21:13.775848+0000","last_fullsized":"2024-05-08T21:21:13.775848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2690,"log_dups_size":0,"ondisk_log_size":2690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1795,"num_write":2691,"num_write_kb":19159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'812","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.353987+0000","last_change":"2024-05-08T20:55:41.598425+0000","last_active":"2024-05-08T21:21:13.353987+0000","last_peered":"2024-05-08T21:21:13.353987+0000","last_clean":"2024-05-08T21:21:13.353987+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:13.353987+0000","last_undegraded":"2024-05-08T21:21:13.353987+0000","last_fullsized":"2024-05-08T21:21:13.353987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.707397+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T21:21:05.707397+0000","last_peered":"2024-05-08T21:21:05.707397+0000","last_clean":"2024-05-08T21:21:05.707397+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:05.707397+0000","last_undegraded":"2024-05-08T21:21:05.707397+0000","last_fullsized":"2024-05-08T21:21:05.707397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3354","reported_seq":3380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.826855+0000","last_change":"2024-05-08T20:54:59.630408+0000","last_active":"2024-05-08T21:21:06.826855+0000","last_peered":"2024-05-08T21:21:06.826855+0000","last_clean":"2024-05-08T21:21:06.826855+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:06.826855+0000","last_undegraded":"2024-05-08T21:21:06.826855+0000","last_fullsized":"2024-05-08T21:21:06.826855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3354,"log_dups_size":0,"ondisk_log_size":3354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:19.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'825","reported_seq":852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.364900+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T21:21:13.364900+0000","last_peered":"2024-05-08T21:21:13.364900+0000","last_clean":"2024-05-08T21:21:13.364900+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:13.364900+0000","last_undegraded":"2024-05-08T21:21:13.364900+0000","last_fullsized":"2024-05-08T21:21:13.364900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.795848+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T21:21:06.795848+0000","last_peered":"2024-05-08T21:21:06.795848+0000","last_clean":"2024-05-08T21:21:06.795848+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:21:06.795848+0000","last_undegraded":"2024-05-08T21:21:06.795848+0000","last_fullsized":"2024-05-08T21:21:06.795848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4047","reported_seq":4074,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.784405+0000","last_change":"2024-05-08T20:54:59.628070+0000","last_active":"2024-05-08T21:21:13.784405+0000","last_peered":"2024-05-08T21:21:13.784405+0000","last_clean":"2024-05-08T21:21:13.784405+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:13.784405+0000","last_undegraded":"2024-05-08T21:21:13.784405+0000","last_fullsized":"2024-05-08T21:21:13.784405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4056,"num_write_kb":23095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'833","reported_seq":861,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.372193+0000","last_change":"2024-05-08T20:55:00.092968+0000","last_active":"2024-05-08T21:21:13.372193+0000","last_peered":"2024-05-08T21:21:13.372193+0000","last_clean":"2024-05-08T21:21:13.372193+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:13.372193+0000","last_undegraded":"2024-05-08T21:21:13.372193+0000","last_fullsized":"2024-05-08T21:21:13.372193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.837729+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T21:21:06.837729+0000","last_peered":"2024-05-08T21:21:06.837729+0000","last_clean":"2024-05-08T21:21:06.837729+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:21:06.837729+0000","last_undegraded":"2024-05-08T21:21:06.837729+0000","last_fullsized":"2024-05-08T21:21:06.837729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4547","reported_seq":4574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.852319+0000","last_change":"2024-05-08T20:54:59.631018+0000","last_active":"2024-05-08T21:21:06.852319+0000","last_peered":"2024-05-08T21:21:06.852319+0000","last_clean":"2024-05-08T21:21:06.852319+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:06.852319+0000","last_undegraded":"2024-05-08T21:21:06.852319+0000","last_fullsized":"2024-05-08T21:21:06.852319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'805","reported_seq":831,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.353365+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T21:21:13.353365+0000","last_peered":"2024-05-08T21:21:13.353365+0000","last_clean":"2024-05-08T21:21:13.353365+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:21:13.353365+0000","last_undegraded":"2024-05-08T21:21:13.353365+0000","last_fullsized":"2024-05-08T21:21:13.353365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3306,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.897454+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T21:21:06.897454+0000","last_peered":"2024-05-08T21:21:06.897454+0000","last_clean":"2024-05-08T21:21:06.897454+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:21:06.897454+0000","last_undegraded":"2024-05-08T21:21:06.897454+0000","last_fullsized":"2024-05-08T21:21:06.897454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:27.883069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2511","reported_seq":2551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.046929+0000","last_change":"2024-05-08T21:21:21.047050+0000","last_active":"2024-05-08T21:21:21.046929+0000","last_peered":"2024-05-08T21:21:21.046929+0000","last_clean":"2024-05-08T21:21:21.046929+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:21.046929+0000","last_undegraded":"2024-05-08T21:21:21.046929+0000","last_fullsized":"2024-05-08T21:21:21.046929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2511","last_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_deep_scrub":"27'2511","last_deep_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.046889+0000","objects_scrubbed":3,"log_size":2511,"log_dups_size":0,"ondisk_log_size":2511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:40.172844+0000","scrub_duration":0.017442593999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'800","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.529060+0000","last_change":"2024-05-08T20:55:41.595254+0000","last_active":"2024-05-08T21:21:21.529060+0000","last_peered":"2024-05-08T21:21:21.529060+0000","last_clean":"2024-05-08T21:21:21.529060+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:21.529060+0000","last_undegraded":"2024-05-08T21:21:21.529060+0000","last_fullsized":"2024-05-08T21:21:21.529060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3428,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.562677+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T21:21:05.562677+0000","last_peered":"2024-05-08T21:21:05.562677+0000","last_clean":"2024-05-08T21:21:05.562677+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:21:05.562677+0000","last_undegraded":"2024-05-08T21:21:05.562677+0000","last_fullsized":"2024-05-08T21:21:05.562677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788155+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T21:21:07.788155+0000","last_peered":"2024-05-08T21:21:07.788155+0000","last_clean":"2024-05-08T21:21:07.788155+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:07.788155+0000","last_undegraded":"2024-05-08T21:21:07.788155+0000","last_fullsized":"2024-05-08T21:21:07.788155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'834","reported_seq":861,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.365902+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T21:21:13.365902+0000","last_peered":"2024-05-08T21:21:13.365902+0000","last_clean":"2024-05-08T21:21:13.365902+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:13.365902+0000","last_undegraded":"2024-05-08T21:21:13.365902+0000","last_fullsized":"2024-05-08T21:21:13.365902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:59.267813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3550,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.901769+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T21:21:06.901769+0000","last_peered":"2024-05-08T21:21:06.901769+0000","last_clean":"2024-05-08T21:21:06.901769+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:21:06.901769+0000","last_undegraded":"2024-05-08T21:21:06.901769+0000","last_fullsized":"2024-05-08T21:21:06.901769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1099","reported_seq":1126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794753+0000","last_change":"2024-05-08T20:54:59.627221+0000","last_active":"2024-05-08T21:21:07.794753+0000","last_peered":"2024-05-08T21:21:07.794753+0000","last_clean":"2024-05-08T21:21:07.794753+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:07.794753+0000","last_undegraded":"2024-05-08T21:21:07.794753+0000","last_fullsized":"2024-05-08T21:21:07.794753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1099,"log_dups_size":0,"ondisk_log_size":1099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'819","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.359686+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T21:21:13.359686+0000","last_peered":"2024-05-08T21:21:13.359686+0000","last_clean":"2024-05-08T21:21:13.359686+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:13.359686+0000","last_undegraded":"2024-05-08T21:21:13.359686+0000","last_fullsized":"2024-05-08T21:21:13.359686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:34:24.991472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.850349+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T21:21:06.850349+0000","last_peered":"2024-05-08T21:21:06.850349+0000","last_clean":"2024-05-08T21:21:06.850349+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:21:06.850349+0000","last_undegraded":"2024-05-08T21:21:06.850349+0000","last_fullsized":"2024-05-08T21:21:06.850349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1824","reported_seq":1853,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795948+0000","last_change":"2024-05-08T20:54:59.620063+0000","last_active":"2024-05-08T21:21:07.795948+0000","last_peered":"2024-05-08T21:21:07.795948+0000","last_clean":"2024-05-08T21:21:07.795948+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:07.795948+0000","last_undegraded":"2024-05-08T21:21:07.795948+0000","last_fullsized":"2024-05-08T21:21:07.795948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'858","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355433+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T21:21:13.355433+0000","last_peered":"2024-05-08T21:21:13.355433+0000","last_clean":"2024-05-08T21:21:13.355433+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:13.355433+0000","last_undegraded":"2024-05-08T21:21:13.355433+0000","last_fullsized":"2024-05-08T21:21:13.355433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:39:24.250135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.752726+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T21:21:07.752726+0000","last_peered":"2024-05-08T21:21:07.752726+0000","last_clean":"2024-05-08T21:21:07.752726+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:21:07.752726+0000","last_undegraded":"2024-05-08T21:21:07.752726+0000","last_fullsized":"2024-05-08T21:21:07.752726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1830","reported_seq":1859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.877565+0000","last_change":"2024-05-08T20:54:59.626418+0000","last_active":"2024-05-08T21:21:06.877565+0000","last_peered":"2024-05-08T21:21:06.877565+0000","last_clean":"2024-05-08T21:21:06.877565+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:06.877565+0000","last_undegraded":"2024-05-08T21:21:06.877565+0000","last_fullsized":"2024-05-08T21:21:06.877565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'841","reported_seq":868,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.351187+0000","last_change":"2024-05-08T20:55:00.095238+0000","last_active":"2024-05-08T21:21:13.351187+0000","last_peered":"2024-05-08T21:21:13.351187+0000","last_clean":"2024-05-08T21:21:13.351187+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:13.351187+0000","last_undegraded":"2024-05-08T21:21:13.351187+0000","last_fullsized":"2024-05-08T21:21:13.351187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4242,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860298+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T21:21:06.860298+0000","last_peered":"2024-05-08T21:21:06.860298+0000","last_clean":"2024-05-08T21:21:06.860298+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:06.860298+0000","last_undegraded":"2024-05-08T21:21:06.860298+0000","last_fullsized":"2024-05-08T21:21:06.860298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1214","reported_seq":1243,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786558+0000","last_change":"2024-05-08T20:54:59.625389+0000","last_active":"2024-05-08T21:21:07.786558+0000","last_peered":"2024-05-08T21:21:07.786558+0000","last_clean":"2024-05-08T21:21:07.786558+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:07.786558+0000","last_undegraded":"2024-05-08T21:21:07.786558+0000","last_fullsized":"2024-05-08T21:21:07.786558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1214,"log_dups_size":0,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'822","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.373555+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T21:21:13.373555+0000","last_peered":"2024-05-08T21:21:13.373555+0000","last_clean":"2024-05-08T21:21:13.373555+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:13.373555+0000","last_undegraded":"2024-05-08T21:21:13.373555+0000","last_fullsized":"2024-05-08T21:21:13.373555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:44.877201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3510,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.878575+0000","last_change":"2024-05-08T20:55:41.599810+0000","last_active":"2024-05-08T21:21:06.878575+0000","last_peered":"2024-05-08T21:21:06.878575+0000","last_clean":"2024-05-08T21:21:06.878575+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:21:06.878575+0000","last_undegraded":"2024-05-08T21:21:06.878575+0000","last_fullsized":"2024-05-08T21:21:06.878575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:59.058826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5319","reported_seq":5347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.384196+0000","last_change":"2024-05-08T20:54:59.628449+0000","last_active":"2024-05-08T21:21:13.384196+0000","last_peered":"2024-05-08T21:21:13.384196+0000","last_clean":"2024-05-08T21:21:13.384196+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:13.384196+0000","last_undegraded":"2024-05-08T21:21:13.384196+0000","last_fullsized":"2024-05-08T21:21:13.384196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":5319,"log_dups_size":0,"ondisk_log_size":5319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007490,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5317,"num_write_kb":42298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'815","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.361004+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T21:21:13.361004+0000","last_peered":"2024-05-08T21:21:13.361004+0000","last_clean":"2024-05-08T21:21:13.361004+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:13.361004+0000","last_undegraded":"2024-05-08T21:21:13.361004+0000","last_fullsized":"2024-05-08T21:21:13.361004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3418","reported_seq":3445,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.781158+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T21:21:13.781158+0000","last_peered":"2024-05-08T21:21:13.781158+0000","last_clean":"2024-05-08T21:21:13.781158+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:21:13.781158+0000","last_undegraded":"2024-05-08T21:21:13.781158+0000","last_fullsized":"2024-05-08T21:21:13.781158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'844","reported_seq":873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.356331+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T21:21:13.356331+0000","last_peered":"2024-05-08T21:21:13.356331+0000","last_clean":"2024-05-08T21:21:13.356331+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:13.356331+0000","last_undegraded":"2024-05-08T21:21:13.356331+0000","last_fullsized":"2024-05-08T21:21:13.356331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6334,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.786162+0000","last_change":"2024-05-08T20:54:59.626780+0000","last_active":"2024-05-08T21:21:07.786162+0000","last_peered":"2024-05-08T21:21:07.786162+0000","last_clean":"2024-05-08T21:21:07.786162+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:07.786162+0000","last_undegraded":"2024-05-08T21:21:07.786162+0000","last_fullsized":"2024-05-08T21:21:07.786162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.675819+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T21:21:05.675819+0000","last_peered":"2024-05-08T21:21:05.675819+0000","last_clean":"2024-05-08T21:21:05.675819+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:21:05.675819+0000","last_undegraded":"2024-05-08T21:21:05.675819+0000","last_fullsized":"2024-05-08T21:21:05.675819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:02.277653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'844","reported_seq":867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376174+0000","last_change":"2024-05-08T20:55:41.599436+0000","last_active":"2024-05-08T21:21:13.376174+0000","last_peered":"2024-05-08T21:21:13.376174+0000","last_clean":"2024-05-08T21:21:13.376174+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:13.376174+0000","last_undegraded":"2024-05-08T21:21:13.376174+0000","last_fullsized":"2024-05-08T21:21:13.376174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2354","reported_seq":2382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.817404+0000","last_change":"2024-05-08T20:54:59.625320+0000","last_active":"2024-05-08T21:21:06.817404+0000","last_peered":"2024-05-08T21:21:06.817404+0000","last_clean":"2024-05-08T21:21:06.817404+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:06.817404+0000","last_undegraded":"2024-05-08T21:21:06.817404+0000","last_fullsized":"2024-05-08T21:21:06.817404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2354,"log_dups_size":0,"ondisk_log_size":2354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:18:52.697136+0000","last_change":"2024-05-08T20:54:49.752948+0000","last_active":"2024-05-08T21:18:52.697136+0000","last_peered":"2024-05-08T21:18:52.697136+0000","last_clean":"2024-05-08T21:18:52.697136+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:18:52.697136+0000","last_undegraded":"2024-05-08T21:18:52.697136+0000","last_fullsized":"2024-05-08T21:18:52.697136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:48.550973+0000","last_clean_scrub_stamp":"2024-05-08T20:54:48.550973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:14.791435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.894977+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T21:21:06.894977+0000","last_peered":"2024-05-08T21:21:06.894977+0000","last_clean":"2024-05-08T21:21:06.894977+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:21:06.894977+0000","last_undegraded":"2024-05-08T21:21:06.894977+0000","last_fullsized":"2024-05-08T21:21:06.894977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'788","reported_seq":817,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.356037+0000","last_change":"2024-05-08T20:55:00.093451+0000","last_active":"2024-05-08T21:21:13.356037+0000","last_peered":"2024-05-08T21:21:13.356037+0000","last_clean":"2024-05-08T21:21:13.356037+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:13.356037+0000","last_undegraded":"2024-05-08T21:21:13.356037+0000","last_fullsized":"2024-05-08T21:21:13.356037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4039","reported_seq":4069,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.907119+0000","last_change":"2024-05-08T20:54:59.633178+0000","last_active":"2024-05-08T21:21:06.907119+0000","last_peered":"2024-05-08T21:21:06.907119+0000","last_clean":"2024-05-08T21:21:06.907119+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:06.907119+0000","last_undegraded":"2024-05-08T21:21:06.907119+0000","last_fullsized":"2024-05-08T21:21:06.907119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4039,"log_dups_size":0,"ondisk_log_size":4039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:13.541701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.839732+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T21:21:06.839732+0000","last_peered":"2024-05-08T21:21:06.839732+0000","last_clean":"2024-05-08T21:21:06.839732+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:21:06.839732+0000","last_undegraded":"2024-05-08T21:21:06.839732+0000","last_fullsized":"2024-05-08T21:21:06.839732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2955","reported_seq":2984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.785687+0000","last_change":"2024-05-08T20:54:59.634065+0000","last_active":"2024-05-08T21:21:07.785687+0000","last_peered":"2024-05-08T21:21:07.785687+0000","last_clean":"2024-05-08T21:21:07.785687+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:07.785687+0000","last_undegraded":"2024-05-08T21:21:07.785687+0000","last_fullsized":"2024-05-08T21:21:07.785687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":0,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:20:59.130482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'839","reported_seq":867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355150+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T21:21:13.355150+0000","last_peered":"2024-05-08T21:21:13.355150+0000","last_clean":"2024-05-08T21:21:13.355150+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:13.355150+0000","last_undegraded":"2024-05-08T21:21:13.355150+0000","last_fullsized":"2024-05-08T21:21:13.355150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3594,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:12.638800+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T21:21:12.638800+0000","last_peered":"2024-05-08T21:21:12.638800+0000","last_clean":"2024-05-08T21:21:12.638800+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:12.638800+0000","last_undegraded":"2024-05-08T21:21:12.638800+0000","last_fullsized":"2024-05-08T21:21:12.638800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2158","reported_seq":2187,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:18.300059+0000","last_change":"2024-05-08T20:54:59.629971+0000","last_active":"2024-05-08T21:21:18.300059+0000","last_peered":"2024-05-08T21:21:18.300059+0000","last_clean":"2024-05-08T21:21:18.300059+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:18.300059+0000","last_undegraded":"2024-05-08T21:21:18.300059+0000","last_fullsized":"2024-05-08T21:21:18.300059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2158,"log_dups_size":0,"ondisk_log_size":2158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2748,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'779","reported_seq":808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.351509+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T21:21:13.351509+0000","last_peered":"2024-05-08T21:21:13.351509+0000","last_clean":"2024-05-08T21:21:13.351509+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:13.351509+0000","last_undegraded":"2024-05-08T21:21:13.351509+0000","last_fullsized":"2024-05-08T21:21:13.351509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.815210+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T21:21:06.815210+0000","last_peered":"2024-05-08T21:21:06.815210+0000","last_clean":"2024-05-08T21:21:06.815210+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:06.815210+0000","last_undegraded":"2024-05-08T21:21:06.815210+0000","last_fullsized":"2024-05-08T21:21:06.815210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1265","reported_seq":1293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.792632+0000","last_change":"2024-05-08T20:54:59.631598+0000","last_active":"2024-05-08T21:21:07.792632+0000","last_peered":"2024-05-08T21:21:07.792632+0000","last_clean":"2024-05-08T21:21:07.792632+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:07.792632+0000","last_undegraded":"2024-05-08T21:21:07.792632+0000","last_fullsized":"2024-05-08T21:21:07.792632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:25.214809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'819","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.354539+0000","last_change":"2024-05-08T20:55:00.087216+0000","last_active":"2024-05-08T21:21:13.354539+0000","last_peered":"2024-05-08T21:21:13.354539+0000","last_clean":"2024-05-08T21:21:13.354539+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:13.354539+0000","last_undegraded":"2024-05-08T21:21:13.354539+0000","last_fullsized":"2024-05-08T21:21:13.354539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.902899+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T21:21:06.902899+0000","last_peered":"2024-05-08T21:21:06.902899+0000","last_clean":"2024-05-08T21:21:06.902899+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:21:06.902899+0000","last_undegraded":"2024-05-08T21:21:06.902899+0000","last_fullsized":"2024-05-08T21:21:06.902899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1126","reported_seq":1155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788639+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T21:21:07.788639+0000","last_peered":"2024-05-08T21:21:07.788639+0000","last_clean":"2024-05-08T21:21:07.788639+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:07.788639+0000","last_undegraded":"2024-05-08T21:21:07.788639+0000","last_fullsized":"2024-05-08T21:21:07.788639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:45:10.894027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'839","reported_seq":868,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.354663+0000","last_change":"2024-05-08T20:55:00.075514+0000","last_active":"2024-05-08T21:21:13.354663+0000","last_peered":"2024-05-08T21:21:13.354663+0000","last_clean":"2024-05-08T21:21:13.354663+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:13.354663+0000","last_undegraded":"2024-05-08T21:21:13.354663+0000","last_fullsized":"2024-05-08T21:21:13.354663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3495,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.906857+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T21:21:06.906857+0000","last_peered":"2024-05-08T21:21:06.906857+0000","last_clean":"2024-05-08T21:21:06.906857+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:06.906857+0000","last_undegraded":"2024-05-08T21:21:06.906857+0000","last_fullsized":"2024-05-08T21:21:06.906857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2225","reported_seq":2254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.791732+0000","last_change":"2024-05-08T20:54:59.622445+0000","last_active":"2024-05-08T21:21:07.791732+0000","last_peered":"2024-05-08T21:21:07.791732+0000","last_clean":"2024-05-08T21:21:07.791732+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:07.791732+0000","last_undegraded":"2024-05-08T21:21:07.791732+0000","last_fullsized":"2024-05-08T21:21:07.791732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'888","reported_seq":917,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.367596+0000","last_change":"2024-05-08T20:55:00.090505+0000","last_active":"2024-05-08T21:21:13.367596+0000","last_peered":"2024-05-08T21:21:13.367596+0000","last_clean":"2024-05-08T21:21:13.367596+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:13.367596+0000","last_undegraded":"2024-05-08T21:21:13.367596+0000","last_fullsized":"2024-05-08T21:21:13.367596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3782,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.718996+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T21:21:05.718996+0000","last_peered":"2024-05-08T21:21:05.718996+0000","last_clean":"2024-05-08T21:21:05.718996+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:05.718996+0000","last_undegraded":"2024-05-08T21:21:05.718996+0000","last_fullsized":"2024-05-08T21:21:05.718996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3678","reported_seq":3707,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.790534+0000","last_change":"2024-05-08T20:54:59.623734+0000","last_active":"2024-05-08T21:21:07.790534+0000","last_peered":"2024-05-08T21:21:07.790534+0000","last_clean":"2024-05-08T21:21:07.790534+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:07.790534+0000","last_undegraded":"2024-05-08T21:21:07.790534+0000","last_fullsized":"2024-05-08T21:21:07.790534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'844","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.361184+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T21:21:13.361184+0000","last_peered":"2024-05-08T21:21:13.361184+0000","last_clean":"2024-05-08T21:21:13.361184+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:13.361184+0000","last_undegraded":"2024-05-08T21:21:13.361184+0000","last_fullsized":"2024-05-08T21:21:13.361184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3513,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714703+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T21:21:05.714703+0000","last_peered":"2024-05-08T21:21:05.714703+0000","last_clean":"2024-05-08T21:21:05.714703+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:21:05.714703+0000","last_undegraded":"2024-05-08T21:21:05.714703+0000","last_fullsized":"2024-05-08T21:21:05.714703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4106","reported_seq":4134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889069+0000","last_change":"2024-05-08T20:54:59.632516+0000","last_active":"2024-05-08T21:21:06.889069+0000","last_peered":"2024-05-08T21:21:06.889069+0000","last_clean":"2024-05-08T21:21:06.889069+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:06.889069+0000","last_undegraded":"2024-05-08T21:21:06.889069+0000","last_fullsized":"2024-05-08T21:21:06.889069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4106,"log_dups_size":0,"ondisk_log_size":4106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.701789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'810","reported_seq":837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.358440+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T21:21:13.358440+0000","last_peered":"2024-05-08T21:21:13.358440+0000","last_clean":"2024-05-08T21:21:13.358440+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:13.358440+0000","last_undegraded":"2024-05-08T21:21:13.358440+0000","last_fullsized":"2024-05-08T21:21:13.358440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:43.152301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3291,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.797861+0000","last_change":"2024-05-08T20:55:41.605046+0000","last_active":"2024-05-08T21:21:06.797861+0000","last_peered":"2024-05-08T21:21:06.797861+0000","last_clean":"2024-05-08T21:21:06.797861+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:21:06.797861+0000","last_undegraded":"2024-05-08T21:21:06.797861+0000","last_fullsized":"2024-05-08T21:21:06.797861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:10.838870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3441","reported_seq":3481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.602506+0000","last_change":"2024-05-08T21:21:21.602580+0000","last_active":"2024-05-08T21:21:21.602506+0000","last_peered":"2024-05-08T21:21:21.602506+0000","last_clean":"2024-05-08T21:21:21.602506+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:21.602506+0000","last_undegraded":"2024-05-08T21:21:21.602506+0000","last_fullsized":"2024-05-08T21:21:21.602506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3441","last_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_deep_scrub":"27'3441","last_deep_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.602478+0000","objects_scrubbed":5,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:12.507196+0000","scrub_duration":0.053816461000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'810","reported_seq":837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.375446+0000","last_change":"2024-05-08T20:55:00.093952+0000","last_active":"2024-05-08T21:21:13.375446+0000","last_peered":"2024-05-08T21:21:13.375446+0000","last_clean":"2024-05-08T21:21:13.375446+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:13.375446+0000","last_undegraded":"2024-05-08T21:21:13.375446+0000","last_fullsized":"2024-05-08T21:21:13.375446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:42.974308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.864134+0000","last_change":"2024-05-08T20:55:41.613686+0000","last_active":"2024-05-08T21:21:06.864134+0000","last_peered":"2024-05-08T21:21:06.864134+0000","last_clean":"2024-05-08T21:21:06.864134+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:21:06.864134+0000","last_undegraded":"2024-05-08T21:21:06.864134+0000","last_fullsized":"2024-05-08T21:21:06.864134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3911","reported_seq":3950,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.858105+0000","last_change":"2024-05-08T21:21:21.858266+0000","last_active":"2024-05-08T21:21:21.858105+0000","last_peered":"2024-05-08T21:21:21.858105+0000","last_clean":"2024-05-08T21:21:21.858105+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:21.858105+0000","last_undegraded":"2024-05-08T21:21:21.858105+0000","last_fullsized":"2024-05-08T21:21:21.858105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3911","last_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_deep_scrub":"27'3911","last_deep_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.858055+0000","objects_scrubbed":2,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:12.384037+0000","scrub_duration":0.015982177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'819","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.367965+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T21:21:13.367965+0000","last_peered":"2024-05-08T21:21:13.367965+0000","last_clean":"2024-05-08T21:21:13.367965+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:13.367965+0000","last_undegraded":"2024-05-08T21:21:13.367965+0000","last_fullsized":"2024-05-08T21:21:13.367965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:53:43.864413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.849896+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T21:21:06.849896+0000","last_peered":"2024-05-08T21:21:06.849896+0000","last_clean":"2024-05-08T21:21:06.849896+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:21:06.849896+0000","last_undegraded":"2024-05-08T21:21:06.849896+0000","last_fullsized":"2024-05-08T21:21:06.849896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:47.140554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1802","reported_seq":1842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.593327+0000","last_change":"2024-05-08T21:21:22.593429+0000","last_active":"2024-05-08T21:21:22.593327+0000","last_peered":"2024-05-08T21:21:22.593327+0000","last_clean":"2024-05-08T21:21:22.593327+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:22.593327+0000","last_undegraded":"2024-05-08T21:21:22.593327+0000","last_fullsized":"2024-05-08T21:21:22.593327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1802","last_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_deep_scrub":"27'1802","last_deep_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.593300+0000","objects_scrubbed":1,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:44.040446+0000","scrub_duration":0.0043429840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'818","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.361057+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T21:21:13.361057+0000","last_peered":"2024-05-08T21:21:13.361057+0000","last_clean":"2024-05-08T21:21:13.361057+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:13.361057+0000","last_undegraded":"2024-05-08T21:21:13.361057+0000","last_fullsized":"2024-05-08T21:21:13.361057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:46.551894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'845","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.362252+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T21:21:13.362252+0000","last_peered":"2024-05-08T21:21:13.362252+0000","last_clean":"2024-05-08T21:21:13.362252+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:13.362252+0000","last_undegraded":"2024-05-08T21:21:13.362252+0000","last_fullsized":"2024-05-08T21:21:13.362252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'869","reported_seq":906,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.357191+0000","last_change":"2024-05-08T20:55:42.115166+0000","last_active":"2024-05-08T21:21:13.357191+0000","last_peered":"2024-05-08T21:21:13.357191+0000","last_clean":"2024-05-08T21:21:13.357191+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:13.357191+0000","last_undegraded":"2024-05-08T21:21:13.357191+0000","last_fullsized":"2024-05-08T21:21:13.357191+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'817","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376345+0000","last_change":"2024-05-08T20:55:00.092863+0000","last_active":"2024-05-08T21:21:13.376345+0000","last_peered":"2024-05-08T21:21:13.376345+0000","last_clean":"2024-05-08T21:21:13.376345+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:13.376345+0000","last_undegraded":"2024-05-08T21:21:13.376345+0000","last_fullsized":"2024-05-08T21:21:13.376345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:54.760685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'848","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.360650+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T21:21:13.360650+0000","last_peered":"2024-05-08T21:21:13.360650+0000","last_clean":"2024-05-08T21:21:13.360650+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:13.360650+0000","last_undegraded":"2024-05-08T21:21:13.360650+0000","last_fullsized":"2024-05-08T21:21:13.360650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'814","reported_seq":843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.357586+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T21:21:13.357586+0000","last_peered":"2024-05-08T21:21:13.357586+0000","last_clean":"2024-05-08T21:21:13.357586+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:13.357586+0000","last_undegraded":"2024-05-08T21:21:13.357586+0000","last_fullsized":"2024-05-08T21:21:13.357586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'818","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.342806+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T21:21:13.342806+0000","last_peered":"2024-05-08T21:21:13.342806+0000","last_clean":"2024-05-08T21:21:13.342806+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:13.342806+0000","last_undegraded":"2024-05-08T21:21:13.342806+0000","last_fullsized":"2024-05-08T21:21:13.342806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'882","reported_seq":909,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.374690+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T21:21:13.374690+0000","last_peered":"2024-05-08T21:21:13.374690+0000","last_clean":"2024-05-08T21:21:13.374690+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:21:13.374690+0000","last_undegraded":"2024-05-08T21:21:13.374690+0000","last_fullsized":"2024-05-08T21:21:13.374690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:55:59.813364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'808","reported_seq":837,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.778980+0000","last_change":"2024-05-08T20:55:00.091768+0000","last_active":"2024-05-08T21:21:13.778980+0000","last_peered":"2024-05-08T21:21:13.778980+0000","last_clean":"2024-05-08T21:21:13.778980+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:13.778980+0000","last_undegraded":"2024-05-08T21:21:13.778980+0000","last_fullsized":"2024-05-08T21:21:13.778980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'808","reported_seq":835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.367462+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T21:21:13.367462+0000","last_peered":"2024-05-08T21:21:13.367462+0000","last_clean":"2024-05-08T21:21:13.367462+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:13.367462+0000","last_undegraded":"2024-05-08T21:21:13.367462+0000","last_fullsized":"2024-05-08T21:21:13.367462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:37.665018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'798","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.357668+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T21:21:13.357668+0000","last_peered":"2024-05-08T21:21:13.357668+0000","last_clean":"2024-05-08T21:21:13.357668+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:13.357668+0000","last_undegraded":"2024-05-08T21:21:13.357668+0000","last_fullsized":"2024-05-08T21:21:13.357668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'833","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.378433+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T21:21:13.378433+0000","last_peered":"2024-05-08T21:21:13.378433+0000","last_clean":"2024-05-08T21:21:13.378433+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:13.378433+0000","last_undegraded":"2024-05-08T21:21:13.378433+0000","last_fullsized":"2024-05-08T21:21:13.378433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:00:20.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'841","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.365379+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T21:21:13.365379+0000","last_peered":"2024-05-08T21:21:13.365379+0000","last_clean":"2024-05-08T21:21:13.365379+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:13.365379+0000","last_undegraded":"2024-05-08T21:21:13.365379+0000","last_fullsized":"2024-05-08T21:21:13.365379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'836","reported_seq":862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.366022+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T21:21:13.366022+0000","last_peered":"2024-05-08T21:21:13.366022+0000","last_clean":"2024-05-08T21:21:13.366022+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:13.366022+0000","last_undegraded":"2024-05-08T21:21:13.366022+0000","last_fullsized":"2024-05-08T21:21:13.366022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:47.849410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86560,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113556,"ondisk_log_size":113556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52760,"ondisk_log_size":52760,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243565076,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2931,"num_read_kb":7530,"num_write":91807,"num_write_kb":660236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487194624,"data_stored":487130152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91061,"ondisk_log_size":91061,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575171,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516716,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":450302,"kb_avail":93855124,"statfs":{"total":96636764160,"available":96107646976,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":461109707},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.65200000000000002,"15min":0.44700000000000001},"min":{"1min":0.22500000000000001,"5min":0.216,"15min":0.191},"max":{"1min":9.2940000000000005,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.437},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.65700000000000003,"15min":0.48599999999999999},"min":{"1min":0.26000000000000001,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":11.170999999999999,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.70999999999999996,"15min":0.48399999999999999},"min":{"1min":0.254,"5min":0.22,"15min":0.20599999999999999},"max":{"1min":11.247999999999999,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.64600000000000002,"15min":0.505},"min":{"1min":0.251,"5min":0.22,"15min":0.20499999999999999},"max":{"1min":11.425000000000001,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.56899999999999995,"15min":0.48399999999999999},"min":{"1min":0.27400000000000002,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":2.1160000000000001,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.58299999999999996,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.9450000000000003,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.53700000000000003}]},{"osd":3,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.73799999999999999,"15min":0.53900000000000003},"min":{"1min":0.27900000000000003,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.218,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":0.56899999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":2.081,"5min":7.9459999999999997,"15min":7.9459999999999997},"last":0.70099999999999996}]},{"osd":4,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.58899999999999997,"15min":0.498},"min":{"1min":0.253,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":0.65100000000000002,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.64900000000000002,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.254},"max":{"1min":1.109,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.72099999999999997}]},{"osd":5,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.67500000000000004,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":8.9849999999999994,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.755,"15min":0.57499999999999996},"min":{"1min":0.44500000000000001,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":2.681,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.748}]},{"osd":6,"last update":"Wed May 8 21:20:32 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":0.67600000000000005,"15min":0.54900000000000004},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":9.1050000000000004,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.71099999999999997,"15min":0.58499999999999996},"min":{"1min":0.34899999999999998,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":1.599,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.76900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.45500000000000002,"15min":0.42099999999999999},"min":{"1min":0.23000000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59199999999999997,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53200000000000003,"5min":2.1080000000000001,"15min":3.839},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.63600000000000001,"15min":0.49399999999999999},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":1.4370000000000001,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.53600000000000003,"15min":0.47999999999999998},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.56499999999999995,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.48599999999999999},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.3089999999999999,"5min":3.694,"15min":3.694},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60399999999999998,"15min":0.497},"min":{"1min":0.28699999999999998,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":1.2709999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":0.61799999999999999}]},{"osd":3,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56599999999999995,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":1.661,"5min":3.218,"15min":3.8250000000000002},"last":0.439},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":1.4770000000000001,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.51700000000000002}]},{"osd":4,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":3.077,"15min":7.3810000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.72899999999999998,"15min":0.56399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.222},"max":{"1min":0.66600000000000004,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.495},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.4039999999999999,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.56499999999999995},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.3420000000000001,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.59199999999999997}]},{"osd":7,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.40899999999999997,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.70499999999999996,"5min":3.1909999999999998,"15min":3.8100000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":1.5009999999999999,"5min":2.919,"15min":3.8780000000000001},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581444,"kb_used_data":81084,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790396,"statfs":{"total":96636764160,"available":96041365504,"internally_reserved":0,"allocated":83030016,"data_stored":82846318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.46300000000000002,"15min":0.35899999999999999},"min":{"1min":0.189,"5min":0.184,"15min":0.17699999999999999},"max":{"1min":2.0699999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.45400000000000001,"15min":0.38100000000000001},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.653,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.32600000000000001}]},{"osd":2,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.41899999999999998,"15min":0.38300000000000001},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.189},"max":{"1min":0.56599999999999995,"5min":5.141,"15min":5.141},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.53600000000000003,"15min":0.45400000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.1179999999999999,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.35699999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.628,"15min":0.49099999999999999},"min":{"1min":0.249,"5min":0.216,"15min":0.215},"max":{"1min":2.1890000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.53100000000000003,"15min":0.45700000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.19},"max":{"1min":1.6890000000000001,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.55400000000000005,"15min":0.501},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.53500000000000003},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":2.1709999999999998,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.52200000000000002}]},{"osd":5,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55500000000000005,"15min":0.499},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.7090000000000001,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.56299999999999994,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.67100000000000004,"15min":0.55100000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.7310000000000001,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63600000000000001,"15min":0.58599999999999997},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.28499999999999998},"max":{"1min":2.4830000000000001,"5min":6.766,"15min":6.766},"last":0.48299999999999998}]},{"osd":7,"last update":"Wed May 8 21:20:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.72799999999999998,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":2.3100000000000001,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69199999999999995,"15min":0.60999999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.33900000000000002},"max":{"1min":1.7529999999999999,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.61099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575172,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375604,"kb_used_data":29548,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996236,"statfs":{"total":96636764160,"available":96252145664,"internally_reserved":0,"allocated":30257152,"data_stored":30069546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.38800000000000001,"15min":0.34100000000000003},"min":{"1min":0.20599999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":1.1559999999999999,"5min":3.823,"15min":3.823},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.41099999999999998,"15min":0.39500000000000002},"min":{"1min":0.247,"5min":0.224,"15min":0.19},"max":{"1min":1.179,"5min":3.879,"15min":4.5919999999999996},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.39400000000000002,"15min":0.35499999999999998},"min":{"1min":0.22800000000000001,"5min":0.20699999999999999,"15min":0.17399999999999999},"max":{"1min":0.59999999999999998,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.224,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.41999999999999998,"5min":1.752,"15min":3.9870000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"min":{"1min":0.27300000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":0.74199999999999999,"5min":3.7160000000000002,"15min":3.895},"last":0.499},{"interface":"front","average":{"1min":0.501,"5min":0.45600000000000002,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":1.7509999999999999,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.48799999999999999}]},{"osd":4,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.51700000000000002,"15min":0.47399999999999998},"min":{"1min":0.29699999999999999,"5min":0.25600000000000001,"15min":0.254},"max":{"1min":0.77400000000000002,"5min":3.794,"15min":5.6559999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46800000000000003,"15min":0.45000000000000001},"min":{"1min":0.32200000000000001,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.68799999999999994,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.60899999999999999}]},{"osd":5,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":0.89700000000000002,"5min":4.0019999999999998,"15min":4.165},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.73899999999999999,"15min":0.59299999999999997},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.28000000000000003},"max":{"1min":2.8799999999999999,"5min":14.901,"15min":14.901},"last":0.746}]},{"osd":6,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56599999999999995,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":0.998,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.55900000000000005,"15min":0.56499999999999995},"min":{"1min":0.34399999999999997,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.621}]},{"osd":7,"last update":"Wed May 8 21:20:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54500000000000004,"15min":0.56499999999999995},"min":{"1min":0.36499999999999999,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.93999999999999995,"5min":1.927,"15min":5.0220000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.65400000000000003,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":2.9980000000000002,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.39600000000000002,"15min":0.34200000000000003},"min":{"1min":0.20799999999999999,"5min":0.17899999999999999,"15min":0.17000000000000001},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.443,"15min":0.40200000000000002},"min":{"1min":0.22500000000000001,"5min":0.187,"15min":0.187},"max":{"1min":5.7359999999999998,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.45700000000000002,"15min":0.39600000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.186},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.24399999999999999},{"interface":"front","average":{"1min":1.194,"5min":0.58999999999999997,"15min":0.47199999999999998},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":6.5170000000000003,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.41299999999999998,"15min":0.38700000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":0.90200000000000002,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.373},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.47199999999999998},"min":{"1min":0.26500000000000001,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":1.484,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.31900000000000001,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":16.651},"last":0.502},{"interface":"front","average":{"1min":0.997,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.38,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":5.7039999999999997,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.48899999999999999}]},{"osd":5,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":0.65600000000000003,"15min":0.53400000000000003},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":7.2599999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70899999999999996,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.4550000000000001,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.60299999999999998,"15min":0.57899999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.27400000000000002},"max":{"1min":2.4689999999999999,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.58399999999999996,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.309},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.45800000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":0.73599999999999999,"15min":0.62},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.34200000000000003},"max":{"1min":5.8499999999999996,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.2749999999999999,"5min":0.71599999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.35099999999999998},"max":{"1min":11.736000000000001,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.44400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575171,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505452,"kb_used_data":37156,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866388,"statfs":{"total":96636764160,"available":96119181312,"internally_reserved":0,"allocated":38047744,"data_stored":37867820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.53100000000000003,"15min":0.41999999999999998},"min":{"1min":0.218,"5min":0.16900000000000001,"15min":0.16800000000000001},"max":{"1min":6.407,"5min":6.407,"15min":6.407},"last":0.316},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.753,"15min":0.496},"min":{"1min":0.246,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":4.2949999999999999,"5min":16.724,"15min":16.724},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.86099999999999999,"15min":0.57999999999999996},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":4.4809999999999999,"5min":13.058,"15min":15.259},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63200000000000001,"15min":0.51400000000000001},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.192},"max":{"1min":6.1109999999999998,"5min":9.5370000000000008,"15min":10.831},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55700000000000005,"15min":0.45900000000000002},"min":{"1min":0.247,"5min":0.222,"15min":0.214},"max":{"1min":4.3739999999999997,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.621,"15min":0.48299999999999998},"min":{"1min":0.25800000000000001,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":2.2639999999999998,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":0.44500000000000001}]},{"osd":4,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.96099999999999997,"15min":0.70499999999999996},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":4.3200000000000003,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.502},{"interface":"front","average":{"1min":0.88100000000000001,"5min":1.0609999999999999,"15min":0.76400000000000001},"min":{"1min":0.32200000000000001,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":4.5039999999999996,"5min":11.755000000000001,"15min":15.224},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.59799999999999998,"15min":0.53900000000000003},"min":{"1min":0.30499999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.92300000000000004,"5min":4.3860000000000001,"15min":4.3860000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.61899999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2549999999999999,"5min":5.548,"15min":5.548},"last":0.64000000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.89300000000000002,"15min":0.65700000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":4.4180000000000001,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.73099999999999998,"15min":0.61399999999999999},"min":{"1min":0.374,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.978,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.876,"15min":0.67500000000000004},"min":{"1min":0.38700000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.3490000000000002,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.97899999999999998,"15min":0.70699999999999996},"min":{"1min":0.40600000000000003,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":4.4560000000000004,"5min":12.939,"15min":12.939},"last":0.60999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575171,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.64100000000000001,"15min":0.48499999999999999},"min":{"1min":0.20999999999999999,"5min":0.20599999999999999,"15min":0.192},"max":{"1min":0.68300000000000005,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.58899999999999997,"15min":0.45900000000000002},"min":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.73299999999999998,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.61599999999999999,"15min":0.48999999999999999},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.21099999999999999},"max":{"1min":0.58399999999999996,"5min":10.222,"15min":10.222},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.58199999999999996,"15min":0.52500000000000002},"min":{"1min":0.25,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":0.624,"5min":7.343,"15min":7.4370000000000003},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.61299999999999999,"15min":0.503},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.64300000000000002,"5min":5.5970000000000004,"15min":5.5970000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.63900000000000001,"15min":0.54400000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":2.1179999999999999,"5min":3.9900000000000002,"15min":6.617},"last":0.71599999999999997}]},{"osd":3,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.75800000000000001,"15min":0.56799999999999995},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":1.9259999999999999,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.323,"5min":5.6609999999999996,"15min":5.6609999999999996},"last":0.69199999999999995}]},{"osd":5,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.57599999999999996,"15min":0.50900000000000001},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.78000000000000003,"5min":4.0190000000000001,"15min":6.4340000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.65700000000000003,"15min":0.54800000000000004},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.23100000000000001},"max":{"1min":0.80200000000000005,"5min":4.8040000000000003,"15min":5.2990000000000004},"last":0.627}]},{"osd":6,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.60999999999999999,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.28599999999999998,"15min":0.26900000000000002},"max":{"1min":0.68899999999999995,"5min":5.6340000000000003,"15min":7.0039999999999996},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.72999999999999998,"15min":0.62},"min":{"1min":0.36199999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.86099999999999999,"5min":9.4550000000000001,"15min":9.4550000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Wed May 8 21:20:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.73599999999999999,"15min":0.59199999999999997},"min":{"1min":0.41299999999999998,"5min":0.34899999999999998,"15min":0.27300000000000002},"max":{"1min":0.89500000000000002,"5min":4.8280000000000003,"15min":4.8280000000000003},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.71799999999999997,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.372,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":5.6890000000000001,"15min":12.691000000000001},"last":0.77900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544972,"kb_used_data":98884,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826868,"statfs":{"total":96636764160,"available":96078712832,"internally_reserved":0,"allocated":101257216,"data_stored":101075772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.56299999999999994,"15min":0.47799999999999998},"min":{"1min":0.22500000000000001,"5min":0.21199999999999999,"15min":0.17899999999999999},"max":{"1min":7.3769999999999998,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.038,"5min":0.878,"15min":0.61099999999999999},"min":{"1min":0.25600000000000001,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":9.2059999999999995,"5min":24.800000000000001,"15min":24.800000000000001},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.60999999999999999},"min":{"1min":0.28199999999999997,"5min":0.218,"15min":0.215},"max":{"1min":7.343,"5min":27.719000000000001,"15min":27.719000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.89600000000000002,"15min":0.61399999999999999},"min":{"1min":0.246,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":6.6150000000000002,"5min":24.826000000000001,"15min":24.826000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.62,"15min":0.52000000000000002},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.24099999999999999},"max":{"1min":7.4779999999999998,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.65500000000000003,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.28699999999999998,"15min":0.24199999999999999},"max":{"1min":7.4009999999999998,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.93899999999999995,"15min":0.66700000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":6.6559999999999997,"5min":24.606000000000002,"15min":24.606000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.751,"15min":0.60299999999999998},"min":{"1min":0.309,"5min":0.29999999999999999,"15min":0.253},"max":{"1min":7.9909999999999997,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.3069999999999999,"15min":0.79800000000000004},"min":{"1min":0.32400000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":10.319000000000001,"5min":71.634,"15min":71.634},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.762,"15min":0.98399999999999999},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.24199999999999999},"max":{"1min":10.032,"5min":101.794,"15min":101.794},"last":0.63200000000000001}]},{"osd":6,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":0.77300000000000002,"15min":0.61399999999999999},"min":{"1min":0.34200000000000003,"5min":0.254,"15min":0.254},"max":{"1min":14.997,"5min":14.997,"15min":14.997},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.073,"15min":0.71599999999999997},"min":{"1min":0.35699999999999998,"5min":0.26600000000000001,"15min":0.26500000000000001},"max":{"1min":19.137,"5min":28.053999999999998,"15min":28.053999999999998},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed May 8 21:20:25 2024","interfaces":[{"interface":"back","average":{"1min":4.7690000000000001,"5min":1.79,"15min":1.0089999999999999},"min":{"1min":0.40600000000000003,"5min":0.31,"15min":0.30499999999999999},"max":{"1min":67.849999999999994,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.66700000000000004},{"interface":"front","average":{"1min":5.2670000000000003,"5min":1.845,"15min":0.99199999999999999},"min":{"1min":0.39400000000000002,"5min":0.31,"15min":0.31},"max":{"1min":67.561000000000007,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82739200,"data_stored":82727906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100966400,"data_stored":100957360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:21:24.458 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.458 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.459 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.460 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.460 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.460 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.460 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.460 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.461 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.461 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.462 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.462 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.462 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.462 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.462 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.462 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.463 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.464 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.464 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.464 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.464 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.464 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.464 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.464 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.465 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.466 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.467 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.467 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.467 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.467 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.467 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.467 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.467 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.468 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.469 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.470 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.470 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T20:54:48.550973+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.470 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.470 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.470 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.470 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.470 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.471 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.471 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.471 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.471 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.471 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.471 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.471 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.472 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.473 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.474 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.475 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.475 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.475 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:24.475 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:21:32.050 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:21:32.053 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:21:44.476 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:21:44.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.611+0000 7ff0799a2700 1 Processor -- start 2024-05-08T21:21:44.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.611+0000 7ff0799a2700 1 -- start start 2024-05-08T21:21:44.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0799a2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff0741534b0 0x7ff0740c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0799a2700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff07406ba70 0x7ff0740c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0799a2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0740c84b0 0x7ff074159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0799a2700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0740c1b60 con 0x7ff07406ba70 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0799a2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0740c2ac0 con 0x7ff0741534b0 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0799a2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0740c24b0 con 0x7ff0740c84b0 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff073fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff07406ba70 0x7ff0740c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff073fff700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7ff07406ba70 0x7ff0740c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55550/0 (socket says 172.21.15.135:55550) 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff073fff700 1 -- 172.21.15.135:0/2329706285 learned_addr learned my addr 172.21.15.135:0/2329706285 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0789a0700 1 --2- 172.21.15.135:0/2329706285 >> v2:172.21.15.183:3300/0 conn(0x7ff0741534b0 0x7ff0740c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff0791a1700 1 --2- 172.21.15.135:0/2329706285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0740c84b0 0x7ff074159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:44.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff073fff700 1 -- 172.21.15.135:0/2329706285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0740c84b0 msgr2=0x7ff074159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff073fff700 1 --2- 172.21.15.135:0/2329706285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0740c84b0 0x7ff074159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff073fff700 1 -- 172.21.15.135:0/2329706285 >> v2:172.21.15.183:3300/0 conn(0x7ff0741534b0 msgr2=0x7ff0740c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.612+0000 7ff073fff700 1 --2- 172.21.15.135:0/2329706285 >> v2:172.21.15.183:3300/0 conn(0x7ff0741534b0 0x7ff0740c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff073fff700 1 -- 172.21.15.135:0/2329706285 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740c3880 con 0x7ff07406ba70 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff073fff700 1 --2- 172.21.15.135:0/2329706285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff0740c7f70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff0740c6d30 tx=0x7ff060009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478805f84860f1a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0737fe700 1 -- 172.21.15.135:0/2329706285 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000b870 con 0x7ff07406ba70 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0737fe700 1 -- 172.21.15.135:0/2329706285 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000b9d0 con 0x7ff07406ba70 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0737fe700 1 -- 172.21.15.135:0/2329706285 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000bd60 con 0x7ff07406ba70 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 -- 172.21.15.135:0/2329706285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 msgr2=0x7ff0740c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 --2- 172.21.15.135:0/2329706285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff0740c7f70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff0740c6d30 tx=0x7ff060009bd0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 -- 172.21.15.135:0/2329706285 shutdown_connections 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 --2- 172.21.15.135:0/2329706285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0740c84b0 0x7ff074159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 --2- 172.21.15.135:0/2329706285 >> v2:172.21.15.183:3300/0 conn(0x7ff0741534b0 0x7ff0740c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 --2- 172.21.15.135:0/2329706285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff0740c7f70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 -- 172.21.15.135:0/2329706285 >> 172.21.15.135:0/2329706285 conn(0x7ff074071520 msgr2=0x7ff07406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:44.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 -- 172.21.15.135:0/2329706285 shutdown_connections 2024-05-08T21:21:44.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.613+0000 7ff0799a2700 1 -- 172.21.15.135:0/2329706285 wait complete. 2024-05-08T21:21:44.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 Processor -- start 2024-05-08T21:21:44.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 -- start start 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff074156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0740c84b0 0x7ff0740cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0741534b0 0x7ff074157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0741591e0 con 0x7ff07406ba70 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0741f2040 con 0x7ff0740c84b0 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.615+0000 7ff0799a2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0741567b0 con 0x7ff0741534b0 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff074156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff074156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55554/0 (socket says 172.21.15.135:55554) 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 -- 172.21.15.135:0/1686978034 learned_addr learned my addr 172.21.15.135:0/1686978034 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff073fff700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0740c84b0 0x7ff0740cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0791a1700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0741534b0 0x7ff074157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:44.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 -- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0741534b0 msgr2=0x7ff074157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0741534b0 0x7ff074157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 -- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0740c84b0 msgr2=0x7ff0740cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0740c84b0 0x7ff0740cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 -- 172.21.15.135:0/1686978034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060009550 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0789a0700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff074156170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff06800e810 tx=0x7ff06800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0717fa700 1 -- 172.21.15.135:0/1686978034 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800c070 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0717fa700 1 -- 172.21.15.135:0/1686978034 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff068013610 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff074159430 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0717fa700 1 -- 172.21.15.135:0/1686978034 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0680139c0 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.616+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0741599f0 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.617+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff074157da0 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.618+0000 7ff0717fa700 1 -- 172.21.15.135:0/1686978034 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff068013b20 con 0x7ff07406ba70 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.618+0000 7ff0717fa700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff05806ac90 0x7ff05806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:21:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.618+0000 7ff0717fa700 1 -- 172.21.15.135:0/1686978034 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0680893d0 con 0x7ff07406ba70 2024-05-08T21:21:44.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.618+0000 7ff073fff700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff05806ac90 0x7ff05806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:21:44.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.619+0000 7ff073fff700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff05806ac90 0x7ff05806d150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0740c6d30 tx=0x7ff060008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:21:44.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.623+0000 7ff0717fa700 1 -- 172.21.15.135:0/1686978034 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff068054200 con 0x7ff07406ba70 2024-05-08T21:21:44.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.815+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0740c2750 con 0x7ff05806ac90 2024-05-08T21:21:44.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.824+0000 7ff0717fa700 1 -- 172.21.15.135:0/1686978034 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369777 (secure 0 0 0) 0x7ff06000bb40 con 0x7ff05806ac90 2024-05-08T21:21:44.831 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:21:44.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff05806ac90 msgr2=0x7ff05806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:44.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff05806ac90 0x7ff05806d150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0740c6d30 tx=0x7ff060008030 comp rx=0 tx=0).stop 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 msgr2=0x7ff074156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff074156170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff06800e810 tx=0x7ff06800eb20 comp rx=0 tx=0).stop 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 shutdown_connections 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7ff05806ac90 0x7ff05806d150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0741534b0 0x7ff074157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff07406ba70 0x7ff074156170 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 --2- 172.21.15.135:0/1686978034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0740c84b0 0x7ff0740cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 >> 172.21.15.135:0/1686978034 conn(0x7ff074071520 msgr2=0x7ff07406c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 shutdown_connections 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:21:44.828+0000 7ff0799a2700 1 -- 172.21.15.135:0/1686978034 wait complete. 2024-05-08T21:21:44.835 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:21:44.843 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":828,"stamp":"2024-05-08T21:21:42.818102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244155444,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3047,"num_read_kb":7630,"num_write":179646,"num_write_kb":3998170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257554,"ondisk_log_size":257554,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3864680,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3385395,"kb_avail":751110040,"statfs":{"total":773094113280,"available":769136680960,"internally_reserved":0,"allocated":490708992,"data_stored":489258184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3466645049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003353"},"pg_stats":[{"pgid":"3.3f","version":"27'774","reported_seq":803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.362759+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T21:21:13.362759+0000","last_peered":"2024-05-08T21:21:13.362759+0000","last_clean":"2024-05-08T21:21:13.362759+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:21:13.362759+0000","last_undegraded":"2024-05-08T21:21:13.362759+0000","last_fullsized":"2024-05-08T21:21:13.362759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'772","reported_seq":800,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355259+0000","last_change":"2024-05-08T20:55:00.089822+0000","last_active":"2024-05-08T21:21:13.355259+0000","last_peered":"2024-05-08T21:21:13.355259+0000","last_clean":"2024-05-08T21:21:13.355259+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:13.355259+0000","last_undegraded":"2024-05-08T21:21:13.355259+0000","last_fullsized":"2024-05-08T21:21:13.355259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'862","reported_seq":902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.036855+0000","last_change":"2024-05-08T21:21:30.036948+0000","last_active":"2024-05-08T21:21:30.036855+0000","last_peered":"2024-05-08T21:21:30.036855+0000","last_clean":"2024-05-08T21:21:30.036855+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:30.036855+0000","last_undegraded":"2024-05-08T21:21:30.036855+0000","last_fullsized":"2024-05-08T21:21:30.036855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'862","last_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_deep_scrub":"27'862","last_deep_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.036832+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:55.453142+0000","scrub_duration":0.0074728939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'823","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.751890+0000","last_change":"2024-05-08T21:21:27.751988+0000","last_active":"2024-05-08T21:21:27.751890+0000","last_peered":"2024-05-08T21:21:27.751890+0000","last_clean":"2024-05-08T21:21:27.751890+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:27.751890+0000","last_undegraded":"2024-05-08T21:21:27.751890+0000","last_fullsized":"2024-05-08T21:21:27.751890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'823","last_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_deep_scrub":"27'823","last_deep_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.751862+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.537249+0000","scrub_duration":0.0019687749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'860","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.360323+0000","last_change":"2024-05-08T20:55:00.093790+0000","last_active":"2024-05-08T21:21:13.360323+0000","last_peered":"2024-05-08T21:21:13.360323+0000","last_clean":"2024-05-08T21:21:13.360323+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:21:13.360323+0000","last_undegraded":"2024-05-08T21:21:13.360323+0000","last_fullsized":"2024-05-08T21:21:13.360323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'767","reported_seq":793,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.381188+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T21:21:13.381188+0000","last_peered":"2024-05-08T21:21:13.381188+0000","last_clean":"2024-05-08T21:21:13.381188+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:21:13.381188+0000","last_undegraded":"2024-05-08T21:21:13.381188+0000","last_fullsized":"2024-05-08T21:21:13.381188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'811","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355616+0000","last_change":"2024-05-08T20:55:00.102709+0000","last_active":"2024-05-08T21:21:13.355616+0000","last_peered":"2024-05-08T21:21:13.355616+0000","last_clean":"2024-05-08T21:21:13.355616+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:13.355616+0000","last_undegraded":"2024-05-08T21:21:13.355616+0000","last_fullsized":"2024-05-08T21:21:13.355616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'788","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.374265+0000","last_change":"2024-05-08T20:55:00.098727+0000","last_active":"2024-05-08T21:21:13.374265+0000","last_peered":"2024-05-08T21:21:13.374265+0000","last_clean":"2024-05-08T21:21:13.374265+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:13.374265+0000","last_undegraded":"2024-05-08T21:21:13.374265+0000","last_fullsized":"2024-05-08T21:21:13.374265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'846","reported_seq":874,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.080607+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T21:21:24.080607+0000","last_peered":"2024-05-08T21:21:24.080607+0000","last_clean":"2024-05-08T21:21:24.080607+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:21:24.080607+0000","last_undegraded":"2024-05-08T21:21:24.080607+0000","last_fullsized":"2024-05-08T21:21:24.080607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'809","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.571724+0000","last_change":"2024-05-08T20:55:00.097264+0000","last_active":"2024-05-08T21:21:23.571724+0000","last_peered":"2024-05-08T21:21:23.571724+0000","last_clean":"2024-05-08T21:21:23.571724+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:23.571724+0000","last_undegraded":"2024-05-08T21:21:23.571724+0000","last_fullsized":"2024-05-08T21:21:23.571724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'819","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.571623+0000","last_change":"2024-05-08T20:55:00.098099+0000","last_active":"2024-05-08T21:21:23.571623+0000","last_peered":"2024-05-08T21:21:23.571623+0000","last_clean":"2024-05-08T21:21:23.571623+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:23.571623+0000","last_undegraded":"2024-05-08T21:21:23.571623+0000","last_fullsized":"2024-05-08T21:21:23.571623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'794","reported_seq":822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.547993+0000","last_change":"2024-05-08T20:55:00.082451+0000","last_active":"2024-05-08T21:21:22.547993+0000","last_peered":"2024-05-08T21:21:22.547993+0000","last_clean":"2024-05-08T21:21:22.547993+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:22.547993+0000","last_undegraded":"2024-05-08T21:21:22.547993+0000","last_fullsized":"2024-05-08T21:21:22.547993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'813","reported_seq":852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.863029+0000","last_change":"2024-05-08T21:21:25.863029+0000","last_active":"2024-05-08T21:21:25.863029+0000","last_peered":"2024-05-08T21:21:25.863029+0000","last_clean":"2024-05-08T21:21:25.863029+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:25.863029+0000","last_undegraded":"2024-05-08T21:21:25.863029+0000","last_fullsized":"2024-05-08T21:21:25.863029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'813","last_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_deep_scrub":"27'813","last_deep_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.862894+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:16.467912+0000","scrub_duration":0.0075367910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'802","reported_seq":830,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.354388+0000","last_change":"2024-05-08T20:55:00.088180+0000","last_active":"2024-05-08T21:21:13.354388+0000","last_peered":"2024-05-08T21:21:13.354388+0000","last_clean":"2024-05-08T21:21:13.354388+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:13.354388+0000","last_undegraded":"2024-05-08T21:21:13.354388+0000","last_fullsized":"2024-05-08T21:21:13.354388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'853","reported_seq":880,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355173+0000","last_change":"2024-05-08T20:55:00.074076+0000","last_active":"2024-05-08T21:21:13.355173+0000","last_peered":"2024-05-08T21:21:13.355173+0000","last_clean":"2024-05-08T21:21:13.355173+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:13.355173+0000","last_undegraded":"2024-05-08T21:21:13.355173+0000","last_fullsized":"2024-05-08T21:21:13.355173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'809","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.736377+0000","last_change":"2024-05-08T21:21:25.736503+0000","last_active":"2024-05-08T21:21:25.736377+0000","last_peered":"2024-05-08T21:21:25.736377+0000","last_clean":"2024-05-08T21:21:25.736377+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:25.736377+0000","last_undegraded":"2024-05-08T21:21:25.736377+0000","last_fullsized":"2024-05-08T21:21:25.736377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.736348+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:53.810852+0000","scrub_duration":0.00189824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'870","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376912+0000","last_change":"2024-05-08T20:55:00.102828+0000","last_active":"2024-05-08T21:21:13.376912+0000","last_peered":"2024-05-08T21:21:13.376912+0000","last_clean":"2024-05-08T21:21:13.376912+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:13.376912+0000","last_undegraded":"2024-05-08T21:21:13.376912+0000","last_fullsized":"2024-05-08T21:21:13.376912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'789","reported_seq":828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.635345+0000","last_change":"2024-05-08T21:21:29.635458+0000","last_active":"2024-05-08T21:21:29.635345+0000","last_peered":"2024-05-08T21:21:29.635345+0000","last_clean":"2024-05-08T21:21:29.635345+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:29.635345+0000","last_undegraded":"2024-05-08T21:21:29.635345+0000","last_fullsized":"2024-05-08T21:21:29.635345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'789","last_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_deep_scrub":"27'789","last_deep_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.635318+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:25.420704+0000","scrub_duration":0.002176664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'839","reported_seq":867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.361938+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T21:21:13.361938+0000","last_peered":"2024-05-08T21:21:13.361938+0000","last_clean":"2024-05-08T21:21:13.361938+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:21:13.361938+0000","last_undegraded":"2024-05-08T21:21:13.361938+0000","last_fullsized":"2024-05-08T21:21:13.361938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3810,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.883056+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T21:21:06.883056+0000","last_peered":"2024-05-08T21:21:06.883056+0000","last_clean":"2024-05-08T21:21:06.883056+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:21:06.883056+0000","last_undegraded":"2024-05-08T21:21:06.883056+0000","last_fullsized":"2024-05-08T21:21:06.883056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1871","reported_seq":1912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.072464+0000","last_change":"2024-05-08T21:21:22.072592+0000","last_active":"2024-05-08T21:21:22.072464+0000","last_peered":"2024-05-08T21:21:22.072464+0000","last_clean":"2024-05-08T21:21:22.072464+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:22.072464+0000","last_undegraded":"2024-05-08T21:21:22.072464+0000","last_fullsized":"2024-05-08T21:21:22.072464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1871","last_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_deep_scrub":"27'1871","last_deep_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.072441+0000","objects_scrubbed":3,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:17.857827+0000","scrub_duration":0.015741767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'809","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.904062+0000","last_change":"2024-05-08T21:21:27.904160+0000","last_active":"2024-05-08T21:21:27.904062+0000","last_peered":"2024-05-08T21:21:27.904062+0000","last_clean":"2024-05-08T21:21:27.904062+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:27.904062+0000","last_undegraded":"2024-05-08T21:21:27.904062+0000","last_fullsized":"2024-05-08T21:21:27.904062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.904035+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.689421+0000","scrub_duration":0.0050121590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3721,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.548096+0000","last_change":"2024-05-08T20:55:04.110661+0000","last_active":"2024-05-08T21:21:22.548096+0000","last_peered":"2024-05-08T21:21:22.548096+0000","last_clean":"2024-05-08T21:21:22.548096+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:22.548096+0000","last_undegraded":"2024-05-08T21:21:22.548096+0000","last_fullsized":"2024-05-08T21:21:22.548096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4026","reported_seq":4068,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.919821+0000","last_change":"2024-05-08T21:21:28.919926+0000","last_active":"2024-05-08T21:21:28.919821+0000","last_peered":"2024-05-08T21:21:28.919821+0000","last_clean":"2024-05-08T21:21:28.919821+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:28.919821+0000","last_undegraded":"2024-05-08T21:21:28.919821+0000","last_fullsized":"2024-05-08T21:21:28.919821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4026","last_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_deep_scrub":"27'4026","last_deep_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.919793+0000","objects_scrubbed":1,"log_size":4026,"log_dups_size":0,"ondisk_log_size":4026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.835728+0000","scrub_duration":0.016721056000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'779","reported_seq":808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.364840+0000","last_change":"2024-05-08T20:55:00.097594+0000","last_active":"2024-05-08T21:21:13.364840+0000","last_peered":"2024-05-08T21:21:13.364840+0000","last_clean":"2024-05-08T21:21:13.364840+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:13.364840+0000","last_undegraded":"2024-05-08T21:21:13.364840+0000","last_fullsized":"2024-05-08T21:21:13.364840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3657,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.912070+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T21:21:06.912070+0000","last_peered":"2024-05-08T21:21:06.912070+0000","last_clean":"2024-05-08T21:21:06.912070+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:21:06.912070+0000","last_undegraded":"2024-05-08T21:21:06.912070+0000","last_fullsized":"2024-05-08T21:21:06.912070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4862","reported_seq":4890,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.796889+0000","last_change":"2024-05-08T20:54:59.634257+0000","last_active":"2024-05-08T21:21:07.796889+0000","last_peered":"2024-05-08T21:21:07.796889+0000","last_clean":"2024-05-08T21:21:07.796889+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:07.796889+0000","last_undegraded":"2024-05-08T21:21:07.796889+0000","last_fullsized":"2024-05-08T21:21:07.796889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":4862,"log_dups_size":0,"ondisk_log_size":4862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'861","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376353+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T21:21:13.376353+0000","last_peered":"2024-05-08T21:21:13.376353+0000","last_clean":"2024-05-08T21:21:13.376353+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:21:13.376353+0000","last_undegraded":"2024-05-08T21:21:13.376353+0000","last_fullsized":"2024-05-08T21:21:13.376353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.857628+0000","last_change":"2024-05-08T20:55:04.111282+0000","last_active":"2024-05-08T21:21:06.857628+0000","last_peered":"2024-05-08T21:21:06.857628+0000","last_clean":"2024-05-08T21:21:06.857628+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:06.857628+0000","last_undegraded":"2024-05-08T21:21:06.857628+0000","last_fullsized":"2024-05-08T21:21:06.857628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1175","reported_seq":1203,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.794074+0000","last_change":"2024-05-08T20:54:59.630133+0000","last_active":"2024-05-08T21:21:07.794074+0000","last_peered":"2024-05-08T21:21:07.794074+0000","last_clean":"2024-05-08T21:21:07.794074+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:07.794074+0000","last_undegraded":"2024-05-08T21:21:07.794074+0000","last_fullsized":"2024-05-08T21:21:07.794074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1175,"log_dups_size":0,"ondisk_log_size":1175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'834","reported_seq":860,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.375956+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T21:21:13.375956+0000","last_peered":"2024-05-08T21:21:13.375956+0000","last_clean":"2024-05-08T21:21:13.375956+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:21:13.375956+0000","last_undegraded":"2024-05-08T21:21:13.375956+0000","last_fullsized":"2024-05-08T21:21:13.375956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.827198+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T21:21:06.827198+0000","last_peered":"2024-05-08T21:21:06.827198+0000","last_clean":"2024-05-08T21:21:06.827198+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:21:06.827198+0000","last_undegraded":"2024-05-08T21:21:06.827198+0000","last_fullsized":"2024-05-08T21:21:06.827198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2317","reported_seq":2356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.926492+0000","last_change":"2024-05-08T21:21:29.926575+0000","last_active":"2024-05-08T21:21:29.926492+0000","last_peered":"2024-05-08T21:21:29.926492+0000","last_clean":"2024-05-08T21:21:29.926492+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:29.926492+0000","last_undegraded":"2024-05-08T21:21:29.926492+0000","last_fullsized":"2024-05-08T21:21:29.926492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2317","last_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_deep_scrub":"27'2317","last_deep_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.926468+0000","objects_scrubbed":2,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.064661+0000","scrub_duration":0.024143202999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'829","reported_seq":867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.066384+0000","last_change":"2024-05-08T21:21:31.066489+0000","last_active":"2024-05-08T21:21:31.066384+0000","last_peered":"2024-05-08T21:21:31.066384+0000","last_clean":"2024-05-08T21:21:31.066384+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:31.066384+0000","last_undegraded":"2024-05-08T21:21:31.066384+0000","last_fullsized":"2024-05-08T21:21:31.066384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'829","last_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_deep_scrub":"27'829","last_deep_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.066360+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:42.055961+0000","scrub_duration":0.0042842599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.608319+0000","last_change":"2024-05-08T21:21:30.608460+0000","last_active":"2024-05-08T21:21:30.608319+0000","last_peered":"2024-05-08T21:21:30.608319+0000","last_clean":"2024-05-08T21:21:30.608319+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:30.608319+0000","last_undegraded":"2024-05-08T21:21:30.608319+0000","last_fullsized":"2024-05-08T21:21:30.608319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3534","last_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_deep_scrub":"27'3534","last_deep_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.608289+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:43.524223+0000","scrub_duration":0.017888930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4378","reported_seq":4416,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.988161+0000","last_change":"2024-05-08T21:21:24.988284+0000","last_active":"2024-05-08T21:21:24.988161+0000","last_peered":"2024-05-08T21:21:24.988161+0000","last_clean":"2024-05-08T21:21:24.988161+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:24.988161+0000","last_undegraded":"2024-05-08T21:21:24.988161+0000","last_fullsized":"2024-05-08T21:21:24.988161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4378","last_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_deep_scrub":"27'4378","last_deep_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.988136+0000","objects_scrubbed":2,"log_size":4378,"log_dups_size":0,"ondisk_log_size":4378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:35.977737+0000","scrub_duration":0.026713068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'818","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.076134+0000","last_change":"2024-05-08T21:21:29.076253+0000","last_active":"2024-05-08T21:21:29.076134+0000","last_peered":"2024-05-08T21:21:29.076134+0000","last_clean":"2024-05-08T21:21:29.076134+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:29.076134+0000","last_undegraded":"2024-05-08T21:21:29.076134+0000","last_fullsized":"2024-05-08T21:21:29.076134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.076108+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:53.637005+0000","scrub_duration":0.0043393650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3636,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.863242+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T21:21:06.863242+0000","last_peered":"2024-05-08T21:21:06.863242+0000","last_clean":"2024-05-08T21:21:06.863242+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:21:06.863242+0000","last_undegraded":"2024-05-08T21:21:06.863242+0000","last_fullsized":"2024-05-08T21:21:06.863242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1717","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.960412+0000","last_change":"2024-05-08T21:21:30.960412+0000","last_active":"2024-05-08T21:21:30.960412+0000","last_peered":"2024-05-08T21:21:30.960412+0000","last_clean":"2024-05-08T21:21:30.960412+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:30.960412+0000","last_undegraded":"2024-05-08T21:21:30.960412+0000","last_fullsized":"2024-05-08T21:21:30.960412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1717","last_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_deep_scrub":"27'1717","last_deep_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.960286+0000","objects_scrubbed":2,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.942541+0000","scrub_duration":0.026136829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'881","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.980335+0000","last_change":"2024-05-08T21:21:32.980335+0000","last_active":"2024-05-08T21:21:32.980335+0000","last_peered":"2024-05-08T21:21:32.980335+0000","last_clean":"2024-05-08T21:21:32.980335+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:32.980335+0000","last_undegraded":"2024-05-08T21:21:32.980335+0000","last_fullsized":"2024-05-08T21:21:32.980335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'881","last_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_deep_scrub":"27'881","last_deep_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.980155+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:57.541052+0000","scrub_duration":0.0015580380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:11.837755+0000","last_change":"2024-05-08T20:55:04.216100+0000","last_active":"2024-05-08T21:21:11.837755+0000","last_peered":"2024-05-08T21:21:11.837755+0000","last_clean":"2024-05-08T21:21:11.837755+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:11.837755+0000","last_undegraded":"2024-05-08T21:21:11.837755+0000","last_fullsized":"2024-05-08T21:21:11.837755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5273","reported_seq":5312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.857565+0000","last_change":"2024-05-08T21:21:29.857565+0000","last_active":"2024-05-08T21:21:29.857565+0000","last_peered":"2024-05-08T21:21:29.857565+0000","last_clean":"2024-05-08T21:21:29.857565+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:21:29.857565+0000","last_undegraded":"2024-05-08T21:21:29.857565+0000","last_fullsized":"2024-05-08T21:21:29.857565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5273","last_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_deep_scrub":"27'5273","last_deep_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.857411+0000","objects_scrubbed":4,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:42.773346+0000","scrub_duration":0.054139549000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'827","reported_seq":854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.020849+0000","last_change":"2024-05-08T20:55:00.090565+0000","last_active":"2024-05-08T21:21:21.020849+0000","last_peered":"2024-05-08T21:21:21.020849+0000","last_clean":"2024-05-08T21:21:21.020849+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:21.020849+0000","last_undegraded":"2024-05-08T21:21:21.020849+0000","last_fullsized":"2024-05-08T21:21:21.020849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860335+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T21:21:06.860335+0000","last_peered":"2024-05-08T21:21:06.860335+0000","last_clean":"2024-05-08T21:21:06.860335+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:21:06.860335+0000","last_undegraded":"2024-05-08T21:21:06.860335+0000","last_fullsized":"2024-05-08T21:21:06.860335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2694","reported_seq":3304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.008413+0000","last_change":"2024-05-08T21:21:40.008506+0000","last_active":"2024-05-08T21:21:40.008413+0000","last_peered":"2024-05-08T21:21:40.008413+0000","last_clean":"2024-05-08T21:21:40.008413+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:40.008413+0000","last_undegraded":"2024-05-08T21:21:40.008413+0000","last_fullsized":"2024-05-08T21:21:40.008413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2694","last_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_deep_scrub":"27'2694","last_deep_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.008388+0000","objects_scrubbed":5,"log_size":2694,"log_dups_size":0,"ondisk_log_size":2694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:26.309746+0000","scrub_duration":0.051681431999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1795,"num_write":2691,"num_write_kb":19159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'812","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.594704+0000","last_change":"2024-05-08T21:21:32.594810+0000","last_active":"2024-05-08T21:21:32.594704+0000","last_peered":"2024-05-08T21:21:32.594704+0000","last_clean":"2024-05-08T21:21:32.594704+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:32.594704+0000","last_undegraded":"2024-05-08T21:21:32.594704+0000","last_fullsized":"2024-05-08T21:21:32.594704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'812","last_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_deep_scrub":"27'812","last_deep_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.594677+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:45.576932+0000","scrub_duration":0.002123504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3342,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.707397+0000","last_change":"2024-05-08T20:55:04.105944+0000","last_active":"2024-05-08T21:21:05.707397+0000","last_peered":"2024-05-08T21:21:05.707397+0000","last_clean":"2024-05-08T21:21:05.707397+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:05.707397+0000","last_undegraded":"2024-05-08T21:21:05.707397+0000","last_fullsized":"2024-05-08T21:21:05.707397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3355","reported_seq":3394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.765436+0000","last_change":"2024-05-08T21:21:31.765436+0000","last_active":"2024-05-08T21:21:31.765436+0000","last_peered":"2024-05-08T21:21:31.765436+0000","last_clean":"2024-05-08T21:21:31.765436+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:31.765436+0000","last_undegraded":"2024-05-08T21:21:31.765436+0000","last_fullsized":"2024-05-08T21:21:31.765436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3355","last_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_deep_scrub":"27'3355","last_deep_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.765305+0000","objects_scrubbed":1,"log_size":3355,"log_dups_size":0,"ondisk_log_size":3355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:44.747560+0000","scrub_duration":0.018616456999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'825","reported_seq":853,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:20.515447+0000","last_change":"2024-05-08T20:55:00.097566+0000","last_active":"2024-05-08T21:21:20.515447+0000","last_peered":"2024-05-08T21:21:20.515447+0000","last_clean":"2024-05-08T21:21:20.515447+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:20.515447+0000","last_undegraded":"2024-05-08T21:21:20.515447+0000","last_fullsized":"2024-05-08T21:21:20.515447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4041,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.795848+0000","last_change":"2024-05-08T20:55:04.111037+0000","last_active":"2024-05-08T21:21:06.795848+0000","last_peered":"2024-05-08T21:21:06.795848+0000","last_clean":"2024-05-08T21:21:06.795848+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:21:06.795848+0000","last_undegraded":"2024-05-08T21:21:06.795848+0000","last_fullsized":"2024-05-08T21:21:06.795848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4049","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.877466+0000","last_change":"2024-05-08T21:21:31.877466+0000","last_active":"2024-05-08T21:21:31.877466+0000","last_peered":"2024-05-08T21:21:31.877466+0000","last_clean":"2024-05-08T21:21:31.877466+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:31.877466+0000","last_undegraded":"2024-05-08T21:21:31.877466+0000","last_fullsized":"2024-05-08T21:21:31.877466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4049","last_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_deep_scrub":"27'4049","last_deep_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.877246+0000","objects_scrubbed":3,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:56.438144+0000","scrub_duration":0.021654677000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4056,"num_write_kb":23095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'833","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:33.106298+0000","last_change":"2024-05-08T21:21:33.106409+0000","last_active":"2024-05-08T21:21:33.106298+0000","last_peered":"2024-05-08T21:21:33.106298+0000","last_clean":"2024-05-08T21:21:33.106298+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:33.106298+0000","last_undegraded":"2024-05-08T21:21:33.106298+0000","last_fullsized":"2024-05-08T21:21:33.106298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'833","last_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_deep_scrub":"27'833","last_deep_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_clean_scrub_stamp":"2024-05-08T21:21:33.106270+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:21.028217+0000","scrub_duration":0.0015875640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.837729+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T21:21:06.837729+0000","last_peered":"2024-05-08T21:21:06.837729+0000","last_clean":"2024-05-08T21:21:06.837729+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:21:06.837729+0000","last_undegraded":"2024-05-08T21:21:06.837729+0000","last_fullsized":"2024-05-08T21:21:06.837729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4551","reported_seq":4590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.984044+0000","last_change":"2024-05-08T21:21:26.984139+0000","last_active":"2024-05-08T21:21:26.984044+0000","last_peered":"2024-05-08T21:21:26.984044+0000","last_clean":"2024-05-08T21:21:26.984044+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:26.984044+0000","last_undegraded":"2024-05-08T21:21:26.984044+0000","last_fullsized":"2024-05-08T21:21:26.984044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4551","last_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_deep_scrub":"27'4551","last_deep_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.984019+0000","objects_scrubbed":5,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:14.905965+0000","scrub_duration":0.030483375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'805","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.080667+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T21:21:24.080667+0000","last_peered":"2024-05-08T21:21:24.080667+0000","last_clean":"2024-05-08T21:21:24.080667+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:21:24.080667+0000","last_undegraded":"2024-05-08T21:21:24.080667+0000","last_fullsized":"2024-05-08T21:21:24.080667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.063130+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T21:21:23.063130+0000","last_peered":"2024-05-08T21:21:23.063130+0000","last_clean":"2024-05-08T21:21:23.063130+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:21:23.063130+0000","last_undegraded":"2024-05-08T21:21:23.063130+0000","last_fullsized":"2024-05-08T21:21:23.063130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2511","reported_seq":2551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.046929+0000","last_change":"2024-05-08T21:21:21.047050+0000","last_active":"2024-05-08T21:21:21.046929+0000","last_peered":"2024-05-08T21:21:21.046929+0000","last_clean":"2024-05-08T21:21:21.046929+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:21.046929+0000","last_undegraded":"2024-05-08T21:21:21.046929+0000","last_fullsized":"2024-05-08T21:21:21.046929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2511","last_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_deep_scrub":"27'2511","last_deep_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.046889+0000","objects_scrubbed":3,"log_size":2511,"log_dups_size":0,"ondisk_log_size":2511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:40.172844+0000","scrub_duration":0.017442593999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'800","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.600144+0000","last_change":"2024-05-08T21:21:34.600251+0000","last_active":"2024-05-08T21:21:34.600144+0000","last_peered":"2024-05-08T21:21:34.600144+0000","last_clean":"2024-05-08T21:21:34.600144+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:34.600144+0000","last_undegraded":"2024-05-08T21:21:34.600144+0000","last_fullsized":"2024-05-08T21:21:34.600144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'800","last_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_deep_scrub":"27'800","last_deep_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.600116+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:59.161013+0000","scrub_duration":0.0021058320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3428,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.562677+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T21:21:05.562677+0000","last_peered":"2024-05-08T21:21:05.562677+0000","last_clean":"2024-05-08T21:21:05.562677+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:21:05.562677+0000","last_undegraded":"2024-05-08T21:21:05.562677+0000","last_fullsized":"2024-05-08T21:21:05.562677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.795968+0000","last_change":"2024-05-08T20:54:59.628502+0000","last_active":"2024-05-08T21:21:07.795968+0000","last_peered":"2024-05-08T21:21:07.795968+0000","last_clean":"2024-05-08T21:21:07.795968+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:07.795968+0000","last_undegraded":"2024-05-08T21:21:07.795968+0000","last_fullsized":"2024-05-08T21:21:07.795968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'834","reported_seq":862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.370934+0000","last_change":"2024-05-08T20:55:00.095269+0000","last_active":"2024-05-08T21:21:13.370934+0000","last_peered":"2024-05-08T21:21:13.370934+0000","last_clean":"2024-05-08T21:21:13.370934+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:13.370934+0000","last_undegraded":"2024-05-08T21:21:13.370934+0000","last_fullsized":"2024-05-08T21:21:13.370934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.041083+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T21:21:22.041083+0000","last_peered":"2024-05-08T21:21:22.041083+0000","last_clean":"2024-05-08T21:21:22.041083+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:21:22.041083+0000","last_undegraded":"2024-05-08T21:21:22.041083+0000","last_fullsized":"2024-05-08T21:21:22.041083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1101","reported_seq":1140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:39.018005+0000","last_change":"2024-05-08T21:21:39.018107+0000","last_active":"2024-05-08T21:21:39.018005+0000","last_peered":"2024-05-08T21:21:39.018005+0000","last_clean":"2024-05-08T21:21:39.018005+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:39.018005+0000","last_undegraded":"2024-05-08T21:21:39.018005+0000","last_fullsized":"2024-05-08T21:21:39.018005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1101","last_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_deep_scrub":"27'1101","last_deep_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_clean_scrub_stamp":"2024-05-08T21:21:39.017978+0000","objects_scrubbed":2,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:33.890814+0000","scrub_duration":0.026486484000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'819","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.362420+0000","last_change":"2024-05-08T20:55:00.087474+0000","last_active":"2024-05-08T21:21:13.362420+0000","last_peered":"2024-05-08T21:21:13.362420+0000","last_clean":"2024-05-08T21:21:13.362420+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:13.362420+0000","last_undegraded":"2024-05-08T21:21:13.362420+0000","last_fullsized":"2024-05-08T21:21:13.362420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:20.515556+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T21:21:20.515556+0000","last_peered":"2024-05-08T21:21:20.515556+0000","last_clean":"2024-05-08T21:21:20.515556+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:21:20.515556+0000","last_undegraded":"2024-05-08T21:21:20.515556+0000","last_fullsized":"2024-05-08T21:21:20.515556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1830","reported_seq":1870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.673979+0000","last_change":"2024-05-08T21:21:25.674104+0000","last_active":"2024-05-08T21:21:25.673979+0000","last_peered":"2024-05-08T21:21:25.673979+0000","last_clean":"2024-05-08T21:21:25.673979+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:25.673979+0000","last_undegraded":"2024-05-08T21:21:25.673979+0000","last_fullsized":"2024-05-08T21:21:25.673979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1830","last_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_deep_scrub":"27'1830","last_deep_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.673951+0000","objects_scrubbed":6,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:42.700633+0000","scrub_duration":0.019234405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'858","reported_seq":886,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355523+0000","last_change":"2024-05-08T20:55:00.103230+0000","last_active":"2024-05-08T21:21:13.355523+0000","last_peered":"2024-05-08T21:21:13.355523+0000","last_clean":"2024-05-08T21:21:13.355523+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:13.355523+0000","last_undegraded":"2024-05-08T21:21:13.355523+0000","last_fullsized":"2024-05-08T21:21:13.355523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.752726+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T21:21:07.752726+0000","last_peered":"2024-05-08T21:21:07.752726+0000","last_clean":"2024-05-08T21:21:07.752726+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:21:07.752726+0000","last_undegraded":"2024-05-08T21:21:07.752726+0000","last_fullsized":"2024-05-08T21:21:07.752726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1832","reported_seq":1872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.055638+0000","last_change":"2024-05-08T21:21:28.055783+0000","last_active":"2024-05-08T21:21:28.055638+0000","last_peered":"2024-05-08T21:21:28.055638+0000","last_clean":"2024-05-08T21:21:28.055638+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:28.055638+0000","last_undegraded":"2024-05-08T21:21:28.055638+0000","last_fullsized":"2024-05-08T21:21:28.055638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1832","last_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_deep_scrub":"27'1832","last_deep_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.055611+0000","objects_scrubbed":2,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:40.971546+0000","scrub_duration":0.014408755000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'841","reported_seq":880,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.197429+0000","last_change":"2024-05-08T21:21:24.197534+0000","last_active":"2024-05-08T21:21:24.197429+0000","last_peered":"2024-05-08T21:21:24.197429+0000","last_clean":"2024-05-08T21:21:24.197429+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:24.197429+0000","last_undegraded":"2024-05-08T21:21:24.197429+0000","last_fullsized":"2024-05-08T21:21:24.197429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'841","last_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_deep_scrub":"27'841","last_deep_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.197404+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:14.802421+0000","scrub_duration":0.001513105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4242,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860298+0000","last_change":"2024-05-08T20:55:04.107097+0000","last_active":"2024-05-08T21:21:06.860298+0000","last_peered":"2024-05-08T21:21:06.860298+0000","last_clean":"2024-05-08T21:21:06.860298+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:06.860298+0000","last_undegraded":"2024-05-08T21:21:06.860298+0000","last_fullsized":"2024-05-08T21:21:06.860298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1215","reported_seq":1255,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.896203+0000","last_change":"2024-05-08T21:21:22.896292+0000","last_active":"2024-05-08T21:21:22.896203+0000","last_peered":"2024-05-08T21:21:22.896203+0000","last_clean":"2024-05-08T21:21:22.896203+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:22.896203+0000","last_undegraded":"2024-05-08T21:21:22.896203+0000","last_fullsized":"2024-05-08T21:21:22.896203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1215","last_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_deep_scrub":"27'1215","last_deep_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.896177+0000","objects_scrubbed":1,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:50.970681+0000","scrub_duration":0.015373217999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'822","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376268+0000","last_change":"2024-05-08T20:55:00.091890+0000","last_active":"2024-05-08T21:21:13.376268+0000","last_peered":"2024-05-08T21:21:13.376268+0000","last_clean":"2024-05-08T21:21:13.376268+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:13.376268+0000","last_undegraded":"2024-05-08T21:21:13.376268+0000","last_fullsized":"2024-05-08T21:21:13.376268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3511,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889900+0000","last_change":"2024-05-08T20:55:41.599810+0000","last_active":"2024-05-08T21:21:06.889900+0000","last_peered":"2024-05-08T21:21:06.889900+0000","last_clean":"2024-05-08T21:21:06.889900+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:21:06.889900+0000","last_undegraded":"2024-05-08T21:21:06.889900+0000","last_fullsized":"2024-05-08T21:21:06.889900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5324","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:35.739075+0000","last_change":"2024-05-08T21:21:35.739165+0000","last_active":"2024-05-08T21:21:35.739075+0000","last_peered":"2024-05-08T21:21:35.739075+0000","last_clean":"2024-05-08T21:21:35.739075+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:35.739075+0000","last_undegraded":"2024-05-08T21:21:35.739075+0000","last_fullsized":"2024-05-08T21:21:35.739075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5324","last_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_deep_scrub":"27'5324","last_deep_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_clean_scrub_stamp":"2024-05-08T21:21:35.739051+0000","objects_scrubbed":6,"log_size":5324,"log_dups_size":0,"ondisk_log_size":5324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:01.155361+0000","scrub_duration":0.059511772999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007490,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5317,"num_write_kb":42298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'815","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.361004+0000","last_change":"2024-05-08T20:55:00.085934+0000","last_active":"2024-05-08T21:21:13.361004+0000","last_peered":"2024-05-08T21:21:13.361004+0000","last_clean":"2024-05-08T21:21:13.361004+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:13.361004+0000","last_undegraded":"2024-05-08T21:21:13.361004+0000","last_fullsized":"2024-05-08T21:21:13.361004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3418","reported_seq":3445,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.781158+0000","last_change":"2024-05-08T20:55:04.114879+0000","last_active":"2024-05-08T21:21:13.781158+0000","last_peered":"2024-05-08T21:21:13.781158+0000","last_clean":"2024-05-08T21:21:13.781158+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:21:13.781158+0000","last_undegraded":"2024-05-08T21:21:13.781158+0000","last_fullsized":"2024-05-08T21:21:13.781158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'844","reported_seq":873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.356331+0000","last_change":"2024-05-08T20:55:00.075395+0000","last_active":"2024-05-08T21:21:13.356331+0000","last_peered":"2024-05-08T21:21:13.356331+0000","last_clean":"2024-05-08T21:21:13.356331+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:13.356331+0000","last_undegraded":"2024-05-08T21:21:13.356331+0000","last_fullsized":"2024-05-08T21:21:13.356331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.633318+0000","last_change":"2024-05-08T21:21:27.633436+0000","last_active":"2024-05-08T21:21:27.633318+0000","last_peered":"2024-05-08T21:21:27.633318+0000","last_clean":"2024-05-08T21:21:27.633318+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:27.633318+0000","last_undegraded":"2024-05-08T21:21:27.633318+0000","last_fullsized":"2024-05-08T21:21:27.633318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3945","last_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_deep_scrub":"27'3945","last_deep_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.633289+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:18.238307+0000","scrub_duration":0.0021982780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4042,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.829273+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T21:21:06.829273+0000","last_peered":"2024-05-08T21:21:06.829273+0000","last_clean":"2024-05-08T21:21:06.829273+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:21:06.829273+0000","last_undegraded":"2024-05-08T21:21:06.829273+0000","last_fullsized":"2024-05-08T21:21:06.829273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'844","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.626410+0000","last_change":"2024-05-08T21:21:31.626525+0000","last_active":"2024-05-08T21:21:31.626410+0000","last_peered":"2024-05-08T21:21:31.626410+0000","last_clean":"2024-05-08T21:21:31.626410+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:31.626410+0000","last_undegraded":"2024-05-08T21:21:31.626410+0000","last_fullsized":"2024-05-08T21:21:31.626410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.626385+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:26.764578+0000","scrub_duration":0.002149495,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2356","reported_seq":2396,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.779052+0000","last_change":"2024-05-08T21:21:30.779163+0000","last_active":"2024-05-08T21:21:30.779052+0000","last_peered":"2024-05-08T21:21:30.779052+0000","last_clean":"2024-05-08T21:21:30.779052+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:30.779052+0000","last_undegraded":"2024-05-08T21:21:30.779052+0000","last_fullsized":"2024-05-08T21:21:30.779052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2356","last_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_deep_scrub":"27'2356","last_deep_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.779025+0000","objects_scrubbed":2,"log_size":2356,"log_dups_size":0,"ondisk_log_size":2356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.917218+0000","scrub_duration":0.024843976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.235943+0000","last_change":"2024-05-08T21:21:28.236054+0000","last_active":"2024-05-08T21:21:28.235943+0000","last_peered":"2024-05-08T21:21:28.235943+0000","last_clean":"2024-05-08T21:21:28.235943+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:21:28.235943+0000","last_undegraded":"2024-05-08T21:21:28.235943+0000","last_fullsized":"2024-05-08T21:21:28.235943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.235917+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.151852+0000","scrub_duration":0.011500560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.894977+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T21:21:06.894977+0000","last_peered":"2024-05-08T21:21:06.894977+0000","last_clean":"2024-05-08T21:21:06.894977+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:21:06.894977+0000","last_undegraded":"2024-05-08T21:21:06.894977+0000","last_fullsized":"2024-05-08T21:21:06.894977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'788","reported_seq":828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.126582+0000","last_change":"2024-05-08T21:21:27.126691+0000","last_active":"2024-05-08T21:21:27.126582+0000","last_peered":"2024-05-08T21:21:27.126582+0000","last_clean":"2024-05-08T21:21:27.126582+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:27.126582+0000","last_undegraded":"2024-05-08T21:21:27.126582+0000","last_fullsized":"2024-05-08T21:21:27.126582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'788","last_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_deep_scrub":"27'788","last_deep_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.126529+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:40.108784+0000","scrub_duration":0.0023240880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4041","reported_seq":4083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.245520+0000","last_change":"2024-05-08T21:21:30.245636+0000","last_active":"2024-05-08T21:21:30.245520+0000","last_peered":"2024-05-08T21:21:30.245520+0000","last_clean":"2024-05-08T21:21:30.245520+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:30.245520+0000","last_undegraded":"2024-05-08T21:21:30.245520+0000","last_fullsized":"2024-05-08T21:21:30.245520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4041","last_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_deep_scrub":"27'4041","last_deep_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.245496+0000","objects_scrubbed":3,"log_size":4041,"log_dups_size":0,"ondisk_log_size":4041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.227751+0000","scrub_duration":0.033406524999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.839732+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T21:21:06.839732+0000","last_peered":"2024-05-08T21:21:06.839732+0000","last_clean":"2024-05-08T21:21:06.839732+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:21:06.839732+0000","last_undegraded":"2024-05-08T21:21:06.839732+0000","last_fullsized":"2024-05-08T21:21:06.839732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2956","reported_seq":2997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.155186+0000","last_change":"2024-05-08T21:21:34.155283+0000","last_active":"2024-05-08T21:21:34.155186+0000","last_peered":"2024-05-08T21:21:34.155186+0000","last_clean":"2024-05-08T21:21:34.155186+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:34.155186+0000","last_undegraded":"2024-05-08T21:21:34.155186+0000","last_fullsized":"2024-05-08T21:21:34.155186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2956","last_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_deep_scrub":"27'2956","last_deep_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.155158+0000","objects_scrubbed":1,"log_size":2956,"log_dups_size":0,"ondisk_log_size":2956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:59.571468+0000","scrub_duration":0.015577423999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'839","reported_seq":867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.355150+0000","last_change":"2024-05-08T20:55:00.075433+0000","last_active":"2024-05-08T21:21:13.355150+0000","last_peered":"2024-05-08T21:21:13.355150+0000","last_clean":"2024-05-08T21:21:13.355150+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:13.355150+0000","last_undegraded":"2024-05-08T21:21:13.355150+0000","last_fullsized":"2024-05-08T21:21:13.355150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3594,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:12.638800+0000","last_change":"2024-05-08T20:55:04.214817+0000","last_active":"2024-05-08T21:21:12.638800+0000","last_peered":"2024-05-08T21:21:12.638800+0000","last_clean":"2024-05-08T21:21:12.638800+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:12.638800+0000","last_undegraded":"2024-05-08T21:21:12.638800+0000","last_fullsized":"2024-05-08T21:21:12.638800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2161","reported_seq":2201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.877526+0000","last_change":"2024-05-08T21:21:24.877608+0000","last_active":"2024-05-08T21:21:24.877526+0000","last_peered":"2024-05-08T21:21:24.877526+0000","last_clean":"2024-05-08T21:21:24.877526+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:24.877526+0000","last_undegraded":"2024-05-08T21:21:24.877526+0000","last_fullsized":"2024-05-08T21:21:24.877526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2161","last_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_deep_scrub":"27'2161","last_deep_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.877501+0000","objects_scrubbed":4,"log_size":2161,"log_dups_size":0,"ondisk_log_size":2161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.662888+0000","scrub_duration":0.036106909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2748,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'779","reported_seq":808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.351509+0000","last_change":"2024-05-08T20:55:00.100328+0000","last_active":"2024-05-08T21:21:13.351509+0000","last_peered":"2024-05-08T21:21:13.351509+0000","last_clean":"2024-05-08T21:21:13.351509+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:13.351509+0000","last_undegraded":"2024-05-08T21:21:13.351509+0000","last_fullsized":"2024-05-08T21:21:13.351509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.815210+0000","last_change":"2024-05-08T20:55:04.214916+0000","last_active":"2024-05-08T21:21:06.815210+0000","last_peered":"2024-05-08T21:21:06.815210+0000","last_clean":"2024-05-08T21:21:06.815210+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:06.815210+0000","last_undegraded":"2024-05-08T21:21:06.815210+0000","last_fullsized":"2024-05-08T21:21:06.815210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1267","reported_seq":1307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:36.960796+0000","last_change":"2024-05-08T21:21:36.960886+0000","last_active":"2024-05-08T21:21:36.960796+0000","last_peered":"2024-05-08T21:21:36.960796+0000","last_clean":"2024-05-08T21:21:36.960796+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:36.960796+0000","last_undegraded":"2024-05-08T21:21:36.960796+0000","last_fullsized":"2024-05-08T21:21:36.960796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1267","last_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_deep_scrub":"27'1267","last_deep_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_clean_scrub_stamp":"2024-05-08T21:21:36.960770+0000","objects_scrubbed":2,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:16.837167+0000","scrub_duration":0.013455020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'819","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.045835+0000","last_change":"2024-05-08T21:21:40.045946+0000","last_active":"2024-05-08T21:21:40.045835+0000","last_peered":"2024-05-08T21:21:40.045835+0000","last_clean":"2024-05-08T21:21:40.045835+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:40.045835+0000","last_undegraded":"2024-05-08T21:21:40.045835+0000","last_fullsized":"2024-05-08T21:21:40.045835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.045808+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:19.922206+0000","scrub_duration":0.003983337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.902899+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T21:21:06.902899+0000","last_peered":"2024-05-08T21:21:06.902899+0000","last_clean":"2024-05-08T21:21:06.902899+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:21:06.902899+0000","last_undegraded":"2024-05-08T21:21:06.902899+0000","last_fullsized":"2024-05-08T21:21:06.902899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1126","reported_seq":1156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.788794+0000","last_change":"2024-05-08T20:54:59.633312+0000","last_active":"2024-05-08T21:21:07.788794+0000","last_peered":"2024-05-08T21:21:07.788794+0000","last_clean":"2024-05-08T21:21:07.788794+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:07.788794+0000","last_undegraded":"2024-05-08T21:21:07.788794+0000","last_fullsized":"2024-05-08T21:21:07.788794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:58.591914+0000","last_clean_scrub_stamp":"2024-05-08T20:54:58.591914+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.053152+0000","last_change":"2024-05-08T21:21:29.053278+0000","last_active":"2024-05-08T21:21:29.053152+0000","last_peered":"2024-05-08T21:21:29.053152+0000","last_clean":"2024-05-08T21:21:29.053152+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:29.053152+0000","last_undegraded":"2024-05-08T21:21:29.053152+0000","last_fullsized":"2024-05-08T21:21:29.053152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.053124+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.191318+0000","scrub_duration":0.0019797819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3495,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.906857+0000","last_change":"2024-05-08T20:55:04.211720+0000","last_active":"2024-05-08T21:21:06.906857+0000","last_peered":"2024-05-08T21:21:06.906857+0000","last_clean":"2024-05-08T21:21:06.906857+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:06.906857+0000","last_undegraded":"2024-05-08T21:21:06.906857+0000","last_fullsized":"2024-05-08T21:21:06.906857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2227","reported_seq":2267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.905689+0000","last_change":"2024-05-08T21:21:32.905786+0000","last_active":"2024-05-08T21:21:32.905689+0000","last_peered":"2024-05-08T21:21:32.905689+0000","last_clean":"2024-05-08T21:21:32.905689+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:32.905689+0000","last_undegraded":"2024-05-08T21:21:32.905689+0000","last_fullsized":"2024-05-08T21:21:32.905689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2227","last_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_deep_scrub":"27'2227","last_deep_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.905663+0000","objects_scrubbed":2,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:58.321972+0000","scrub_duration":0.026572928999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'888","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.888496+0000","last_change":"2024-05-08T21:21:26.888635+0000","last_active":"2024-05-08T21:21:26.888496+0000","last_peered":"2024-05-08T21:21:26.888496+0000","last_clean":"2024-05-08T21:21:26.888496+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:26.888496+0000","last_undegraded":"2024-05-08T21:21:26.888496+0000","last_fullsized":"2024-05-08T21:21:26.888496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'888","last_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_deep_scrub":"27'888","last_deep_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.888468+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:46.014423+0000","scrub_duration":0.0039110660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3782,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.718996+0000","last_change":"2024-05-08T20:55:04.110094+0000","last_active":"2024-05-08T21:21:05.718996+0000","last_peered":"2024-05-08T21:21:05.718996+0000","last_clean":"2024-05-08T21:21:05.718996+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:05.718996+0000","last_undegraded":"2024-05-08T21:21:05.718996+0000","last_fullsized":"2024-05-08T21:21:05.718996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3680","reported_seq":3720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.885021+0000","last_change":"2024-05-08T21:21:29.885123+0000","last_active":"2024-05-08T21:21:29.885021+0000","last_peered":"2024-05-08T21:21:29.885021+0000","last_clean":"2024-05-08T21:21:29.885021+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:29.885021+0000","last_undegraded":"2024-05-08T21:21:29.885021+0000","last_fullsized":"2024-05-08T21:21:29.885021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3680","last_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_deep_scrub":"27'3680","last_deep_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.884993+0000","objects_scrubbed":2,"log_size":3680,"log_dups_size":0,"ondisk_log_size":3680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.867249+0000","scrub_duration":0.031053055999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'844","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.361184+0000","last_change":"2024-05-08T20:55:00.089804+0000","last_active":"2024-05-08T21:21:13.361184+0000","last_peered":"2024-05-08T21:21:13.361184+0000","last_clean":"2024-05-08T21:21:13.361184+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:13.361184+0000","last_undegraded":"2024-05-08T21:21:13.361184+0000","last_fullsized":"2024-05-08T21:21:13.361184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3513,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714703+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T21:21:05.714703+0000","last_peered":"2024-05-08T21:21:05.714703+0000","last_clean":"2024-05-08T21:21:05.714703+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:21:05.714703+0000","last_undegraded":"2024-05-08T21:21:05.714703+0000","last_fullsized":"2024-05-08T21:21:05.714703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4109","reported_seq":4149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.255769+0000","last_change":"2024-05-08T21:21:29.255874+0000","last_active":"2024-05-08T21:21:29.255769+0000","last_peered":"2024-05-08T21:21:29.255769+0000","last_clean":"2024-05-08T21:21:29.255769+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:29.255769+0000","last_undegraded":"2024-05-08T21:21:29.255769+0000","last_fullsized":"2024-05-08T21:21:29.255769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4109","last_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_deep_scrub":"27'4109","last_deep_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.255742+0000","objects_scrubbed":3,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.393936+0000","scrub_duration":0.030240922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'810","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.358530+0000","last_change":"2024-05-08T20:55:00.089841+0000","last_active":"2024-05-08T21:21:13.358530+0000","last_peered":"2024-05-08T21:21:13.358530+0000","last_clean":"2024-05-08T21:21:13.358530+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:13.358530+0000","last_undegraded":"2024-05-08T21:21:13.358530+0000","last_fullsized":"2024-05-08T21:21:13.358530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.710824+0000","last_change":"2024-05-08T20:55:41.605046+0000","last_active":"2024-05-08T21:21:07.710824+0000","last_peered":"2024-05-08T21:21:07.710824+0000","last_clean":"2024-05-08T21:21:07.710824+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:21:07.710824+0000","last_undegraded":"2024-05-08T21:21:07.710824+0000","last_fullsized":"2024-05-08T21:21:07.710824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3441","reported_seq":3481,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.602506+0000","last_change":"2024-05-08T21:21:21.602580+0000","last_active":"2024-05-08T21:21:21.602506+0000","last_peered":"2024-05-08T21:21:21.602506+0000","last_clean":"2024-05-08T21:21:21.602506+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:21.602506+0000","last_undegraded":"2024-05-08T21:21:21.602506+0000","last_fullsized":"2024-05-08T21:21:21.602506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3441","last_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_deep_scrub":"27'3441","last_deep_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.602478+0000","objects_scrubbed":5,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:12.507196+0000","scrub_duration":0.053816461000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'810","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.215399+0000","last_change":"2024-05-08T21:21:26.215510+0000","last_active":"2024-05-08T21:21:26.215399+0000","last_peered":"2024-05-08T21:21:26.215399+0000","last_clean":"2024-05-08T21:21:26.215399+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:26.215399+0000","last_undegraded":"2024-05-08T21:21:26.215399+0000","last_fullsized":"2024-05-08T21:21:26.215399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'810","last_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_deep_scrub":"27'810","last_deep_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.215374+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:22.000760+0000","scrub_duration":0.0030007150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.864134+0000","last_change":"2024-05-08T20:55:41.613686+0000","last_active":"2024-05-08T21:21:06.864134+0000","last_peered":"2024-05-08T21:21:06.864134+0000","last_clean":"2024-05-08T21:21:06.864134+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:21:06.864134+0000","last_undegraded":"2024-05-08T21:21:06.864134+0000","last_fullsized":"2024-05-08T21:21:06.864134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3911","reported_seq":3950,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.858105+0000","last_change":"2024-05-08T21:21:21.858266+0000","last_active":"2024-05-08T21:21:21.858105+0000","last_peered":"2024-05-08T21:21:21.858105+0000","last_clean":"2024-05-08T21:21:21.858105+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:21.858105+0000","last_undegraded":"2024-05-08T21:21:21.858105+0000","last_fullsized":"2024-05-08T21:21:21.858105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3911","last_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_deep_scrub":"27'3911","last_deep_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.858055+0000","objects_scrubbed":2,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:12.384037+0000","scrub_duration":0.015982177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'819","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376283+0000","last_change":"2024-05-08T20:55:00.093120+0000","last_active":"2024-05-08T21:21:13.376283+0000","last_peered":"2024-05-08T21:21:13.376283+0000","last_clean":"2024-05-08T21:21:13.376283+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:13.376283+0000","last_undegraded":"2024-05-08T21:21:13.376283+0000","last_fullsized":"2024-05-08T21:21:13.376283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3415,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.626642+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T21:21:07.626642+0000","last_peered":"2024-05-08T21:21:07.626642+0000","last_clean":"2024-05-08T21:21:07.626642+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:21:07.626642+0000","last_undegraded":"2024-05-08T21:21:07.626642+0000","last_fullsized":"2024-05-08T21:21:07.626642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1802","reported_seq":1842,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.593327+0000","last_change":"2024-05-08T21:21:22.593429+0000","last_active":"2024-05-08T21:21:22.593327+0000","last_peered":"2024-05-08T21:21:22.593327+0000","last_clean":"2024-05-08T21:21:22.593327+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:22.593327+0000","last_undegraded":"2024-05-08T21:21:22.593327+0000","last_fullsized":"2024-05-08T21:21:22.593327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1802","last_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_deep_scrub":"27'1802","last_deep_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.593300+0000","objects_scrubbed":1,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:44.040446+0000","scrub_duration":0.0043429840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'818","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.362854+0000","last_change":"2024-05-08T20:55:00.096450+0000","last_active":"2024-05-08T21:21:13.362854+0000","last_peered":"2024-05-08T21:21:13.362854+0000","last_clean":"2024-05-08T21:21:13.362854+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:13.362854+0000","last_undegraded":"2024-05-08T21:21:13.362854+0000","last_fullsized":"2024-05-08T21:21:13.362854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'845","reported_seq":873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.362344+0000","last_change":"2024-05-08T20:55:00.090634+0000","last_active":"2024-05-08T21:21:13.362344+0000","last_peered":"2024-05-08T21:21:13.362344+0000","last_clean":"2024-05-08T21:21:13.362344+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:13.362344+0000","last_undegraded":"2024-05-08T21:21:13.362344+0000","last_fullsized":"2024-05-08T21:21:13.362344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'869","reported_seq":917,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.662227+0000","last_change":"2024-05-08T21:21:28.662357+0000","last_active":"2024-05-08T21:21:28.662227+0000","last_peered":"2024-05-08T21:21:28.662227+0000","last_clean":"2024-05-08T21:21:28.662227+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:28.662227+0000","last_undegraded":"2024-05-08T21:21:28.662227+0000","last_fullsized":"2024-05-08T21:21:28.662227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'869","last_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_deep_scrub":"27'869","last_deep_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.662201+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:47.788156+0000","scrub_duration":0.0052510159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'817","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.739694+0000","last_change":"2024-05-08T21:21:24.739823+0000","last_active":"2024-05-08T21:21:24.739694+0000","last_peered":"2024-05-08T21:21:24.739694+0000","last_clean":"2024-05-08T21:21:24.739694+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:24.739694+0000","last_undegraded":"2024-05-08T21:21:24.739694+0000","last_fullsized":"2024-05-08T21:21:24.739694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'817","last_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_deep_scrub":"27'817","last_deep_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.739660+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:15.265642+0000","scrub_duration":0.002018003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'848","reported_seq":877,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.360650+0000","last_change":"2024-05-08T20:55:00.094915+0000","last_active":"2024-05-08T21:21:13.360650+0000","last_peered":"2024-05-08T21:21:13.360650+0000","last_clean":"2024-05-08T21:21:13.360650+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:13.360650+0000","last_undegraded":"2024-05-08T21:21:13.360650+0000","last_fullsized":"2024-05-08T21:21:13.360650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'814","reported_seq":843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.357586+0000","last_change":"2024-05-08T20:55:00.087299+0000","last_active":"2024-05-08T21:21:13.357586+0000","last_peered":"2024-05-08T21:21:13.357586+0000","last_clean":"2024-05-08T21:21:13.357586+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:13.357586+0000","last_undegraded":"2024-05-08T21:21:13.357586+0000","last_fullsized":"2024-05-08T21:21:13.357586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'818","reported_seq":846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.342806+0000","last_change":"2024-05-08T20:55:00.090395+0000","last_active":"2024-05-08T21:21:13.342806+0000","last_peered":"2024-05-08T21:21:13.342806+0000","last_clean":"2024-05-08T21:21:13.342806+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:13.342806+0000","last_undegraded":"2024-05-08T21:21:13.342806+0000","last_fullsized":"2024-05-08T21:21:13.342806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'882","reported_seq":910,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.374791+0000","last_change":"2024-05-08T20:55:00.094008+0000","last_active":"2024-05-08T21:21:13.374791+0000","last_peered":"2024-05-08T21:21:13.374791+0000","last_clean":"2024-05-08T21:21:13.374791+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:21:13.374791+0000","last_undegraded":"2024-05-08T21:21:13.374791+0000","last_fullsized":"2024-05-08T21:21:13.374791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'808","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.790030+0000","last_change":"2024-05-08T21:21:23.790119+0000","last_active":"2024-05-08T21:21:23.790030+0000","last_peered":"2024-05-08T21:21:23.790030+0000","last_clean":"2024-05-08T21:21:23.790030+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:23.790030+0000","last_undegraded":"2024-05-08T21:21:23.790030+0000","last_fullsized":"2024-05-08T21:21:23.790030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'808","last_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_deep_scrub":"27'808","last_deep_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_clean_scrub_stamp":"2024-05-08T21:21:23.790007+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:31.585133+0000","scrub_duration":0.0053510820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'808","reported_seq":836,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.378388+0000","last_change":"2024-05-08T20:55:00.097618+0000","last_active":"2024-05-08T21:21:13.378388+0000","last_peered":"2024-05-08T21:21:13.378388+0000","last_clean":"2024-05-08T21:21:13.378388+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:13.378388+0000","last_undegraded":"2024-05-08T21:21:13.378388+0000","last_fullsized":"2024-05-08T21:21:13.378388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'798","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.357668+0000","last_change":"2024-05-08T20:55:00.085406+0000","last_active":"2024-05-08T21:21:13.357668+0000","last_peered":"2024-05-08T21:21:13.357668+0000","last_clean":"2024-05-08T21:21:13.357668+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:13.357668+0000","last_undegraded":"2024-05-08T21:21:13.357668+0000","last_fullsized":"2024-05-08T21:21:13.357668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'833","reported_seq":860,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.378507+0000","last_change":"2024-05-08T20:55:00.100941+0000","last_active":"2024-05-08T21:21:13.378507+0000","last_peered":"2024-05-08T21:21:13.378507+0000","last_clean":"2024-05-08T21:21:13.378507+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:13.378507+0000","last_undegraded":"2024-05-08T21:21:13.378507+0000","last_fullsized":"2024-05-08T21:21:13.378507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'841","reported_seq":869,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.365379+0000","last_change":"2024-05-08T20:55:00.100827+0000","last_active":"2024-05-08T21:21:13.365379+0000","last_peered":"2024-05-08T21:21:13.365379+0000","last_clean":"2024-05-08T21:21:13.365379+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:13.365379+0000","last_undegraded":"2024-05-08T21:21:13.365379+0000","last_fullsized":"2024-05-08T21:21:13.365379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'836","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.366117+0000","last_change":"2024-05-08T20:55:00.090525+0000","last_active":"2024-05-08T21:21:13.366117+0000","last_peered":"2024-05-08T21:21:13.366117+0000","last_clean":"2024-05-08T21:21:13.366117+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:13.366117+0000","last_undegraded":"2024-05-08T21:21:13.366117+0000","last_fullsized":"2024-05-08T21:21:13.366117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86560,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113556,"ondisk_log_size":113556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52760,"ondisk_log_size":52760,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243565076,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2931,"num_read_kb":7530,"num_write":91807,"num_write_kb":660236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487194624,"data_stored":487130152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91119,"ondisk_log_size":91119,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575175,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516716,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":450302,"kb_avail":93855124,"statfs":{"total":96636764160,"available":96107646976,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":461109707},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.47099999999999997},"min":{"1min":0.247,"5min":0.216,"15min":0.191},"max":{"1min":2.996,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67200000000000004,"15min":0.501},"min":{"1min":0.30299999999999999,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":2.121,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.54100000000000004}]},{"osd":1,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.752,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.5660000000000001,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.67400000000000004,"15min":0.51800000000000002},"min":{"1min":0.25800000000000001,"5min":0.22,"15min":0.20499999999999999},"max":{"1min":1.385,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.5},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":2.3519999999999999,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.621,"15min":0.50700000000000001},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.3380000000000001,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.60199999999999998}]},{"osd":3,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77300000000000002,"15min":0.56000000000000005},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.1269999999999998,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.627},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.81599999999999995,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":9.0800000000000001,"5min":9.0800000000000001,"15min":9.0800000000000001},"last":0.61599999999999999}]},{"osd":4,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":1.0329999999999999,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":2.7589999999999999,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.41899999999999998}]},{"osd":5,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.68300000000000005,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":1.304,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.436},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76100000000000001,"15min":0.58899999999999997},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":1.472,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.68400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":0.83299999999999996,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.60399999999999998},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":3.0310000000000001,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575175,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.45500000000000002,"15min":0.42099999999999999},"min":{"1min":0.23000000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.59199999999999997,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.42999999999999999,"15min":0.41699999999999998},"min":{"1min":0.24099999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.53200000000000003,"5min":2.1080000000000001,"15min":3.839},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.63600000000000001,"15min":0.49399999999999999},"min":{"1min":0.26100000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":1.4370000000000001,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.53600000000000003,"15min":0.47999999999999998},"min":{"1min":0.28000000000000003,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":0.56499999999999995,"5min":3.4990000000000001,"15min":3.4990000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.48599999999999999},"min":{"1min":0.26800000000000002,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.3089999999999999,"5min":3.694,"15min":3.694},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.60399999999999998,"15min":0.497},"min":{"1min":0.28699999999999998,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":1.2709999999999999,"5min":4.0620000000000003,"15min":4.0620000000000003},"last":0.59899999999999998}]},{"osd":3,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.56599999999999995,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":1.661,"5min":3.218,"15min":3.8250000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":1.4770000000000001,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.53100000000000003,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.64500000000000002,"5min":3.077,"15min":7.3810000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.72899999999999998,"15min":0.56399999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.222},"max":{"1min":0.66600000000000004,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.55100000000000005}]},{"osd":5,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52400000000000002,"15min":0.495},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.4039999999999999,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.56499999999999995},"min":{"1min":0.35399999999999998,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":1.3420000000000001,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed May 8 21:20:45 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.59699999999999998,"15min":0.55300000000000005},"min":{"1min":0.40899999999999997,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.70499999999999996,"5min":3.1909999999999998,"15min":3.8100000000000001},"last":0.63},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.56100000000000005},"min":{"1min":0.371,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":1.5009999999999999,"5min":2.919,"15min":3.8780000000000001},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575175,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581444,"kb_used_data":81084,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790396,"statfs":{"total":96636764160,"available":96041365504,"internally_reserved":0,"allocated":83030016,"data_stored":82846318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.47399999999999998,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":1.349,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"min":{"1min":0.185,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.52500000000000002,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":1.448,"5min":5.141,"15min":5.141},"last":0.377},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.55300000000000005,"15min":0.46400000000000002},"min":{"1min":0.311,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.4750000000000001,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.46200000000000002}]},{"osd":3,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.64000000000000001,"15min":0.501},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.321,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.438},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.51600000000000001,"15min":0.46100000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.19},"max":{"1min":0.67700000000000005,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.48699999999999999}]},{"osd":4,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55400000000000005,"15min":0.50600000000000001},"min":{"1min":0.254,"5min":0.25,"15min":0.247},"max":{"1min":0.84299999999999997,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66100000000000003,"15min":0.54800000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.2829999999999999,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.50700000000000001},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":1.006,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.59599999999999997,"15min":0.56100000000000005},"min":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.626}]},{"osd":6,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.67100000000000004,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0369999999999999,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.63100000000000001,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.28499999999999998},"max":{"1min":0.86499999999999999,"5min":6.766,"15min":6.766},"last":0.66700000000000004}]},{"osd":7,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.746,"15min":0.60399999999999998},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":1.377,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69999999999999996,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.33900000000000002},"max":{"1min":0.96599999999999997,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.65300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575176,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375604,"kb_used_data":29548,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996236,"statfs":{"total":96636764160,"available":96252145664,"internally_reserved":0,"allocated":30257152,"data_stored":30069546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40500000000000003,"15min":0.34699999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.86099999999999999,"5min":3.823,"15min":3.823},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.45200000000000001,"15min":0.41199999999999998},"min":{"1min":0.27600000000000002,"5min":0.23100000000000001,"15min":0.19},"max":{"1min":2.734,"5min":3.879,"15min":4.5919999999999996},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.45700000000000002,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20999999999999999,"15min":0.17399999999999999},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.9870000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.49199999999999999,"15min":0.438},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":2.4900000000000002,"5min":3.7160000000000002,"15min":3.895},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.498,"15min":0.44400000000000001},"min":{"1min":0.26500000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":2.4750000000000001,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.48499999999999999},"min":{"1min":0.38500000000000001,"5min":0.26400000000000001,"15min":0.254},"max":{"1min":1.127,"5min":3.794,"15min":5.6559999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.496,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.76400000000000001,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.61499999999999999}]},{"osd":5,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.55500000000000005,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":4.298,"5min":4.298,"15min":4.298},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.77100000000000002,"15min":0.60299999999999998},"min":{"1min":0.40300000000000002,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":1.206,"5min":14.901,"15min":14.901},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":1.0329999999999999,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.60199999999999998,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":2.7669999999999999,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.31900000000000001},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":5.0220000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.61699999999999999},"min":{"1min":0.45300000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":1.1739999999999999,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575175,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.39200000000000002,"15min":0.34200000000000003},"min":{"1min":0.19600000000000001,"5min":0.17899999999999999,"15min":0.17399999999999999},"max":{"1min":0.42999999999999999,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.44900000000000001,"15min":0.40699999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.91500000000000004,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.44400000000000001}]},{"osd":1,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.44900000000000001,"15min":0.39600000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.186},"max":{"1min":0.47599999999999998,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.58299999999999996,"15min":0.47399999999999998},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.41199999999999998,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.501}]},{"osd":3,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.433,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":2.0019999999999998,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.249,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":0.64800000000000002,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":7.3799999999999999,"15min":16.651},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.629,"15min":0.63},"min":{"1min":0.28699999999999998,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.88400000000000001,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":2.04,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.69399999999999995,"15min":0.60999999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86899999999999999,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.54100000000000004},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.309},"max":{"1min":2.0920000000000001,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.745,"15min":0.627},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.628},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.73399999999999999,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.35099999999999998},"max":{"1min":2.0659999999999998,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.68100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575175,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505452,"kb_used_data":37156,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866388,"statfs":{"total":96636764160,"available":96119181312,"internally_reserved":0,"allocated":38047744,"data_stored":37867820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.49099999999999999,"15min":0.42999999999999999},"min":{"1min":0.19500000000000001,"5min":0.19,"15min":0.16900000000000001},"max":{"1min":1.0549999999999999,"5min":6.407,"15min":6.407},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.69699999999999995,"15min":0.504},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":1.2150000000000001,"5min":16.724,"15min":16.724},"last":0.25900000000000001}]},{"osd":1,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.86599999999999999,"15min":0.60299999999999998},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":4.4740000000000002,"5min":13.058,"15min":15.259},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.53700000000000003},"min":{"1min":0.249,"5min":0.217,"15min":0.192},"max":{"1min":4.2009999999999996,"5min":9.5370000000000008,"15min":10.831},"last":0.40999999999999998}]},{"osd":2,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.214},"max":{"1min":0.81799999999999995,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.70599999999999996,"15min":0.52900000000000003},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":5.6539999999999999,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":0.39100000000000001}]},{"osd":4,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.82699999999999996,"15min":0.71099999999999997},"min":{"1min":0.31,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82499999999999996,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.155,"5min":1.0700000000000001,"15min":0.81000000000000005},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":5.5549999999999997,"5min":11.755000000000001,"15min":15.224},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0289999999999999,"5min":2.403,"15min":4.3860000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71299999999999997,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.6419999999999999,"5min":5.548,"15min":5.548},"last":0.48699999999999999}]},{"osd":6,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.95099999999999996,"15min":0.70599999999999996},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":5.5990000000000002,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.621},"min":{"1min":0.39700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.997,"5min":4.1100000000000003,"15min":5.2530000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.85099999999999998,"15min":0.68400000000000005},"min":{"1min":0.39300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84799999999999998,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.212,"5min":1.0489999999999999,"15min":0.753},"min":{"1min":0.45500000000000002,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":5.6299999999999999,"5min":12.939,"15min":12.939},"last":0.60599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575175,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.61299999999999999,"15min":0.495},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.018,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.63,"15min":0.5},"min":{"1min":0.28199999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":9.4900000000000002,"5min":9.4900000000000002,"15min":9.4900000000000002},"last":0.72499999999999998}]},{"osd":1,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":0.84199999999999997,"15min":0.56899999999999995},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":18.529,"5min":18.529,"15min":18.529},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56200000000000006,"15min":0.54000000000000004},"min":{"1min":0.27800000000000002,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":2.129,"5min":7.343,"15min":7.4370000000000003},"last":0.77100000000000002}]},{"osd":2,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":0.77800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29399999999999998,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":15.917,"5min":15.917,"15min":15.917},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":2.1579999999999999,"5min":3.9900000000000002,"15min":6.617},"last":0.73899999999999999}]},{"osd":3,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.79000000000000004,"15min":0.60699999999999998},"min":{"1min":0.32900000000000001,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":9.3759999999999994,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.405,"5min":0.80400000000000005,"15min":0.61599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28299999999999997},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":0.70799999999999996}]},{"osd":5,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.67800000000000005,"15min":0.56899999999999995},"min":{"1min":0.249,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.69599999999999995,"15min":0.58799999999999997},"min":{"1min":0.35899999999999999,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":9.5259999999999998,"5min":9.5259999999999998,"15min":9.5259999999999998},"last":0.53100000000000003}]},{"osd":6,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":0.79700000000000004,"15min":0.622},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":18.463000000000001,"5min":18.463000000000001,"15min":18.463000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.621,"15min":0.63},"min":{"1min":0.35499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0469999999999999,"5min":5.0860000000000003,"15min":9.4550000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.74299999999999999,"15min":0.63200000000000001},"min":{"1min":0.38500000000000001,"5min":0.34899999999999998,"15min":0.28000000000000003},"max":{"1min":9.4320000000000004,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.626},{"interface":"front","average":{"1min":1.6120000000000001,"5min":0.88700000000000001,"15min":0.71899999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.315},"max":{"1min":18.5,"5min":18.5,"15min":18.5},"last":0.55900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575175,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544972,"kb_used_data":98884,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826868,"statfs":{"total":96636764160,"available":96078712832,"internally_reserved":0,"allocated":101257216,"data_stored":101075772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.54900000000000004,"15min":0.48699999999999999},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.17899999999999999},"max":{"1min":1.4299999999999999,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.66100000000000003,"15min":0.623},"min":{"1min":0.26500000000000001,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":1.276,"5min":9.2059999999999995,"15min":24.800000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.66000000000000003,"15min":0.626},"min":{"1min":0.222,"5min":0.218,"15min":0.215},"max":{"1min":2.2000000000000002,"5min":15.426,"15min":27.719000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.63300000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":1.9219999999999999,"5min":7.1399999999999997,"15min":24.826000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.65100000000000002,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.254,"15min":0.24099999999999999},"max":{"1min":5.9130000000000003,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.629,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.28699999999999998,"15min":0.24199999999999999},"max":{"1min":1.4590000000000001,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75700000000000001,"15min":0.69399999999999995},"min":{"1min":0.308,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":4.8780000000000001,"5min":6.6559999999999997,"15min":24.606000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.73199999999999998,"15min":0.61799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.253},"max":{"1min":3.165,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.62,"15min":0.81599999999999995},"min":{"1min":0.27000000000000002,"5min":0.248,"15min":0.22600000000000001},"max":{"1min":2.5409999999999999,"5min":10.319000000000001,"15min":71.634},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.79500000000000004,"15min":1.004},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":2.8380000000000001,"5min":10.032,"15min":101.794},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.745,"15min":0.623},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.254},"max":{"1min":1.4730000000000001,"5min":14.997,"15min":14.997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.81200000000000006,"15min":0.72999999999999998},"min":{"1min":0.34899999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":2.3999999999999999,"5min":19.137,"15min":28.053999999999998},"last":0.42099999999999999}]},{"osd":7,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.5660000000000001,"15min":1.024},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.30499999999999999},"max":{"1min":1.399,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.577,"15min":1.006},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.31},"max":{"1min":2.4910000000000001,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.47799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82739200,"data_stored":82727906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100966400,"data_stored":100957360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:21:44.849 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.849 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.849 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.849 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.850 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.851 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.852 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.853 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.854 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.855 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.856 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.856 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.856 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.856 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:54:58.591914+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.856 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.856 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.856 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.857 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:21:44.858 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:22:02.119 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:02.123 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:04.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:22:04.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.991+0000 7faa7e7d1700 1 Processor -- start 2024-05-08T21:22:04.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.991+0000 7faa7e7d1700 1 -- start start 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa7e7d1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 0x7faa780c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa7e7d1700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780c8780 con 0x7faa781514b0 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa7e7d1700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7815b790 con 0x7faa780cca80 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa7e7d1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa781571e0 con 0x7faa780c8980 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa77fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7faa781514b0 0x7faa78157910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:40718/0 (socket says 172.21.15.135:40718) 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa77fff700 1 -- 172.21.15.135:0/2225486720 learned_addr learned my addr 172.21.15.135:0/2225486720 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa777fe700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 0x7faa780c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.992+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862969026 0 0) 0x7faa780c8780 con 0x7faa781514b0 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa600035b0 con 0x7faa781514b0 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046157772 0 0) 0x7faa600035b0 con 0x7faa781514b0 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 msgr2=0x7faa780c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:04.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 0x7faa780c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 >> v1:172.21.15.183:6789/0 conn(0x7faa780cca80 legacy=0x7faa78161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7815ac10 con 0x7faa781514b0 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7faa68001670 con 0x7faa781514b0 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 >> v1:172.21.15.135:6789/0 conn(0x7faa781514b0 legacy=0x7faa78157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa60003a30 0x7faa60003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600043e0 0x7faa600048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 0x7faa60005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781571e0 con 0x7faa600043e0 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6000ba10 con 0x7faa60003a30 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6000bbd0 con 0x7faa780c8980 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa777fe700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600043e0 0x7faa600048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa7cd6e700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 0x7faa60005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa77fff700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa60003a30 0x7faa60003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:04.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa777fe700 1 -- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 msgr2=0x7faa60005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa777fe700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa780c8980 0x7faa60005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa777fe700 1 -- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa60003a30 msgr2=0x7faa60003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa777fe700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa60003a30 0x7faa60003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa777fe700 1 -- 172.21.15.135:0/2225486720 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600035b0 con 0x7faa600043e0 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.993+0000 7faa777fe700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600043e0 0x7faa600048b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009b60 tx=0x7faa60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98c5d5cf65c5f66 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00e6c0 con 0x7faa600043e0 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00e820 con 0x7faa600043e0 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa76ffd700 1 -- 172.21.15.135:0/2225486720 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00eb90 con 0x7faa600043e0 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa7e7d1700 1 -- 172.21.15.135:0/2225486720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600043e0 msgr2=0x7faa600048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa7e7d1700 1 --2- 172.21.15.135:0/2225486720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa600043e0 0x7faa600048b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009b60 tx=0x7faa60005880 comp rx=0 tx=0).stop 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa7cd6e700 1 -- 172.21.15.135:0/2225486720 reap_dead start 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa7e7d1700 1 -- 172.21.15.135:0/2225486720 shutdown_connections 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa7e7d1700 1 -- 172.21.15.135:0/2225486720 >> 172.21.15.135:0/2225486720 conn(0x7faa7806a960 msgr2=0x7faa7806ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa7e7d1700 1 -- 172.21.15.135:0/2225486720 shutdown_connections 2024-05-08T21:22:04.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.994+0000 7faa7e7d1700 1 -- 172.21.15.135:0/2225486720 wait complete. 2024-05-08T21:22:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.995+0000 7faa7e7d1700 1 Processor -- start 2024-05-08T21:22:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa7e7d1700 1 -- start start 2024-05-08T21:22:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa7e7d1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa7814ef20 0x7faa7814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa7e7d1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa7814f300 0x7faa781ecc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa7e7d1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa781583a0 0x7faa78149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa7e7d1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7814aaa0 con 0x7faa7814f300 2024-05-08T21:22:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa7e7d1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780afbb0 con 0x7faa781583a0 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa7e7d1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7814b400 con 0x7faa7814ef20 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa777fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa7814f300 0x7faa781ecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa777fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa7814f300 0x7faa781ecc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36810/0 (socket says 172.21.15.135:36810) 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.996+0000 7faa777fe700 1 -- 172.21.15.135:0/1828432349 learned_addr learned my addr 172.21.15.135:0/1828432349 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa77fff700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa7814ef20 0x7faa7814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa7cd6e700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa781583a0 0x7faa78149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa777fe700 1 -- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa7814ef20 msgr2=0x7faa7814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa777fe700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa7814ef20 0x7faa7814aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa777fe700 1 -- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa781583a0 msgr2=0x7faa78149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa777fe700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa781583a0 0x7faa78149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa777fe700 1 -- 172.21.15.135:0/1828432349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa781ed4d0 con 0x7faa7814f300 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa777fe700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa7814f300 0x7faa781ecc40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00e4b0 tx=0x7faa6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa74ff9700 1 -- 172.21.15.135:0/1828432349 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00e6c0 con 0x7faa7814f300 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa74ff9700 1 -- 172.21.15.135:0/1828432349 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c0038c0 con 0x7faa7814f300 2024-05-08T21:22:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa781ed7b0 con 0x7faa7814f300 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa74ff9700 1 -- 172.21.15.135:0/1828432349 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c003c70 con 0x7faa7814f300 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.997+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7814a3e0 con 0x7faa7814f300 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.999+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa780671d0 con 0x7faa7814f300 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.999+0000 7faa74ff9700 1 -- 172.21.15.135:0/1828432349 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa6c013470 con 0x7faa7814f300 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.999+0000 7faa74ff9700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa6406acc0 0x7faa6406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.999+0000 7faa74ff9700 1 -- 172.21.15.135:0/1828432349 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa6c08af40 con 0x7faa7814f300 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:04.999+0000 7faa77fff700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa6406acc0 0x7faa6406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.000+0000 7faa77fff700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa6406acc0 0x7faa6406d180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa68001050 tx=0x7faa68001bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:05.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.004+0000 7faa74ff9700 1 -- 172.21.15.135:0/1828432349 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faa6c055f10 con 0x7faa7814f300 2024-05-08T21:22:05.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.202+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa78150cd0 con 0x7faa6406acc0 2024-05-08T21:22:05.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.212+0000 7faa74ff9700 1 -- 172.21.15.135:0/1828432349 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372713 (secure 0 0 0) 0x7faa78150cd0 con 0x7faa6406acc0 2024-05-08T21:22:05.219 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:22:05.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.215+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa6406acc0 msgr2=0x7faa6406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:05.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.215+0000 7faa7e7d1700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa6406acc0 0x7faa6406d180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa68001050 tx=0x7faa68001bf0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.215+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa7814f300 msgr2=0x7faa781ecc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.215+0000 7faa7e7d1700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa7814f300 0x7faa781ecc40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00e4b0 tx=0x7faa6c0047c0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 shutdown_connections 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7faa6406acc0 0x7faa6406d180 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa781583a0 0x7faa78149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa7814ef20 0x7faa7814aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 --2- 172.21.15.135:0/1828432349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa7814f300 0x7faa781ecc40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 >> 172.21.15.135:0/1828432349 conn(0x7faa7806a960 msgr2=0x7faa780b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 shutdown_connections 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:05.216+0000 7faa7e7d1700 1 -- 172.21.15.135:0/1828432349 wait complete. 2024-05-08T21:22:05.223 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:22:05.230 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":839,"stamp":"2024-05-08T21:22:04.830814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244155444,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3047,"num_read_kb":7630,"num_write":179646,"num_write_kb":3998170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257560,"ondisk_log_size":257560,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3864680,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3385395,"kb_avail":751110040,"statfs":{"total":773094113280,"available":769136680960,"internally_reserved":0,"allocated":490708992,"data_stored":489258184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3466645049},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003266"},"pg_stats":[{"pgid":"3.3f","version":"27'774","reported_seq":803,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.362759+0000","last_change":"2024-05-08T20:55:00.096605+0000","last_active":"2024-05-08T21:21:13.362759+0000","last_peered":"2024-05-08T21:21:13.362759+0000","last_clean":"2024-05-08T21:21:13.362759+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:21:13.362759+0000","last_undegraded":"2024-05-08T21:21:13.362759+0000","last_fullsized":"2024-05-08T21:21:13.362759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'772","reported_seq":811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:49.932779+0000","last_change":"2024-05-08T21:21:49.932891+0000","last_active":"2024-05-08T21:21:49.932779+0000","last_peered":"2024-05-08T21:21:49.932779+0000","last_clean":"2024-05-08T21:21:49.932779+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:49.932779+0000","last_undegraded":"2024-05-08T21:21:49.932779+0000","last_fullsized":"2024-05-08T21:21:49.932779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'772","last_scrub_stamp":"2024-05-08T21:21:49.932752+0000","last_deep_scrub":"27'772","last_deep_scrub_stamp":"2024-05-08T21:21:49.932752+0000","last_clean_scrub_stamp":"2024-05-08T21:21:49.932752+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:13.196819+0000","scrub_duration":0.0068780669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'862","reported_seq":902,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.036855+0000","last_change":"2024-05-08T21:21:30.036948+0000","last_active":"2024-05-08T21:21:30.036855+0000","last_peered":"2024-05-08T21:21:30.036855+0000","last_clean":"2024-05-08T21:21:30.036855+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:30.036855+0000","last_undegraded":"2024-05-08T21:21:30.036855+0000","last_fullsized":"2024-05-08T21:21:30.036855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'862","last_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_deep_scrub":"27'862","last_deep_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.036832+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:55.453142+0000","scrub_duration":0.0074728939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'823","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.751890+0000","last_change":"2024-05-08T21:21:27.751988+0000","last_active":"2024-05-08T21:21:27.751890+0000","last_peered":"2024-05-08T21:21:27.751890+0000","last_clean":"2024-05-08T21:21:27.751890+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:27.751890+0000","last_undegraded":"2024-05-08T21:21:27.751890+0000","last_fullsized":"2024-05-08T21:21:27.751890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'823","last_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_deep_scrub":"27'823","last_deep_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.751862+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.537249+0000","scrub_duration":0.0019687749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'860","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:02.419054+0000","last_change":"2024-05-08T21:22:02.419182+0000","last_active":"2024-05-08T21:22:02.419054+0000","last_peered":"2024-05-08T21:22:02.419054+0000","last_clean":"2024-05-08T21:22:02.419054+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:22:02.419054+0000","last_undegraded":"2024-05-08T21:22:02.419054+0000","last_fullsized":"2024-05-08T21:22:02.419054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'860","last_scrub_stamp":"2024-05-08T21:22:02.419027+0000","last_deep_scrub":"27'860","last_deep_scrub_stamp":"2024-05-08T21:22:02.419027+0000","last_clean_scrub_stamp":"2024-05-08T21:22:02.419027+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:11.298342+0000","scrub_duration":0.011455531999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'767","reported_seq":793,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.381188+0000","last_change":"2024-05-08T20:55:00.092435+0000","last_active":"2024-05-08T21:21:13.381188+0000","last_peered":"2024-05-08T21:21:13.381188+0000","last_clean":"2024-05-08T21:21:13.381188+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:21:13.381188+0000","last_undegraded":"2024-05-08T21:21:13.381188+0000","last_fullsized":"2024-05-08T21:21:13.381188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'811","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.339467+0000","last_change":"2024-05-08T21:21:57.339570+0000","last_active":"2024-05-08T21:21:57.339467+0000","last_peered":"2024-05-08T21:21:57.339467+0000","last_clean":"2024-05-08T21:21:57.339467+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:57.339467+0000","last_undegraded":"2024-05-08T21:21:57.339467+0000","last_fullsized":"2024-05-08T21:21:57.339467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'811","last_scrub_stamp":"2024-05-08T21:21:57.339438+0000","last_deep_scrub":"27'811","last_deep_scrub_stamp":"2024-05-08T21:21:57.339438+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.339438+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:55.528420+0000","scrub_duration":0.0020686020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'788","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:53.904218+0000","last_change":"2024-05-08T21:21:53.904335+0000","last_active":"2024-05-08T21:21:53.904218+0000","last_peered":"2024-05-08T21:21:53.904218+0000","last_clean":"2024-05-08T21:21:53.904218+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:53.904218+0000","last_undegraded":"2024-05-08T21:21:53.904218+0000","last_fullsized":"2024-05-08T21:21:53.904218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'788","last_scrub_stamp":"2024-05-08T21:21:53.904193+0000","last_deep_scrub":"27'788","last_deep_scrub_stamp":"2024-05-08T21:21:53.904193+0000","last_clean_scrub_stamp":"2024-05-08T21:21:53.904193+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:49.742590+0000","scrub_duration":0.0021721689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'846","reported_seq":874,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.080607+0000","last_change":"2024-05-08T20:55:00.096293+0000","last_active":"2024-05-08T21:21:24.080607+0000","last_peered":"2024-05-08T21:21:24.080607+0000","last_clean":"2024-05-08T21:21:24.080607+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:21:24.080607+0000","last_undegraded":"2024-05-08T21:21:24.080607+0000","last_fullsized":"2024-05-08T21:21:24.080607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'809","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:54.921077+0000","last_change":"2024-05-08T21:21:54.921177+0000","last_active":"2024-05-08T21:21:54.921077+0000","last_peered":"2024-05-08T21:21:54.921077+0000","last_clean":"2024-05-08T21:21:54.921077+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:54.921077+0000","last_undegraded":"2024-05-08T21:21:54.921077+0000","last_fullsized":"2024-05-08T21:21:54.921077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:54.921049+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:54.921049+0000","last_clean_scrub_stamp":"2024-05-08T21:21:54.921049+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:03.800363+0000","scrub_duration":0.0031844239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'819","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.996816+0000","last_change":"2024-05-08T21:21:42.996970+0000","last_active":"2024-05-08T21:21:42.996816+0000","last_peered":"2024-05-08T21:21:42.996816+0000","last_clean":"2024-05-08T21:21:42.996816+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:42.996816+0000","last_undegraded":"2024-05-08T21:21:42.996816+0000","last_fullsized":"2024-05-08T21:21:42.996816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:42.996772+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:42.996772+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.996772+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:06.260839+0000","scrub_duration":0.0065513519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'794","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.413622+0000","last_change":"2024-05-08T21:21:45.413781+0000","last_active":"2024-05-08T21:21:45.413622+0000","last_peered":"2024-05-08T21:21:45.413622+0000","last_clean":"2024-05-08T21:21:45.413622+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:45.413622+0000","last_undegraded":"2024-05-08T21:21:45.413622+0000","last_fullsized":"2024-05-08T21:21:45.413622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'794","last_scrub_stamp":"2024-05-08T21:21:45.413576+0000","last_deep_scrub":"27'794","last_deep_scrub_stamp":"2024-05-08T21:21:45.413576+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.413576+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:40.286412+0000","scrub_duration":0.0018887540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'813","reported_seq":852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.863029+0000","last_change":"2024-05-08T21:21:25.863029+0000","last_active":"2024-05-08T21:21:25.863029+0000","last_peered":"2024-05-08T21:21:25.863029+0000","last_clean":"2024-05-08T21:21:25.863029+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:25.863029+0000","last_undegraded":"2024-05-08T21:21:25.863029+0000","last_fullsized":"2024-05-08T21:21:25.863029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'813","last_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_deep_scrub":"27'813","last_deep_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.862894+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:16.467912+0000","scrub_duration":0.0075367910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'802","reported_seq":841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.062238+0000","last_change":"2024-05-08T21:21:42.062360+0000","last_active":"2024-05-08T21:21:42.062238+0000","last_peered":"2024-05-08T21:21:42.062238+0000","last_clean":"2024-05-08T21:21:42.062238+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:42.062238+0000","last_undegraded":"2024-05-08T21:21:42.062238+0000","last_fullsized":"2024-05-08T21:21:42.062238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'802","last_scrub_stamp":"2024-05-08T21:21:42.062211+0000","last_deep_scrub":"27'802","last_deep_scrub_stamp":"2024-05-08T21:21:42.062211+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.062211+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:36.935046+0000","scrub_duration":0.0040292820000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'853","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:53.855569+0000","last_change":"2024-05-08T21:21:53.855702+0000","last_active":"2024-05-08T21:21:53.855569+0000","last_peered":"2024-05-08T21:21:53.855569+0000","last_clean":"2024-05-08T21:21:53.855569+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:53.855569+0000","last_undegraded":"2024-05-08T21:21:53.855569+0000","last_fullsized":"2024-05-08T21:21:53.855569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'853","last_scrub_stamp":"2024-05-08T21:21:53.855539+0000","last_deep_scrub":"27'853","last_deep_scrub_stamp":"2024-05-08T21:21:53.855539+0000","last_clean_scrub_stamp":"2024-05-08T21:21:53.855539+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:10.074609+0000","scrub_duration":0.0073019199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'809","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.736377+0000","last_change":"2024-05-08T21:21:25.736503+0000","last_active":"2024-05-08T21:21:25.736377+0000","last_peered":"2024-05-08T21:21:25.736377+0000","last_clean":"2024-05-08T21:21:25.736377+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:25.736377+0000","last_undegraded":"2024-05-08T21:21:25.736377+0000","last_fullsized":"2024-05-08T21:21:25.736377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.736348+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:53.810852+0000","scrub_duration":0.00189824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'870","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:48.736103+0000","last_change":"2024-05-08T21:21:48.736241+0000","last_active":"2024-05-08T21:21:48.736103+0000","last_peered":"2024-05-08T21:21:48.736103+0000","last_clean":"2024-05-08T21:21:48.736103+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:48.736103+0000","last_undegraded":"2024-05-08T21:21:48.736103+0000","last_fullsized":"2024-05-08T21:21:48.736103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'870","last_scrub_stamp":"2024-05-08T21:21:48.736071+0000","last_deep_scrub":"27'870","last_deep_scrub_stamp":"2024-05-08T21:21:48.736071+0000","last_clean_scrub_stamp":"2024-05-08T21:21:48.736071+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:35.037429+0000","scrub_duration":0.0071336680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'789","reported_seq":828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.635345+0000","last_change":"2024-05-08T21:21:29.635458+0000","last_active":"2024-05-08T21:21:29.635345+0000","last_peered":"2024-05-08T21:21:29.635345+0000","last_clean":"2024-05-08T21:21:29.635345+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:29.635345+0000","last_undegraded":"2024-05-08T21:21:29.635345+0000","last_fullsized":"2024-05-08T21:21:29.635345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'789","last_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_deep_scrub":"27'789","last_deep_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.635318+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:25.420704+0000","scrub_duration":0.002176664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'839","reported_seq":868,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.080717+0000","last_change":"2024-05-08T20:55:00.094426+0000","last_active":"2024-05-08T21:21:24.080717+0000","last_peered":"2024-05-08T21:21:24.080717+0000","last_clean":"2024-05-08T21:21:24.080717+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:21:24.080717+0000","last_undegraded":"2024-05-08T21:21:24.080717+0000","last_fullsized":"2024-05-08T21:21:24.080717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3811,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.041096+0000","last_change":"2024-05-08T20:55:04.215574+0000","last_active":"2024-05-08T21:21:22.041096+0000","last_peered":"2024-05-08T21:21:22.041096+0000","last_clean":"2024-05-08T21:21:22.041096+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:21:22.041096+0000","last_undegraded":"2024-05-08T21:21:22.041096+0000","last_fullsized":"2024-05-08T21:21:22.041096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1871","reported_seq":1912,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.072464+0000","last_change":"2024-05-08T21:21:22.072592+0000","last_active":"2024-05-08T21:21:22.072464+0000","last_peered":"2024-05-08T21:21:22.072464+0000","last_clean":"2024-05-08T21:21:22.072464+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:22.072464+0000","last_undegraded":"2024-05-08T21:21:22.072464+0000","last_fullsized":"2024-05-08T21:21:22.072464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1871","last_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_deep_scrub":"27'1871","last_deep_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.072441+0000","objects_scrubbed":3,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:17.857827+0000","scrub_duration":0.015741767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'809","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.904062+0000","last_change":"2024-05-08T21:21:27.904160+0000","last_active":"2024-05-08T21:21:27.904062+0000","last_peered":"2024-05-08T21:21:27.904062+0000","last_clean":"2024-05-08T21:21:27.904062+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:27.904062+0000","last_undegraded":"2024-05-08T21:21:27.904062+0000","last_fullsized":"2024-05-08T21:21:27.904062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.904035+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.689421+0000","scrub_duration":0.0050121590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3732,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:54.480851+0000","last_change":"2024-05-08T21:21:54.481012+0000","last_active":"2024-05-08T21:21:54.480851+0000","last_peered":"2024-05-08T21:21:54.480851+0000","last_clean":"2024-05-08T21:21:54.480851+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:54.480851+0000","last_undegraded":"2024-05-08T21:21:54.480851+0000","last_fullsized":"2024-05-08T21:21:54.480851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3695","last_scrub_stamp":"2024-05-08T21:21:54.480824+0000","last_deep_scrub":"27'3695","last_deep_scrub_stamp":"2024-05-08T21:21:54.480824+0000","last_clean_scrub_stamp":"2024-05-08T21:21:54.480824+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:10.699893+0000","scrub_duration":0.014220731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4026","reported_seq":4068,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.919821+0000","last_change":"2024-05-08T21:21:28.919926+0000","last_active":"2024-05-08T21:21:28.919821+0000","last_peered":"2024-05-08T21:21:28.919821+0000","last_clean":"2024-05-08T21:21:28.919821+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:28.919821+0000","last_undegraded":"2024-05-08T21:21:28.919821+0000","last_fullsized":"2024-05-08T21:21:28.919821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4026","last_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_deep_scrub":"27'4026","last_deep_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.919793+0000","objects_scrubbed":1,"log_size":4026,"log_dups_size":0,"ondisk_log_size":4026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.835728+0000","scrub_duration":0.016721056000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'779","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.014388+0000","last_change":"2024-05-08T21:21:47.014532+0000","last_active":"2024-05-08T21:21:47.014388+0000","last_peered":"2024-05-08T21:21:47.014388+0000","last_clean":"2024-05-08T21:21:47.014388+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:47.014388+0000","last_undegraded":"2024-05-08T21:21:47.014388+0000","last_fullsized":"2024-05-08T21:21:47.014388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-05-08T21:21:47.014362+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-05-08T21:21:47.014362+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.014362+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:42.852759+0000","scrub_duration":0.0082407149999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3657,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.912070+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T21:21:06.912070+0000","last_peered":"2024-05-08T21:21:06.912070+0000","last_clean":"2024-05-08T21:21:06.912070+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:21:06.912070+0000","last_undegraded":"2024-05-08T21:21:06.912070+0000","last_fullsized":"2024-05-08T21:21:06.912070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4865","reported_seq":4904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.241416+0000","last_change":"2024-05-08T21:21:50.241523+0000","last_active":"2024-05-08T21:21:50.241416+0000","last_peered":"2024-05-08T21:21:50.241416+0000","last_clean":"2024-05-08T21:21:50.241416+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:50.241416+0000","last_undegraded":"2024-05-08T21:21:50.241416+0000","last_fullsized":"2024-05-08T21:21:50.241416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4865","last_scrub_stamp":"2024-05-08T21:21:50.241390+0000","last_deep_scrub":"27'4865","last_deep_scrub_stamp":"2024-05-08T21:21:50.241390+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.241390+0000","objects_scrubbed":3,"log_size":4865,"log_dups_size":0,"ondisk_log_size":4865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:25.583510+0000","scrub_duration":0.029835649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'861","reported_seq":887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.376353+0000","last_change":"2024-05-08T20:55:00.089750+0000","last_active":"2024-05-08T21:21:13.376353+0000","last_peered":"2024-05-08T21:21:13.376353+0000","last_clean":"2024-05-08T21:21:13.376353+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:21:13.376353+0000","last_undegraded":"2024-05-08T21:21:13.376353+0000","last_fullsized":"2024-05-08T21:21:13.376353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:56.503468+0000","last_change":"2024-05-08T21:21:56.503623+0000","last_active":"2024-05-08T21:21:56.503468+0000","last_peered":"2024-05-08T21:21:56.503468+0000","last_clean":"2024-05-08T21:21:56.503468+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:56.503468+0000","last_undegraded":"2024-05-08T21:21:56.503468+0000","last_fullsized":"2024-05-08T21:21:56.503468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3447","last_scrub_stamp":"2024-05-08T21:21:56.503441+0000","last_deep_scrub":"27'3447","last_deep_scrub_stamp":"2024-05-08T21:21:56.503441+0000","last_clean_scrub_stamp":"2024-05-08T21:21:56.503441+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:54.692423+0000","scrub_duration":0.016081088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1177","reported_seq":1216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.088816+0000","last_change":"2024-05-08T21:21:44.088912+0000","last_active":"2024-05-08T21:21:44.088816+0000","last_peered":"2024-05-08T21:21:44.088816+0000","last_clean":"2024-05-08T21:21:44.088816+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:44.088816+0000","last_undegraded":"2024-05-08T21:21:44.088816+0000","last_fullsized":"2024-05-08T21:21:44.088816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1177","last_scrub_stamp":"2024-05-08T21:21:44.088787+0000","last_deep_scrub":"27'1177","last_deep_scrub_stamp":"2024-05-08T21:21:44.088787+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.088787+0000","objects_scrubbed":2,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:23.965184+0000","scrub_duration":0.014020988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'834","reported_seq":860,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:13.375956+0000","last_change":"2024-05-08T20:55:00.089840+0000","last_active":"2024-05-08T21:21:13.375956+0000","last_peered":"2024-05-08T21:21:13.375956+0000","last_clean":"2024-05-08T21:21:13.375956+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:21:13.375956+0000","last_undegraded":"2024-05-08T21:21:13.375956+0000","last_fullsized":"2024-05-08T21:21:13.375956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.827198+0000","last_change":"2024-05-08T20:55:04.109343+0000","last_active":"2024-05-08T21:21:06.827198+0000","last_peered":"2024-05-08T21:21:06.827198+0000","last_clean":"2024-05-08T21:21:06.827198+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:21:06.827198+0000","last_undegraded":"2024-05-08T21:21:06.827198+0000","last_fullsized":"2024-05-08T21:21:06.827198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2317","reported_seq":2356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.926492+0000","last_change":"2024-05-08T21:21:29.926575+0000","last_active":"2024-05-08T21:21:29.926492+0000","last_peered":"2024-05-08T21:21:29.926492+0000","last_clean":"2024-05-08T21:21:29.926492+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:29.926492+0000","last_undegraded":"2024-05-08T21:21:29.926492+0000","last_fullsized":"2024-05-08T21:21:29.926492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2317","last_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_deep_scrub":"27'2317","last_deep_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.926468+0000","objects_scrubbed":2,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.064661+0000","scrub_duration":0.024143202999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'829","reported_seq":867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.066384+0000","last_change":"2024-05-08T21:21:31.066489+0000","last_active":"2024-05-08T21:21:31.066384+0000","last_peered":"2024-05-08T21:21:31.066384+0000","last_clean":"2024-05-08T21:21:31.066384+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:31.066384+0000","last_undegraded":"2024-05-08T21:21:31.066384+0000","last_fullsized":"2024-05-08T21:21:31.066384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'829","last_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_deep_scrub":"27'829","last_deep_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.066360+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:42.055961+0000","scrub_duration":0.0042842599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.608319+0000","last_change":"2024-05-08T21:21:30.608460+0000","last_active":"2024-05-08T21:21:30.608319+0000","last_peered":"2024-05-08T21:21:30.608319+0000","last_clean":"2024-05-08T21:21:30.608319+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:30.608319+0000","last_undegraded":"2024-05-08T21:21:30.608319+0000","last_fullsized":"2024-05-08T21:21:30.608319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3534","last_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_deep_scrub":"27'3534","last_deep_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.608289+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:43.524223+0000","scrub_duration":0.017888930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4378","reported_seq":4416,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.988161+0000","last_change":"2024-05-08T21:21:24.988284+0000","last_active":"2024-05-08T21:21:24.988161+0000","last_peered":"2024-05-08T21:21:24.988161+0000","last_clean":"2024-05-08T21:21:24.988161+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:24.988161+0000","last_undegraded":"2024-05-08T21:21:24.988161+0000","last_fullsized":"2024-05-08T21:21:24.988161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4378","last_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_deep_scrub":"27'4378","last_deep_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.988136+0000","objects_scrubbed":2,"log_size":4378,"log_dups_size":0,"ondisk_log_size":4378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:35.977737+0000","scrub_duration":0.026713068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'818","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.076134+0000","last_change":"2024-05-08T21:21:29.076253+0000","last_active":"2024-05-08T21:21:29.076134+0000","last_peered":"2024-05-08T21:21:29.076134+0000","last_clean":"2024-05-08T21:21:29.076134+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:29.076134+0000","last_undegraded":"2024-05-08T21:21:29.076134+0000","last_fullsized":"2024-05-08T21:21:29.076134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.076108+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:53.637005+0000","scrub_duration":0.0043393650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3636,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.863242+0000","last_change":"2024-05-08T20:55:04.106334+0000","last_active":"2024-05-08T21:21:06.863242+0000","last_peered":"2024-05-08T21:21:06.863242+0000","last_clean":"2024-05-08T21:21:06.863242+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:21:06.863242+0000","last_undegraded":"2024-05-08T21:21:06.863242+0000","last_fullsized":"2024-05-08T21:21:06.863242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1717","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.960412+0000","last_change":"2024-05-08T21:21:30.960412+0000","last_active":"2024-05-08T21:21:30.960412+0000","last_peered":"2024-05-08T21:21:30.960412+0000","last_clean":"2024-05-08T21:21:30.960412+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:30.960412+0000","last_undegraded":"2024-05-08T21:21:30.960412+0000","last_fullsized":"2024-05-08T21:21:30.960412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1717","last_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_deep_scrub":"27'1717","last_deep_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.960286+0000","objects_scrubbed":2,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.942541+0000","scrub_duration":0.026136829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'881","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.980335+0000","last_change":"2024-05-08T21:21:32.980335+0000","last_active":"2024-05-08T21:21:32.980335+0000","last_peered":"2024-05-08T21:21:32.980335+0000","last_clean":"2024-05-08T21:21:32.980335+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:32.980335+0000","last_undegraded":"2024-05-08T21:21:32.980335+0000","last_fullsized":"2024-05-08T21:21:32.980335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'881","last_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_deep_scrub":"27'881","last_deep_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.980155+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:57.541052+0000","scrub_duration":0.0015580380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3588,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.043015+0000","last_change":"2024-05-08T21:21:57.043200+0000","last_active":"2024-05-08T21:21:57.043015+0000","last_peered":"2024-05-08T21:21:57.043015+0000","last_clean":"2024-05-08T21:21:57.043015+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:57.043015+0000","last_undegraded":"2024-05-08T21:21:57.043015+0000","last_fullsized":"2024-05-08T21:21:57.043015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3549","last_scrub_stamp":"2024-05-08T21:21:57.042969+0000","last_deep_scrub":"27'3549","last_deep_scrub_stamp":"2024-05-08T21:21:57.042969+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.042969+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:10.155182+0000","scrub_duration":0.011593343000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5273","reported_seq":5312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.857565+0000","last_change":"2024-05-08T21:21:29.857565+0000","last_active":"2024-05-08T21:21:29.857565+0000","last_peered":"2024-05-08T21:21:29.857565+0000","last_clean":"2024-05-08T21:21:29.857565+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:21:29.857565+0000","last_undegraded":"2024-05-08T21:21:29.857565+0000","last_fullsized":"2024-05-08T21:21:29.857565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5273","last_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_deep_scrub":"27'5273","last_deep_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.857411+0000","objects_scrubbed":4,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:42.773346+0000","scrub_duration":0.054139549000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'827","reported_seq":865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:48.892457+0000","last_change":"2024-05-08T21:21:48.892570+0000","last_active":"2024-05-08T21:21:48.892457+0000","last_peered":"2024-05-08T21:21:48.892457+0000","last_clean":"2024-05-08T21:21:48.892457+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:48.892457+0000","last_undegraded":"2024-05-08T21:21:48.892457+0000","last_fullsized":"2024-05-08T21:21:48.892457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'827","last_scrub_stamp":"2024-05-08T21:21:48.892428+0000","last_deep_scrub":"27'827","last_deep_scrub_stamp":"2024-05-08T21:21:48.892428+0000","last_clean_scrub_stamp":"2024-05-08T21:21:48.892428+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:24.234549+0000","scrub_duration":0.0069871000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.860335+0000","last_change":"2024-05-08T20:55:04.210830+0000","last_active":"2024-05-08T21:21:06.860335+0000","last_peered":"2024-05-08T21:21:06.860335+0000","last_clean":"2024-05-08T21:21:06.860335+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:21:06.860335+0000","last_undegraded":"2024-05-08T21:21:06.860335+0000","last_fullsized":"2024-05-08T21:21:06.860335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2694","reported_seq":3304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.008413+0000","last_change":"2024-05-08T21:21:40.008506+0000","last_active":"2024-05-08T21:21:40.008413+0000","last_peered":"2024-05-08T21:21:40.008413+0000","last_clean":"2024-05-08T21:21:40.008413+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:40.008413+0000","last_undegraded":"2024-05-08T21:21:40.008413+0000","last_fullsized":"2024-05-08T21:21:40.008413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2694","last_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_deep_scrub":"27'2694","last_deep_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.008388+0000","objects_scrubbed":5,"log_size":2694,"log_dups_size":0,"ondisk_log_size":2694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:26.309746+0000","scrub_duration":0.051681431999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1795,"num_write":2691,"num_write_kb":19159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'812","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.594704+0000","last_change":"2024-05-08T21:21:32.594810+0000","last_active":"2024-05-08T21:21:32.594704+0000","last_peered":"2024-05-08T21:21:32.594704+0000","last_clean":"2024-05-08T21:21:32.594704+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:32.594704+0000","last_undegraded":"2024-05-08T21:21:32.594704+0000","last_fullsized":"2024-05-08T21:21:32.594704+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'812","last_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_deep_scrub":"27'812","last_deep_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.594677+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:45.576932+0000","scrub_duration":0.002123504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.067659+0000","last_change":"2024-05-08T21:21:59.067805+0000","last_active":"2024-05-08T21:21:59.067659+0000","last_peered":"2024-05-08T21:21:59.067659+0000","last_clean":"2024-05-08T21:21:59.067659+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:59.067659+0000","last_undegraded":"2024-05-08T21:21:59.067659+0000","last_fullsized":"2024-05-08T21:21:59.067659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3316","last_scrub_stamp":"2024-05-08T21:21:59.067632+0000","last_deep_scrub":"27'3316","last_deep_scrub_stamp":"2024-05-08T21:21:59.067632+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.067632+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:57.256614+0000","scrub_duration":0.014948201,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3355","reported_seq":3394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.765436+0000","last_change":"2024-05-08T21:21:31.765436+0000","last_active":"2024-05-08T21:21:31.765436+0000","last_peered":"2024-05-08T21:21:31.765436+0000","last_clean":"2024-05-08T21:21:31.765436+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:31.765436+0000","last_undegraded":"2024-05-08T21:21:31.765436+0000","last_fullsized":"2024-05-08T21:21:31.765436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3355","last_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_deep_scrub":"27'3355","last_deep_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.765305+0000","objects_scrubbed":1,"log_size":3355,"log_dups_size":0,"ondisk_log_size":3355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:44.747560+0000","scrub_duration":0.018616456999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'825","reported_seq":864,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:43.085998+0000","last_change":"2024-05-08T21:21:43.086103+0000","last_active":"2024-05-08T21:21:43.085998+0000","last_peered":"2024-05-08T21:21:43.085998+0000","last_clean":"2024-05-08T21:21:43.085998+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:43.085998+0000","last_undegraded":"2024-05-08T21:21:43.085998+0000","last_fullsized":"2024-05-08T21:21:43.085998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'825","last_scrub_stamp":"2024-05-08T21:21:43.085971+0000","last_deep_scrub":"27'825","last_deep_scrub_stamp":"2024-05-08T21:21:43.085971+0000","last_clean_scrub_stamp":"2024-05-08T21:21:43.085971+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:29.387329+0000","scrub_duration":0.0058775499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4052,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:00.549828+0000","last_change":"2024-05-08T21:22:00.549972+0000","last_active":"2024-05-08T21:22:00.549828+0000","last_peered":"2024-05-08T21:22:00.549828+0000","last_clean":"2024-05-08T21:22:00.549828+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:22:00.549828+0000","last_undegraded":"2024-05-08T21:22:00.549828+0000","last_fullsized":"2024-05-08T21:22:00.549828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4015","last_scrub_stamp":"2024-05-08T21:22:00.549799+0000","last_deep_scrub":"27'4015","last_deep_scrub_stamp":"2024-05-08T21:22:00.549799+0000","last_clean_scrub_stamp":"2024-05-08T21:22:00.549799+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:13.662012+0000","scrub_duration":0.013658672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4049","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.877466+0000","last_change":"2024-05-08T21:21:31.877466+0000","last_active":"2024-05-08T21:21:31.877466+0000","last_peered":"2024-05-08T21:21:31.877466+0000","last_clean":"2024-05-08T21:21:31.877466+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:31.877466+0000","last_undegraded":"2024-05-08T21:21:31.877466+0000","last_fullsized":"2024-05-08T21:21:31.877466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4049","last_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_deep_scrub":"27'4049","last_deep_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.877246+0000","objects_scrubbed":3,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:56.438144+0000","scrub_duration":0.021654677000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4056,"num_write_kb":23095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'833","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:33.106298+0000","last_change":"2024-05-08T21:21:33.106409+0000","last_active":"2024-05-08T21:21:33.106298+0000","last_peered":"2024-05-08T21:21:33.106298+0000","last_clean":"2024-05-08T21:21:33.106298+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:33.106298+0000","last_undegraded":"2024-05-08T21:21:33.106298+0000","last_fullsized":"2024-05-08T21:21:33.106298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'833","last_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_deep_scrub":"27'833","last_deep_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_clean_scrub_stamp":"2024-05-08T21:21:33.106270+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:21.028217+0000","scrub_duration":0.0015875640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.837729+0000","last_change":"2024-05-08T20:55:04.117297+0000","last_active":"2024-05-08T21:21:06.837729+0000","last_peered":"2024-05-08T21:21:06.837729+0000","last_clean":"2024-05-08T21:21:06.837729+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:21:06.837729+0000","last_undegraded":"2024-05-08T21:21:06.837729+0000","last_fullsized":"2024-05-08T21:21:06.837729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4551","reported_seq":4590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.984044+0000","last_change":"2024-05-08T21:21:26.984139+0000","last_active":"2024-05-08T21:21:26.984044+0000","last_peered":"2024-05-08T21:21:26.984044+0000","last_clean":"2024-05-08T21:21:26.984044+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:26.984044+0000","last_undegraded":"2024-05-08T21:21:26.984044+0000","last_fullsized":"2024-05-08T21:21:26.984044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4551","last_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_deep_scrub":"27'4551","last_deep_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.984019+0000","objects_scrubbed":5,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:14.905965+0000","scrub_duration":0.030483375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'805","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.080667+0000","last_change":"2024-05-08T20:55:00.095581+0000","last_active":"2024-05-08T21:21:24.080667+0000","last_peered":"2024-05-08T21:21:24.080667+0000","last_clean":"2024-05-08T21:21:24.080667+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:21:24.080667+0000","last_undegraded":"2024-05-08T21:21:24.080667+0000","last_fullsized":"2024-05-08T21:21:24.080667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:54:59.597060+0000","last_clean_scrub_stamp":"2024-05-08T20:54:59.597060+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.063130+0000","last_change":"2024-05-08T20:55:04.215897+0000","last_active":"2024-05-08T21:21:23.063130+0000","last_peered":"2024-05-08T21:21:23.063130+0000","last_clean":"2024-05-08T21:21:23.063130+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:21:23.063130+0000","last_undegraded":"2024-05-08T21:21:23.063130+0000","last_fullsized":"2024-05-08T21:21:23.063130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2511","reported_seq":2551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.046929+0000","last_change":"2024-05-08T21:21:21.047050+0000","last_active":"2024-05-08T21:21:21.046929+0000","last_peered":"2024-05-08T21:21:21.046929+0000","last_clean":"2024-05-08T21:21:21.046929+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:21.046929+0000","last_undegraded":"2024-05-08T21:21:21.046929+0000","last_fullsized":"2024-05-08T21:21:21.046929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2511","last_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_deep_scrub":"27'2511","last_deep_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.046889+0000","objects_scrubbed":3,"log_size":2511,"log_dups_size":0,"ondisk_log_size":2511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:40.172844+0000","scrub_duration":0.017442593999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'800","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.600144+0000","last_change":"2024-05-08T21:21:34.600251+0000","last_active":"2024-05-08T21:21:34.600144+0000","last_peered":"2024-05-08T21:21:34.600144+0000","last_clean":"2024-05-08T21:21:34.600144+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:34.600144+0000","last_undegraded":"2024-05-08T21:21:34.600144+0000","last_fullsized":"2024-05-08T21:21:34.600144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'800","last_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_deep_scrub":"27'800","last_deep_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.600116+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:59.161013+0000","scrub_duration":0.0021058320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3428,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.562677+0000","last_change":"2024-05-08T20:55:04.210883+0000","last_active":"2024-05-08T21:21:05.562677+0000","last_peered":"2024-05-08T21:21:05.562677+0000","last_clean":"2024-05-08T21:21:05.562677+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:21:05.562677+0000","last_undegraded":"2024-05-08T21:21:05.562677+0000","last_fullsized":"2024-05-08T21:21:05.562677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.741038+0000","last_change":"2024-05-08T21:21:45.741178+0000","last_active":"2024-05-08T21:21:45.741038+0000","last_peered":"2024-05-08T21:21:45.741038+0000","last_clean":"2024-05-08T21:21:45.741038+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:45.741038+0000","last_undegraded":"2024-05-08T21:21:45.741038+0000","last_fullsized":"2024-05-08T21:21:45.741038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T21:21:45.740993+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T21:21:45.740993+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.740993+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.617390+0000","scrub_duration":0.0038103590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'834","reported_seq":873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:55.298082+0000","last_change":"2024-05-08T21:21:55.298236+0000","last_active":"2024-05-08T21:21:55.298082+0000","last_peered":"2024-05-08T21:21:55.298082+0000","last_clean":"2024-05-08T21:21:55.298082+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:55.298082+0000","last_undegraded":"2024-05-08T21:21:55.298082+0000","last_fullsized":"2024-05-08T21:21:55.298082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'834","last_scrub_stamp":"2024-05-08T21:21:55.298042+0000","last_deep_scrub":"27'834","last_deep_scrub_stamp":"2024-05-08T21:21:55.298042+0000","last_clean_scrub_stamp":"2024-05-08T21:21:55.298042+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:11.517112+0000","scrub_duration":0.001697879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.041083+0000","last_change":"2024-05-08T20:55:04.214697+0000","last_active":"2024-05-08T21:21:22.041083+0000","last_peered":"2024-05-08T21:21:22.041083+0000","last_clean":"2024-05-08T21:21:22.041083+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:21:22.041083+0000","last_undegraded":"2024-05-08T21:21:22.041083+0000","last_fullsized":"2024-05-08T21:21:22.041083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1101","reported_seq":1140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:39.018005+0000","last_change":"2024-05-08T21:21:39.018107+0000","last_active":"2024-05-08T21:21:39.018005+0000","last_peered":"2024-05-08T21:21:39.018005+0000","last_clean":"2024-05-08T21:21:39.018005+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:39.018005+0000","last_undegraded":"2024-05-08T21:21:39.018005+0000","last_fullsized":"2024-05-08T21:21:39.018005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1101","last_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_deep_scrub":"27'1101","last_deep_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_clean_scrub_stamp":"2024-05-08T21:21:39.017978+0000","objects_scrubbed":2,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:33.890814+0000","scrub_duration":0.026486484000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'819","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.003346+0000","last_change":"2024-05-08T21:21:44.003447+0000","last_active":"2024-05-08T21:21:44.003346+0000","last_peered":"2024-05-08T21:21:44.003346+0000","last_clean":"2024-05-08T21:21:44.003346+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:44.003346+0000","last_undegraded":"2024-05-08T21:21:44.003346+0000","last_fullsized":"2024-05-08T21:21:44.003346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:44.003318+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:44.003318+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.003318+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.841715+0000","scrub_duration":0.001906243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3333,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:20.515556+0000","last_change":"2024-05-08T20:55:04.111300+0000","last_active":"2024-05-08T21:21:20.515556+0000","last_peered":"2024-05-08T21:21:20.515556+0000","last_clean":"2024-05-08T21:21:20.515556+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:21:20.515556+0000","last_undegraded":"2024-05-08T21:21:20.515556+0000","last_fullsized":"2024-05-08T21:21:20.515556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1830","reported_seq":1870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.673979+0000","last_change":"2024-05-08T21:21:25.674104+0000","last_active":"2024-05-08T21:21:25.673979+0000","last_peered":"2024-05-08T21:21:25.673979+0000","last_clean":"2024-05-08T21:21:25.673979+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:25.673979+0000","last_undegraded":"2024-05-08T21:21:25.673979+0000","last_fullsized":"2024-05-08T21:21:25.673979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1830","last_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_deep_scrub":"27'1830","last_deep_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.673951+0000","objects_scrubbed":6,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:42.700633+0000","scrub_duration":0.019234405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'858","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.214224+0000","last_change":"2024-05-08T21:21:51.214331+0000","last_active":"2024-05-08T21:21:51.214224+0000","last_peered":"2024-05-08T21:21:51.214224+0000","last_clean":"2024-05-08T21:21:51.214224+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:51.214224+0000","last_undegraded":"2024-05-08T21:21:51.214224+0000","last_fullsized":"2024-05-08T21:21:51.214224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'858","last_scrub_stamp":"2024-05-08T21:21:51.214198+0000","last_deep_scrub":"27'858","last_deep_scrub_stamp":"2024-05-08T21:21:51.214198+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.214198+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:14.478266+0000","scrub_duration":0.00159553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.752726+0000","last_change":"2024-05-08T20:55:04.108916+0000","last_active":"2024-05-08T21:21:07.752726+0000","last_peered":"2024-05-08T21:21:07.752726+0000","last_clean":"2024-05-08T21:21:07.752726+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:21:07.752726+0000","last_undegraded":"2024-05-08T21:21:07.752726+0000","last_fullsized":"2024-05-08T21:21:07.752726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1832","reported_seq":1873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.055783+0000","last_change":"2024-05-08T21:21:28.055783+0000","last_active":"2024-05-08T21:21:28.055783+0000","last_peered":"2024-05-08T21:21:28.055783+0000","last_clean":"2024-05-08T21:21:28.055783+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:28.055783+0000","last_undegraded":"2024-05-08T21:21:28.055783+0000","last_fullsized":"2024-05-08T21:21:28.055783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1832","last_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_deep_scrub":"27'1832","last_deep_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.055611+0000","objects_scrubbed":2,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:40.971546+0000","scrub_duration":0.014408755000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'841","reported_seq":881,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.197534+0000","last_change":"2024-05-08T21:21:24.197534+0000","last_active":"2024-05-08T21:21:24.197534+0000","last_peered":"2024-05-08T21:21:24.197534+0000","last_clean":"2024-05-08T21:21:24.197534+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:24.197534+0000","last_undegraded":"2024-05-08T21:21:24.197534+0000","last_fullsized":"2024-05-08T21:21:24.197534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'841","last_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_deep_scrub":"27'841","last_deep_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.197404+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:14.802421+0000","scrub_duration":0.001513105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4253,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:55.910022+0000","last_change":"2024-05-08T21:21:55.910186+0000","last_active":"2024-05-08T21:21:55.910022+0000","last_peered":"2024-05-08T21:21:55.910022+0000","last_clean":"2024-05-08T21:21:55.910022+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:55.910022+0000","last_undegraded":"2024-05-08T21:21:55.910022+0000","last_fullsized":"2024-05-08T21:21:55.910022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4215","last_scrub_stamp":"2024-05-08T21:21:55.909994+0000","last_deep_scrub":"27'4215","last_deep_scrub_stamp":"2024-05-08T21:21:55.909994+0000","last_clean_scrub_stamp":"2024-05-08T21:21:55.909994+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:54.098976+0000","scrub_duration":0.016427773999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1215","reported_seq":1255,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.896203+0000","last_change":"2024-05-08T21:21:22.896292+0000","last_active":"2024-05-08T21:21:22.896203+0000","last_peered":"2024-05-08T21:21:22.896203+0000","last_clean":"2024-05-08T21:21:22.896203+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:22.896203+0000","last_undegraded":"2024-05-08T21:21:22.896203+0000","last_fullsized":"2024-05-08T21:21:22.896203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1215","last_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_deep_scrub":"27'1215","last_deep_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.896177+0000","objects_scrubbed":1,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:50.970681+0000","scrub_duration":0.015373217999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'822","reported_seq":861,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.852353+0000","last_change":"2024-05-08T21:21:52.852458+0000","last_active":"2024-05-08T21:21:52.852353+0000","last_peered":"2024-05-08T21:21:52.852353+0000","last_clean":"2024-05-08T21:21:52.852353+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:52.852353+0000","last_undegraded":"2024-05-08T21:21:52.852353+0000","last_fullsized":"2024-05-08T21:21:52.852353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'822","last_scrub_stamp":"2024-05-08T21:21:52.852328+0000","last_deep_scrub":"27'822","last_deep_scrub_stamp":"2024-05-08T21:21:52.852328+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.852328+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:48.690725+0000","scrub_duration":0.0038734249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3511,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889900+0000","last_change":"2024-05-08T20:55:41.599810+0000","last_active":"2024-05-08T21:21:06.889900+0000","last_peered":"2024-05-08T21:21:06.889900+0000","last_clean":"2024-05-08T21:21:06.889900+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:21:06.889900+0000","last_undegraded":"2024-05-08T21:21:06.889900+0000","last_fullsized":"2024-05-08T21:21:06.889900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5324","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:35.739075+0000","last_change":"2024-05-08T21:21:35.739165+0000","last_active":"2024-05-08T21:21:35.739075+0000","last_peered":"2024-05-08T21:21:35.739075+0000","last_clean":"2024-05-08T21:21:35.739075+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:35.739075+0000","last_undegraded":"2024-05-08T21:21:35.739075+0000","last_fullsized":"2024-05-08T21:21:35.739075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5324","last_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_deep_scrub":"27'5324","last_deep_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_clean_scrub_stamp":"2024-05-08T21:21:35.739051+0000","objects_scrubbed":6,"log_size":5324,"log_dups_size":0,"ondisk_log_size":5324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:01.155361+0000","scrub_duration":0.059511772999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007490,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5317,"num_write_kb":42298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'815","reported_seq":855,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:43.325228+0000","last_change":"2024-05-08T21:21:43.325345+0000","last_active":"2024-05-08T21:21:43.325228+0000","last_peered":"2024-05-08T21:21:43.325228+0000","last_clean":"2024-05-08T21:21:43.325228+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:43.325228+0000","last_undegraded":"2024-05-08T21:21:43.325228+0000","last_fullsized":"2024-05-08T21:21:43.325228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'815","last_scrub_stamp":"2024-05-08T21:21:43.325201+0000","last_deep_scrub":"27'815","last_deep_scrub_stamp":"2024-05-08T21:21:43.325201+0000","last_clean_scrub_stamp":"2024-05-08T21:21:43.325201+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:23.201599+0000","scrub_duration":0.0025464149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3418","reported_seq":3456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:00.818321+0000","last_change":"2024-05-08T21:22:00.818459+0000","last_active":"2024-05-08T21:22:00.818321+0000","last_peered":"2024-05-08T21:22:00.818321+0000","last_clean":"2024-05-08T21:22:00.818321+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:22:00.818321+0000","last_undegraded":"2024-05-08T21:22:00.818321+0000","last_fullsized":"2024-05-08T21:22:00.818321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3418","last_scrub_stamp":"2024-05-08T21:22:00.818290+0000","last_deep_scrub":"27'3418","last_deep_scrub_stamp":"2024-05-08T21:22:00.818290+0000","last_clean_scrub_stamp":"2024-05-08T21:22:00.818290+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:37.583512+0000","scrub_duration":0.013355994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'844","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.927146+0000","last_change":"2024-05-08T21:21:50.927241+0000","last_active":"2024-05-08T21:21:50.927146+0000","last_peered":"2024-05-08T21:21:50.927146+0000","last_clean":"2024-05-08T21:21:50.927146+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:50.927146+0000","last_undegraded":"2024-05-08T21:21:50.927146+0000","last_fullsized":"2024-05-08T21:21:50.927146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:50.927119+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:50.927119+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.927119+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:46.765517+0000","scrub_duration":0.001723739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6345,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.633318+0000","last_change":"2024-05-08T21:21:27.633436+0000","last_active":"2024-05-08T21:21:27.633318+0000","last_peered":"2024-05-08T21:21:27.633318+0000","last_clean":"2024-05-08T21:21:27.633318+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:27.633318+0000","last_undegraded":"2024-05-08T21:21:27.633318+0000","last_fullsized":"2024-05-08T21:21:27.633318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3945","last_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_deep_scrub":"27'3945","last_deep_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.633289+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:18.238307+0000","scrub_duration":0.0021982780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4042,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.829273+0000","last_change":"2024-05-08T20:55:04.214905+0000","last_active":"2024-05-08T21:21:06.829273+0000","last_peered":"2024-05-08T21:21:06.829273+0000","last_clean":"2024-05-08T21:21:06.829273+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:21:06.829273+0000","last_undegraded":"2024-05-08T21:21:06.829273+0000","last_fullsized":"2024-05-08T21:21:06.829273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'844","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.626410+0000","last_change":"2024-05-08T21:21:31.626525+0000","last_active":"2024-05-08T21:21:31.626410+0000","last_peered":"2024-05-08T21:21:31.626410+0000","last_clean":"2024-05-08T21:21:31.626410+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:31.626410+0000","last_undegraded":"2024-05-08T21:21:31.626410+0000","last_fullsized":"2024-05-08T21:21:31.626410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.626385+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:26.764578+0000","scrub_duration":0.002149495,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2356","reported_seq":2396,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.779052+0000","last_change":"2024-05-08T21:21:30.779163+0000","last_active":"2024-05-08T21:21:30.779052+0000","last_peered":"2024-05-08T21:21:30.779052+0000","last_clean":"2024-05-08T21:21:30.779052+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:30.779052+0000","last_undegraded":"2024-05-08T21:21:30.779052+0000","last_fullsized":"2024-05-08T21:21:30.779052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2356","last_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_deep_scrub":"27'2356","last_deep_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.779025+0000","objects_scrubbed":2,"log_size":2356,"log_dups_size":0,"ondisk_log_size":2356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.917218+0000","scrub_duration":0.024843976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.235943+0000","last_change":"2024-05-08T21:21:28.236054+0000","last_active":"2024-05-08T21:21:28.235943+0000","last_peered":"2024-05-08T21:21:28.235943+0000","last_clean":"2024-05-08T21:21:28.235943+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:21:28.235943+0000","last_undegraded":"2024-05-08T21:21:28.235943+0000","last_fullsized":"2024-05-08T21:21:28.235943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.235917+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.151852+0000","scrub_duration":0.011500560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3604,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.894977+0000","last_change":"2024-05-08T20:55:04.215091+0000","last_active":"2024-05-08T21:21:06.894977+0000","last_peered":"2024-05-08T21:21:06.894977+0000","last_clean":"2024-05-08T21:21:06.894977+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:21:06.894977+0000","last_undegraded":"2024-05-08T21:21:06.894977+0000","last_fullsized":"2024-05-08T21:21:06.894977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'788","reported_seq":828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.126582+0000","last_change":"2024-05-08T21:21:27.126691+0000","last_active":"2024-05-08T21:21:27.126582+0000","last_peered":"2024-05-08T21:21:27.126582+0000","last_clean":"2024-05-08T21:21:27.126582+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:27.126582+0000","last_undegraded":"2024-05-08T21:21:27.126582+0000","last_fullsized":"2024-05-08T21:21:27.126582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'788","last_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_deep_scrub":"27'788","last_deep_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.126529+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:40.108784+0000","scrub_duration":0.0023240880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4041","reported_seq":4083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.245520+0000","last_change":"2024-05-08T21:21:30.245636+0000","last_active":"2024-05-08T21:21:30.245520+0000","last_peered":"2024-05-08T21:21:30.245520+0000","last_clean":"2024-05-08T21:21:30.245520+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:30.245520+0000","last_undegraded":"2024-05-08T21:21:30.245520+0000","last_fullsized":"2024-05-08T21:21:30.245520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4041","last_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_deep_scrub":"27'4041","last_deep_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.245496+0000","objects_scrubbed":3,"log_size":4041,"log_dups_size":0,"ondisk_log_size":4041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.227751+0000","scrub_duration":0.033406524999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.839732+0000","last_change":"2024-05-08T20:55:04.210881+0000","last_active":"2024-05-08T21:21:06.839732+0000","last_peered":"2024-05-08T21:21:06.839732+0000","last_clean":"2024-05-08T21:21:06.839732+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:21:06.839732+0000","last_undegraded":"2024-05-08T21:21:06.839732+0000","last_fullsized":"2024-05-08T21:21:06.839732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2956","reported_seq":2997,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.155186+0000","last_change":"2024-05-08T21:21:34.155283+0000","last_active":"2024-05-08T21:21:34.155186+0000","last_peered":"2024-05-08T21:21:34.155186+0000","last_clean":"2024-05-08T21:21:34.155186+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:34.155186+0000","last_undegraded":"2024-05-08T21:21:34.155186+0000","last_fullsized":"2024-05-08T21:21:34.155186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2956","last_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_deep_scrub":"27'2956","last_deep_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.155158+0000","objects_scrubbed":1,"log_size":2956,"log_dups_size":0,"ondisk_log_size":2956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:59.571468+0000","scrub_duration":0.015577423999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'839","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.871208+0000","last_change":"2024-05-08T21:21:42.871328+0000","last_active":"2024-05-08T21:21:42.871208+0000","last_peered":"2024-05-08T21:21:42.871208+0000","last_clean":"2024-05-08T21:21:42.871208+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:42.871208+0000","last_undegraded":"2024-05-08T21:21:42.871208+0000","last_fullsized":"2024-05-08T21:21:42.871208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:21:42.871178+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:21:42.871178+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.871178+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:22.747575+0000","scrub_duration":0.0049309480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3605,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.004491+0000","last_change":"2024-05-08T21:21:57.004649+0000","last_active":"2024-05-08T21:21:57.004491+0000","last_peered":"2024-05-08T21:21:57.004491+0000","last_clean":"2024-05-08T21:21:57.004491+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:57.004491+0000","last_undegraded":"2024-05-08T21:21:57.004491+0000","last_fullsized":"2024-05-08T21:21:57.004491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3566","last_scrub_stamp":"2024-05-08T21:21:57.004462+0000","last_deep_scrub":"27'3566","last_deep_scrub_stamp":"2024-05-08T21:21:57.004462+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.004462+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:13.223532+0000","scrub_duration":0.017708050999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2161","reported_seq":2201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.877526+0000","last_change":"2024-05-08T21:21:24.877608+0000","last_active":"2024-05-08T21:21:24.877526+0000","last_peered":"2024-05-08T21:21:24.877526+0000","last_clean":"2024-05-08T21:21:24.877526+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:24.877526+0000","last_undegraded":"2024-05-08T21:21:24.877526+0000","last_fullsized":"2024-05-08T21:21:24.877526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2161","last_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_deep_scrub":"27'2161","last_deep_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.877501+0000","objects_scrubbed":4,"log_size":2161,"log_dups_size":0,"ondisk_log_size":2161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.662888+0000","scrub_duration":0.036106909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2748,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'779","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.957532+0000","last_change":"2024-05-08T21:21:47.957630+0000","last_active":"2024-05-08T21:21:47.957532+0000","last_peered":"2024-05-08T21:21:47.957532+0000","last_clean":"2024-05-08T21:21:47.957532+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:47.957532+0000","last_undegraded":"2024-05-08T21:21:47.957532+0000","last_fullsized":"2024-05-08T21:21:47.957532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-05-08T21:21:47.957506+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-05-08T21:21:47.957506+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.957506+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:42.830342+0000","scrub_duration":0.0063647870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3369,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.490537+0000","last_change":"2024-05-08T21:21:50.490702+0000","last_active":"2024-05-08T21:21:50.490537+0000","last_peered":"2024-05-08T21:21:50.490537+0000","last_clean":"2024-05-08T21:21:50.490537+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:50.490537+0000","last_undegraded":"2024-05-08T21:21:50.490537+0000","last_fullsized":"2024-05-08T21:21:50.490537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3331","last_scrub_stamp":"2024-05-08T21:21:50.490507+0000","last_deep_scrub":"27'3331","last_deep_scrub_stamp":"2024-05-08T21:21:50.490507+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.490507+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:46.328904+0000","scrub_duration":0.015760401,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1267","reported_seq":1307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:36.960796+0000","last_change":"2024-05-08T21:21:36.960886+0000","last_active":"2024-05-08T21:21:36.960796+0000","last_peered":"2024-05-08T21:21:36.960796+0000","last_clean":"2024-05-08T21:21:36.960796+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:36.960796+0000","last_undegraded":"2024-05-08T21:21:36.960796+0000","last_fullsized":"2024-05-08T21:21:36.960796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1267","last_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_deep_scrub":"27'1267","last_deep_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_clean_scrub_stamp":"2024-05-08T21:21:36.960770+0000","objects_scrubbed":2,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:16.837167+0000","scrub_duration":0.013455020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'819","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.045835+0000","last_change":"2024-05-08T21:21:40.045946+0000","last_active":"2024-05-08T21:21:40.045835+0000","last_peered":"2024-05-08T21:21:40.045835+0000","last_clean":"2024-05-08T21:21:40.045835+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:40.045835+0000","last_undegraded":"2024-05-08T21:21:40.045835+0000","last_fullsized":"2024-05-08T21:21:40.045835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.045808+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:19.922206+0000","scrub_duration":0.003983337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3659,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.902899+0000","last_change":"2024-05-08T20:55:04.109865+0000","last_active":"2024-05-08T21:21:06.902899+0000","last_peered":"2024-05-08T21:21:06.902899+0000","last_clean":"2024-05-08T21:21:06.902899+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:21:06.902899+0000","last_undegraded":"2024-05-08T21:21:06.902899+0000","last_fullsized":"2024-05-08T21:21:06.902899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1127","reported_seq":1168,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:46.127654+0000","last_change":"2024-05-08T21:21:46.127752+0000","last_active":"2024-05-08T21:21:46.127654+0000","last_peered":"2024-05-08T21:21:46.127654+0000","last_clean":"2024-05-08T21:21:46.127654+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:46.127654+0000","last_undegraded":"2024-05-08T21:21:46.127654+0000","last_fullsized":"2024-05-08T21:21:46.127654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1127","last_scrub_stamp":"2024-05-08T21:21:46.127626+0000","last_deep_scrub":"27'1127","last_deep_scrub_stamp":"2024-05-08T21:21:46.127626+0000","last_clean_scrub_stamp":"2024-05-08T21:21:46.127626+0000","objects_scrubbed":1,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:41.000462+0000","scrub_duration":0.013414069000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.053152+0000","last_change":"2024-05-08T21:21:29.053278+0000","last_active":"2024-05-08T21:21:29.053152+0000","last_peered":"2024-05-08T21:21:29.053152+0000","last_clean":"2024-05-08T21:21:29.053152+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:29.053152+0000","last_undegraded":"2024-05-08T21:21:29.053152+0000","last_fullsized":"2024-05-08T21:21:29.053152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.053124+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.191318+0000","scrub_duration":0.0019797819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.828748+0000","last_change":"2024-05-08T21:21:59.828927+0000","last_active":"2024-05-08T21:21:59.828748+0000","last_peered":"2024-05-08T21:21:59.828748+0000","last_clean":"2024-05-08T21:21:59.828748+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:59.828748+0000","last_undegraded":"2024-05-08T21:21:59.828748+0000","last_fullsized":"2024-05-08T21:21:59.828748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3469","last_scrub_stamp":"2024-05-08T21:21:59.828717+0000","last_deep_scrub":"27'3469","last_deep_scrub_stamp":"2024-05-08T21:21:59.828717+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.828717+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:25.850036+0000","scrub_duration":0.012228011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2227","reported_seq":2267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.905689+0000","last_change":"2024-05-08T21:21:32.905786+0000","last_active":"2024-05-08T21:21:32.905689+0000","last_peered":"2024-05-08T21:21:32.905689+0000","last_clean":"2024-05-08T21:21:32.905689+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:32.905689+0000","last_undegraded":"2024-05-08T21:21:32.905689+0000","last_fullsized":"2024-05-08T21:21:32.905689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2227","last_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_deep_scrub":"27'2227","last_deep_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.905663+0000","objects_scrubbed":2,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:58.321972+0000","scrub_duration":0.026572928999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'888","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.888496+0000","last_change":"2024-05-08T21:21:26.888635+0000","last_active":"2024-05-08T21:21:26.888496+0000","last_peered":"2024-05-08T21:21:26.888496+0000","last_clean":"2024-05-08T21:21:26.888496+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:26.888496+0000","last_undegraded":"2024-05-08T21:21:26.888496+0000","last_fullsized":"2024-05-08T21:21:26.888496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'888","last_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_deep_scrub":"27'888","last_deep_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.888468+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:46.014423+0000","scrub_duration":0.0039110660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3793,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:46.473159+0000","last_change":"2024-05-08T21:21:46.473294+0000","last_active":"2024-05-08T21:21:46.473159+0000","last_peered":"2024-05-08T21:21:46.473159+0000","last_clean":"2024-05-08T21:21:46.473159+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:46.473159+0000","last_undegraded":"2024-05-08T21:21:46.473159+0000","last_fullsized":"2024-05-08T21:21:46.473159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3756","last_scrub_stamp":"2024-05-08T21:21:46.473129+0000","last_deep_scrub":"27'3756","last_deep_scrub_stamp":"2024-05-08T21:21:46.473129+0000","last_clean_scrub_stamp":"2024-05-08T21:21:46.473129+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:32.774488+0000","scrub_duration":0.015135117999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3680","reported_seq":3720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.885021+0000","last_change":"2024-05-08T21:21:29.885123+0000","last_active":"2024-05-08T21:21:29.885021+0000","last_peered":"2024-05-08T21:21:29.885021+0000","last_clean":"2024-05-08T21:21:29.885021+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:29.885021+0000","last_undegraded":"2024-05-08T21:21:29.885021+0000","last_fullsized":"2024-05-08T21:21:29.885021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3680","last_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_deep_scrub":"27'3680","last_deep_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.884993+0000","objects_scrubbed":2,"log_size":3680,"log_dups_size":0,"ondisk_log_size":3680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.867249+0000","scrub_duration":0.031053055999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'844","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.879171+0000","last_change":"2024-05-08T21:21:51.879171+0000","last_active":"2024-05-08T21:21:51.879171+0000","last_peered":"2024-05-08T21:21:51.879171+0000","last_clean":"2024-05-08T21:21:51.879171+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:51.879171+0000","last_undegraded":"2024-05-08T21:21:51.879171+0000","last_fullsized":"2024-05-08T21:21:51.879171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:51.879027+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:51.879027+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.879027+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:27.221148+0000","scrub_duration":0.00408691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3513,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:05.714703+0000","last_change":"2024-05-08T20:55:04.108795+0000","last_active":"2024-05-08T21:21:05.714703+0000","last_peered":"2024-05-08T21:21:05.714703+0000","last_clean":"2024-05-08T21:21:05.714703+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:21:05.714703+0000","last_undegraded":"2024-05-08T21:21:05.714703+0000","last_fullsized":"2024-05-08T21:21:05.714703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4109","reported_seq":4150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.255874+0000","last_change":"2024-05-08T21:21:29.255874+0000","last_active":"2024-05-08T21:21:29.255874+0000","last_peered":"2024-05-08T21:21:29.255874+0000","last_clean":"2024-05-08T21:21:29.255874+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:29.255874+0000","last_undegraded":"2024-05-08T21:21:29.255874+0000","last_fullsized":"2024-05-08T21:21:29.255874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4109","last_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_deep_scrub":"27'4109","last_deep_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.255742+0000","objects_scrubbed":3,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.393936+0000","scrub_duration":0.030240922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'810","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:49.878919+0000","last_change":"2024-05-08T21:21:49.879015+0000","last_active":"2024-05-08T21:21:49.878919+0000","last_peered":"2024-05-08T21:21:49.878919+0000","last_clean":"2024-05-08T21:21:49.878919+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:49.878919+0000","last_undegraded":"2024-05-08T21:21:49.878919+0000","last_fullsized":"2024-05-08T21:21:49.878919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'810","last_scrub_stamp":"2024-05-08T21:21:49.878891+0000","last_deep_scrub":"27'810","last_deep_scrub_stamp":"2024-05-08T21:21:49.878891+0000","last_clean_scrub_stamp":"2024-05-08T21:21:49.878891+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:48.067874+0000","scrub_duration":0.001602535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.710824+0000","last_change":"2024-05-08T20:55:41.605046+0000","last_active":"2024-05-08T21:21:07.710824+0000","last_peered":"2024-05-08T21:21:07.710824+0000","last_clean":"2024-05-08T21:21:07.710824+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:21:07.710824+0000","last_undegraded":"2024-05-08T21:21:07.710824+0000","last_fullsized":"2024-05-08T21:21:07.710824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3441","reported_seq":3482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.602580+0000","last_change":"2024-05-08T21:21:21.602580+0000","last_active":"2024-05-08T21:21:21.602580+0000","last_peered":"2024-05-08T21:21:21.602580+0000","last_clean":"2024-05-08T21:21:21.602580+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:21.602580+0000","last_undegraded":"2024-05-08T21:21:21.602580+0000","last_fullsized":"2024-05-08T21:21:21.602580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3441","last_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_deep_scrub":"27'3441","last_deep_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.602478+0000","objects_scrubbed":5,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:12.507196+0000","scrub_duration":0.053816461000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'810","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.215510+0000","last_change":"2024-05-08T21:21:26.215510+0000","last_active":"2024-05-08T21:21:26.215510+0000","last_peered":"2024-05-08T21:21:26.215510+0000","last_clean":"2024-05-08T21:21:26.215510+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:26.215510+0000","last_undegraded":"2024-05-08T21:21:26.215510+0000","last_fullsized":"2024-05-08T21:21:26.215510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'810","last_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_deep_scrub":"27'810","last_deep_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.215374+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:22.000760+0000","scrub_duration":0.0030007150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.864134+0000","last_change":"2024-05-08T20:55:41.613686+0000","last_active":"2024-05-08T21:21:06.864134+0000","last_peered":"2024-05-08T21:21:06.864134+0000","last_clean":"2024-05-08T21:21:06.864134+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:21:06.864134+0000","last_undegraded":"2024-05-08T21:21:06.864134+0000","last_fullsized":"2024-05-08T21:21:06.864134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3911","reported_seq":3951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.858266+0000","last_change":"2024-05-08T21:21:21.858266+0000","last_active":"2024-05-08T21:21:21.858266+0000","last_peered":"2024-05-08T21:21:21.858266+0000","last_clean":"2024-05-08T21:21:21.858266+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:21.858266+0000","last_undegraded":"2024-05-08T21:21:21.858266+0000","last_fullsized":"2024-05-08T21:21:21.858266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3911","last_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_deep_scrub":"27'3911","last_deep_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.858055+0000","objects_scrubbed":2,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:12.384037+0000","scrub_duration":0.015982177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'819","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:56.841143+0000","last_change":"2024-05-08T21:21:56.841143+0000","last_active":"2024-05-08T21:21:56.841143+0000","last_peered":"2024-05-08T21:21:56.841143+0000","last_clean":"2024-05-08T21:21:56.841143+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:56.841143+0000","last_undegraded":"2024-05-08T21:21:56.841143+0000","last_fullsized":"2024-05-08T21:21:56.841143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:56.841000+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:56.841000+0000","last_clean_scrub_stamp":"2024-05-08T21:21:56.841000+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:13.060070+0000","scrub_duration":0.0020392829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3415,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.626642+0000","last_change":"2024-05-08T20:55:04.210965+0000","last_active":"2024-05-08T21:21:07.626642+0000","last_peered":"2024-05-08T21:21:07.626642+0000","last_clean":"2024-05-08T21:21:07.626642+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:21:07.626642+0000","last_undegraded":"2024-05-08T21:21:07.626642+0000","last_fullsized":"2024-05-08T21:21:07.626642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1802","reported_seq":1843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.593429+0000","last_change":"2024-05-08T21:21:22.593429+0000","last_active":"2024-05-08T21:21:22.593429+0000","last_peered":"2024-05-08T21:21:22.593429+0000","last_clean":"2024-05-08T21:21:22.593429+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:22.593429+0000","last_undegraded":"2024-05-08T21:21:22.593429+0000","last_fullsized":"2024-05-08T21:21:22.593429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1802","last_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_deep_scrub":"27'1802","last_deep_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.593300+0000","objects_scrubbed":1,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:44.040446+0000","scrub_duration":0.0043429840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'818","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.201091+0000","last_change":"2024-05-08T21:21:52.201091+0000","last_active":"2024-05-08T21:21:52.201091+0000","last_peered":"2024-05-08T21:21:52.201091+0000","last_clean":"2024-05-08T21:21:52.201091+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:52.201091+0000","last_undegraded":"2024-05-08T21:21:52.201091+0000","last_fullsized":"2024-05-08T21:21:52.201091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:52.200940+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:52.200940+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.200940+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:48.039338+0000","scrub_duration":0.0051215999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'845","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.887559+0000","last_change":"2024-05-08T21:21:59.887670+0000","last_active":"2024-05-08T21:21:59.887559+0000","last_peered":"2024-05-08T21:21:59.887559+0000","last_clean":"2024-05-08T21:21:59.887559+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:59.887559+0000","last_undegraded":"2024-05-08T21:21:59.887559+0000","last_fullsized":"2024-05-08T21:21:59.887559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'845","last_scrub_stamp":"2024-05-08T21:21:59.887533+0000","last_deep_scrub":"27'845","last_deep_scrub_stamp":"2024-05-08T21:21:59.887533+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.887533+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:12.518654+0000","scrub_duration":0.0022607679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'869","reported_seq":917,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.662227+0000","last_change":"2024-05-08T21:21:28.662357+0000","last_active":"2024-05-08T21:21:28.662227+0000","last_peered":"2024-05-08T21:21:28.662227+0000","last_clean":"2024-05-08T21:21:28.662227+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:28.662227+0000","last_undegraded":"2024-05-08T21:21:28.662227+0000","last_fullsized":"2024-05-08T21:21:28.662227+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'869","last_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_deep_scrub":"27'869","last_deep_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.662201+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:47.788156+0000","scrub_duration":0.0052510159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'817","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.739694+0000","last_change":"2024-05-08T21:21:24.739823+0000","last_active":"2024-05-08T21:21:24.739694+0000","last_peered":"2024-05-08T21:21:24.739694+0000","last_clean":"2024-05-08T21:21:24.739694+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:24.739694+0000","last_undegraded":"2024-05-08T21:21:24.739694+0000","last_fullsized":"2024-05-08T21:21:24.739694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'817","last_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_deep_scrub":"27'817","last_deep_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.739660+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:15.265642+0000","scrub_duration":0.002018003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'848","reported_seq":888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.015648+0000","last_change":"2024-05-08T21:21:51.015747+0000","last_active":"2024-05-08T21:21:51.015648+0000","last_peered":"2024-05-08T21:21:51.015648+0000","last_clean":"2024-05-08T21:21:51.015648+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:51.015648+0000","last_undegraded":"2024-05-08T21:21:51.015648+0000","last_fullsized":"2024-05-08T21:21:51.015648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'848","last_scrub_stamp":"2024-05-08T21:21:51.015622+0000","last_deep_scrub":"27'848","last_deep_scrub_stamp":"2024-05-08T21:21:51.015622+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.015622+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:07.234691+0000","scrub_duration":0.0025535380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'814","reported_seq":854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.874297+0000","last_change":"2024-05-08T21:21:52.874413+0000","last_active":"2024-05-08T21:21:52.874297+0000","last_peered":"2024-05-08T21:21:52.874297+0000","last_clean":"2024-05-08T21:21:52.874297+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:52.874297+0000","last_undegraded":"2024-05-08T21:21:52.874297+0000","last_fullsized":"2024-05-08T21:21:52.874297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'814","last_scrub_stamp":"2024-05-08T21:21:52.874259+0000","last_deep_scrub":"27'814","last_deep_scrub_stamp":"2024-05-08T21:21:52.874259+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.874259+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:16.138326+0000","scrub_duration":0.001750756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'818","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.965165+0000","last_change":"2024-05-08T21:21:44.965262+0000","last_active":"2024-05-08T21:21:44.965165+0000","last_peered":"2024-05-08T21:21:44.965165+0000","last_clean":"2024-05-08T21:21:44.965165+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:44.965165+0000","last_undegraded":"2024-05-08T21:21:44.965165+0000","last_fullsized":"2024-05-08T21:21:44.965165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:44.965141+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:44.965141+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.965141+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:39.837977+0000","scrub_duration":0.0064359550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'882","reported_seq":921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:01.857579+0000","last_change":"2024-05-08T21:22:01.857676+0000","last_active":"2024-05-08T21:22:01.857579+0000","last_peered":"2024-05-08T21:22:01.857579+0000","last_clean":"2024-05-08T21:22:01.857579+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:22:01.857579+0000","last_undegraded":"2024-05-08T21:22:01.857579+0000","last_fullsized":"2024-05-08T21:22:01.857579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'882","last_scrub_stamp":"2024-05-08T21:22:01.857552+0000","last_deep_scrub":"27'882","last_deep_scrub_stamp":"2024-05-08T21:22:01.857552+0000","last_clean_scrub_stamp":"2024-05-08T21:22:01.857552+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:38.930362+0000","scrub_duration":0.0015362259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'808","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.790030+0000","last_change":"2024-05-08T21:21:23.790119+0000","last_active":"2024-05-08T21:21:23.790030+0000","last_peered":"2024-05-08T21:21:23.790030+0000","last_clean":"2024-05-08T21:21:23.790030+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:23.790030+0000","last_undegraded":"2024-05-08T21:21:23.790030+0000","last_fullsized":"2024-05-08T21:21:23.790030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'808","last_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_deep_scrub":"27'808","last_deep_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_clean_scrub_stamp":"2024-05-08T21:21:23.790007+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:31.585133+0000","scrub_duration":0.0053510820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'808","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.760633+0000","last_change":"2024-05-08T21:21:47.760795+0000","last_active":"2024-05-08T21:21:47.760633+0000","last_peered":"2024-05-08T21:21:47.760633+0000","last_clean":"2024-05-08T21:21:47.760633+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:47.760633+0000","last_undegraded":"2024-05-08T21:21:47.760633+0000","last_fullsized":"2024-05-08T21:21:47.760633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'808","last_scrub_stamp":"2024-05-08T21:21:47.760591+0000","last_deep_scrub":"27'808","last_deep_scrub_stamp":"2024-05-08T21:21:47.760591+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.760591+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:42.633427+0000","scrub_duration":0.0020371019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'798","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.956784+0000","last_change":"2024-05-08T21:21:45.956784+0000","last_active":"2024-05-08T21:21:45.956784+0000","last_peered":"2024-05-08T21:21:45.956784+0000","last_clean":"2024-05-08T21:21:45.956784+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:45.956784+0000","last_undegraded":"2024-05-08T21:21:45.956784+0000","last_fullsized":"2024-05-08T21:21:45.956784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'798","last_scrub_stamp":"2024-05-08T21:21:45.956652+0000","last_deep_scrub":"27'798","last_deep_scrub_stamp":"2024-05-08T21:21:45.956652+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.956652+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.833049+0000","scrub_duration":0.0027042889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'833","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:58.840570+0000","last_change":"2024-05-08T21:21:58.840570+0000","last_active":"2024-05-08T21:21:58.840570+0000","last_peered":"2024-05-08T21:21:58.840570+0000","last_clean":"2024-05-08T21:21:58.840570+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:58.840570+0000","last_undegraded":"2024-05-08T21:21:58.840570+0000","last_fullsized":"2024-05-08T21:21:58.840570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'833","last_scrub_stamp":"2024-05-08T21:21:58.840443+0000","last_deep_scrub":"27'833","last_deep_scrub_stamp":"2024-05-08T21:21:58.840443+0000","last_clean_scrub_stamp":"2024-05-08T21:21:58.840443+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:57.029426+0000","scrub_duration":0.0016211890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'841","reported_seq":881,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.961917+0000","last_change":"2024-05-08T21:21:52.961917+0000","last_active":"2024-05-08T21:21:52.961917+0000","last_peered":"2024-05-08T21:21:52.961917+0000","last_clean":"2024-05-08T21:21:52.961917+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:52.961917+0000","last_undegraded":"2024-05-08T21:21:52.961917+0000","last_fullsized":"2024-05-08T21:21:52.961917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'841","last_scrub_stamp":"2024-05-08T21:21:52.961795+0000","last_deep_scrub":"27'841","last_deep_scrub_stamp":"2024-05-08T21:21:52.961795+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.961795+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:51.150777+0000","scrub_duration":0.0037096870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'836","reported_seq":875,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.919525+0000","last_change":"2024-05-08T21:21:47.919525+0000","last_active":"2024-05-08T21:21:47.919525+0000","last_peered":"2024-05-08T21:21:47.919525+0000","last_clean":"2024-05-08T21:21:47.919525+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:47.919525+0000","last_undegraded":"2024-05-08T21:21:47.919525+0000","last_fullsized":"2024-05-08T21:21:47.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'836","last_scrub_stamp":"2024-05-08T21:21:47.919374+0000","last_deep_scrub":"27'836","last_deep_scrub_stamp":"2024-05-08T21:21:47.919374+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.919374+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:04.138444+0000","scrub_duration":0.001520024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86560,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113556,"ondisk_log_size":113556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52760,"ondisk_log_size":52760,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243565076,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2931,"num_read_kb":7530,"num_write":91807,"num_write_kb":660236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487194624,"data_stored":487130152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91125,"ondisk_log_size":91125,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575179,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":516716,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":450302,"kb_avail":93855124,"statfs":{"total":96636764160,"available":96107646976,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":461109707},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.47099999999999997},"min":{"1min":0.247,"5min":0.216,"15min":0.191},"max":{"1min":2.996,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67200000000000004,"15min":0.501},"min":{"1min":0.30299999999999999,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":2.121,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.752,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.5660000000000001,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.67400000000000004,"15min":0.51800000000000002},"min":{"1min":0.25800000000000001,"5min":0.22,"15min":0.20499999999999999},"max":{"1min":1.385,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.5},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":2.3519999999999999,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.621,"15min":0.50700000000000001},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.3380000000000001,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77300000000000002,"15min":0.56000000000000005},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.1269999999999998,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.81599999999999995,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":9.0800000000000001,"5min":9.0800000000000001,"15min":9.0800000000000001},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":1.0329999999999999,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":2.7589999999999999,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.47799999999999998}]},{"osd":5,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.68300000000000005,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":1.304,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76100000000000001,"15min":0.58899999999999997},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":1.472,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.51400000000000001}]},{"osd":6,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.68400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":0.83299999999999996,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.504},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.60399999999999998},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":3.0310000000000001,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.55400000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575179,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.27600000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":4.0460000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":9.1980000000000004,"5min":9.1980000000000004,"15min":9.1980000000000004},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.58799999999999997,"15min":0.505},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":0.67100000000000004,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.849,"5min":0.79200000000000004,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":26.343,"5min":26.343,"15min":26.343},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":3.694,"15min":3.694},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.64000000000000001,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":9.1539999999999999,"5min":9.1539999999999999,"15min":9.1539999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":2.278,"15min":3.8250000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":2.3039999999999998,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.54300000000000004}]},{"osd":4,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":4.5670000000000002,"5min":4.5670000000000002,"15min":7.3810000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.089,"5min":0.70999999999999996,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.222},"max":{"1min":12.109999999999999,"5min":12.109999999999999,"15min":12.109999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.8680000000000001,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.57299999999999995},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":0.80700000000000005,"5min":3.024,"15min":4.0119999999999996},"last":0.46100000000000002}]},{"osd":7,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.86199999999999999,"5min":2.2989999999999999,"15min":3.8100000000000001},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.56899999999999995},"min":{"1min":0.441,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":0.75600000000000001,"5min":2.919,"15min":3.8780000000000001},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575179,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581444,"kb_used_data":81084,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790396,"statfs":{"total":96636764160,"available":96041365504,"internally_reserved":0,"allocated":83030016,"data_stored":82846318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.47399999999999998,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":1.349,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"min":{"1min":0.185,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.52500000000000002,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.50800000000000001}]},{"osd":2,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":1.448,"5min":5.141,"15min":5.141},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.55300000000000005,"15min":0.46400000000000002},"min":{"1min":0.311,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.4750000000000001,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.58699999999999997}]},{"osd":3,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.64000000000000001,"15min":0.501},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.321,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.51600000000000001,"15min":0.46100000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.19},"max":{"1min":0.67700000000000005,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.61799999999999999}]},{"osd":4,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55400000000000005,"15min":0.50600000000000001},"min":{"1min":0.254,"5min":0.25,"15min":0.247},"max":{"1min":0.84299999999999997,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.751},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66100000000000003,"15min":0.54800000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.2829999999999999,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.90200000000000002}]},{"osd":5,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.50700000000000001},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":1.006,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.59599999999999997,"15min":0.56100000000000005},"min":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.95199999999999996}]},{"osd":6,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.67100000000000004,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0369999999999999,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.63100000000000001,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.28499999999999998},"max":{"1min":0.86499999999999999,"5min":6.766,"15min":6.766},"last":0.88500000000000001}]},{"osd":7,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.746,"15min":0.60399999999999998},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":1.377,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69999999999999996,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.33900000000000002},"max":{"1min":0.96599999999999997,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.86599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575180,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375604,"kb_used_data":29548,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996236,"statfs":{"total":96636764160,"available":96252145664,"internally_reserved":0,"allocated":30257152,"data_stored":30069546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40500000000000003,"15min":0.34699999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.86099999999999999,"5min":3.823,"15min":3.823},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.45200000000000001,"15min":0.41199999999999998},"min":{"1min":0.27600000000000002,"5min":0.23100000000000001,"15min":0.19},"max":{"1min":2.734,"5min":3.879,"15min":4.5919999999999996},"last":0.39900000000000002}]},{"osd":2,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.45700000000000002,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20999999999999999,"15min":0.17399999999999999},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.314},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.9870000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.49199999999999999,"15min":0.438},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":2.4900000000000002,"5min":3.7160000000000002,"15min":3.895},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.498,"15min":0.44400000000000001},"min":{"1min":0.26500000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":2.4750000000000001,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.38300000000000001}]},{"osd":4,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.48499999999999999},"min":{"1min":0.38500000000000001,"5min":0.26400000000000001,"15min":0.254},"max":{"1min":1.127,"5min":3.794,"15min":5.6559999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.496,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.76400000000000001,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.53300000000000003}]},{"osd":5,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.55500000000000005,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":4.298,"5min":4.298,"15min":4.298},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.77100000000000002,"15min":0.60299999999999998},"min":{"1min":0.40300000000000002,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":1.206,"5min":14.901,"15min":14.901},"last":0.48799999999999999}]},{"osd":6,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":1.0329999999999999,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.501},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.60199999999999998,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":2.7669999999999999,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.31900000000000001},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":5.0220000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.61699999999999999},"min":{"1min":0.45300000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":1.1739999999999999,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.39200000000000002,"15min":0.34200000000000003},"min":{"1min":0.19600000000000001,"5min":0.17899999999999999,"15min":0.17399999999999999},"max":{"1min":0.42999999999999999,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.44900000000000001,"15min":0.40699999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.91500000000000004,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.44900000000000001,"15min":0.39600000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.186},"max":{"1min":0.47599999999999998,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.58299999999999996,"15min":0.47399999999999998},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.41199999999999998,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.52300000000000002}]},{"osd":3,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.433,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":2.0019999999999998,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.495},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.249,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":0.64800000000000002,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.56399999999999995}]},{"osd":4,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":7.3799999999999999,"15min":16.651},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.629,"15min":0.63},"min":{"1min":0.28699999999999998,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.88400000000000001,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.874}]},{"osd":5,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":2.04,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.69399999999999995,"15min":0.60999999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86899999999999999,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.84399999999999997}]},{"osd":6,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.54100000000000004},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.309},"max":{"1min":2.0920000000000001,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.79500000000000004}]},{"osd":7,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.745,"15min":0.627},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.73399999999999999,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.35099999999999998},"max":{"1min":2.0659999999999998,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.81499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575179,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505452,"kb_used_data":37156,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866388,"statfs":{"total":96636764160,"available":96119181312,"internally_reserved":0,"allocated":38047744,"data_stored":37867820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.49099999999999999,"15min":0.42999999999999999},"min":{"1min":0.19500000000000001,"5min":0.19,"15min":0.16900000000000001},"max":{"1min":1.0549999999999999,"5min":6.407,"15min":6.407},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.69699999999999995,"15min":0.504},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":1.2150000000000001,"5min":16.724,"15min":16.724},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.86599999999999999,"15min":0.60299999999999998},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":4.4740000000000002,"5min":13.058,"15min":15.259},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.53700000000000003},"min":{"1min":0.249,"5min":0.217,"15min":0.192},"max":{"1min":4.2009999999999996,"5min":9.5370000000000008,"15min":10.831},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.214},"max":{"1min":0.81799999999999995,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.70599999999999996,"15min":0.52900000000000003},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":5.6539999999999999,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":0.53300000000000003}]},{"osd":4,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.82699999999999996,"15min":0.71099999999999997},"min":{"1min":0.31,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82499999999999996,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.155,"5min":1.0700000000000001,"15min":0.81000000000000005},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":5.5549999999999997,"5min":11.755000000000001,"15min":15.224},"last":0.78200000000000003}]},{"osd":5,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0289999999999999,"5min":2.403,"15min":4.3860000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71299999999999997,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.6419999999999999,"5min":5.548,"15min":5.548},"last":0.66700000000000004}]},{"osd":6,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.95099999999999996,"15min":0.70599999999999996},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":5.5990000000000002,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.621},"min":{"1min":0.39700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.997,"5min":4.1100000000000003,"15min":5.2530000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.85099999999999998,"15min":0.68400000000000005},"min":{"1min":0.39300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84799999999999998,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.212,"5min":1.0489999999999999,"15min":0.753},"min":{"1min":0.45500000000000002,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":5.6299999999999999,"5min":12.939,"15min":12.939},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575179,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.61299999999999999,"15min":0.495},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.018,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.63,"15min":0.5},"min":{"1min":0.28199999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":9.4900000000000002,"5min":9.4900000000000002,"15min":9.4900000000000002},"last":0.52500000000000002}]},{"osd":1,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":0.84199999999999997,"15min":0.56899999999999995},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":18.529,"5min":18.529,"15min":18.529},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56200000000000006,"15min":0.54000000000000004},"min":{"1min":0.27800000000000002,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":2.129,"5min":7.343,"15min":7.4370000000000003},"last":0.60799999999999998}]},{"osd":2,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":0.77800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29399999999999998,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":15.917,"5min":15.917,"15min":15.917},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":2.1579999999999999,"5min":3.9900000000000002,"15min":6.617},"last":0.56299999999999994}]},{"osd":3,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.79000000000000004,"15min":0.60699999999999998},"min":{"1min":0.32900000000000001,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":9.3759999999999994,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.405,"5min":0.80400000000000005,"15min":0.61599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28299999999999997},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":0.78100000000000003}]},{"osd":5,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.67800000000000005,"15min":0.56899999999999995},"min":{"1min":0.249,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.997,"5min":0.69599999999999995,"15min":0.58799999999999997},"min":{"1min":0.35899999999999999,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":9.5259999999999998,"5min":9.5259999999999998,"15min":9.5259999999999998},"last":0.628}]},{"osd":6,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":0.79700000000000004,"15min":0.622},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":18.463000000000001,"5min":18.463000000000001,"15min":18.463000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.621,"15min":0.63},"min":{"1min":0.35499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0469999999999999,"5min":5.0860000000000003,"15min":9.4550000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.74299999999999999,"15min":0.63200000000000001},"min":{"1min":0.38500000000000001,"5min":0.34899999999999998,"15min":0.28000000000000003},"max":{"1min":9.4320000000000004,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.751},{"interface":"front","average":{"1min":1.6120000000000001,"5min":0.88700000000000001,"15min":0.71899999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.315},"max":{"1min":18.5,"5min":18.5,"15min":18.5},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575179,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544972,"kb_used_data":98884,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826868,"statfs":{"total":96636764160,"available":96078712832,"internally_reserved":0,"allocated":101257216,"data_stored":101075772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.54900000000000004,"15min":0.48699999999999999},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.17899999999999999},"max":{"1min":1.4299999999999999,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.66100000000000003,"15min":0.623},"min":{"1min":0.26500000000000001,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":1.276,"5min":9.2059999999999995,"15min":24.800000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.66000000000000003,"15min":0.626},"min":{"1min":0.222,"5min":0.218,"15min":0.215},"max":{"1min":2.2000000000000002,"5min":15.426,"15min":27.719000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.63300000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":1.9219999999999999,"5min":7.1399999999999997,"15min":24.826000000000001},"last":0.69999999999999996}]},{"osd":2,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.65100000000000002,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.254,"15min":0.24099999999999999},"max":{"1min":5.9130000000000003,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.629,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.28699999999999998,"15min":0.24199999999999999},"max":{"1min":1.4590000000000001,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.57599999999999996}]},{"osd":3,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75700000000000001,"15min":0.69399999999999995},"min":{"1min":0.308,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":4.8780000000000001,"5min":6.6559999999999997,"15min":24.606000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.73199999999999998,"15min":0.61799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.253},"max":{"1min":3.165,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.66000000000000003}]},{"osd":4,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.62,"15min":0.81599999999999995},"min":{"1min":0.27000000000000002,"5min":0.248,"15min":0.22600000000000001},"max":{"1min":2.5409999999999999,"5min":10.319000000000001,"15min":71.634},"last":0.439},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.79500000000000004,"15min":1.004},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":2.8380000000000001,"5min":10.032,"15min":101.794},"last":0.51500000000000001}]},{"osd":6,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.745,"15min":0.623},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.254},"max":{"1min":1.4730000000000001,"5min":14.997,"15min":14.997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.81200000000000006,"15min":0.72999999999999998},"min":{"1min":0.34899999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":2.3999999999999999,"5min":19.137,"15min":28.053999999999998},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.5660000000000001,"15min":1.024},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.30499999999999999},"max":{"1min":1.399,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.577,"15min":1.006},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.31},"max":{"1min":2.4910000000000001,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82739200,"data_stored":82727906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100966400,"data_stored":100957360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:22:05.237 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.237 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.237 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.237 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.237 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.237 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.238 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.238 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.238 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.238 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.238 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.238 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.238 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:54:59.597060+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=54, tm_sec=59, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.239 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.239 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.239 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.239 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.239 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.239 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.239 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.240 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.240 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.240 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.240 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.240 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.240 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.241 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:05.241 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:22:25.242 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:22:25.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.375+0000 7fa138bed700 1 Processor -- start 2024-05-08T21:22:25.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.375+0000 7fa138bed700 1 -- start start 2024-05-08T21:22:25.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.376+0000 7fa138bed700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa1341535a0 0x7fa13406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:25.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.376+0000 7fa138bed700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1340cbf50 0x7fa13406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:25.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.376+0000 7fa138bed700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13415c990 con 0x7fa134072ae0 2024-05-08T21:22:25.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.376+0000 7fa138bed700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13415cbc0 con 0x7fa1340cbf50 2024-05-08T21:22:25.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.376+0000 7fa138bed700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13415ce60 con 0x7fa1341535a0 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa131d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa1340cbf50 0x7fa13406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa132d9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fa134072ae0 0x7fa1340c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:41486/0 (socket says 172.21.15.135:41486) 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa132d9d700 1 -- 172.21.15.135:0/4213146634 learned_addr learned my addr 172.21.15.135:0/4213146634 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa13259c700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa1341535a0 0x7fa13406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa131d9b700 1 -- 172.21.15.135:0/4213146634 >> v2:172.21.15.183:3300/0 conn(0x7fa1341535a0 msgr2=0x7fa13406a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa131d9b700 1 --2- 172.21.15.135:0/4213146634 >> v2:172.21.15.183:3300/0 conn(0x7fa1341535a0 0x7fa13406a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa131d9b700 1 -- 172.21.15.135:0/4213146634 >> v1:172.21.15.135:6789/0 conn(0x7fa134072ae0 legacy=0x7fa1340c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa131d9b700 1 -- 172.21.15.135:0/4213146634 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13415d140 con 0x7fa1340cbf50 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa13159a700 1 -- 172.21.15.135:0/4213146634 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921433226 0 0) 0x7fa13415c990 con 0x7fa134072ae0 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa131d9b700 1 --2- 172.21.15.135:0/4213146634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa13406aea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa1340cca20 tx=0x7fa128009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9ee93a4d4bcc2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:25.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa13159a700 1 -- 172.21.15.135:0/4213146634 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011830 con 0x7fa1340cbf50 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa13159a700 1 -- 172.21.15.135:0/4213146634 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128011990 con 0x7fa1340cbf50 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.377+0000 7fa13159a700 1 -- 172.21.15.135:0/4213146634 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128011d20 con 0x7fa1340cbf50 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 -- 172.21.15.135:0/4213146634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 msgr2=0x7fa13406aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 --2- 172.21.15.135:0/4213146634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa13406aea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa1340cca20 tx=0x7fa128009b20 comp rx=0 tx=0).stop 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 -- 172.21.15.135:0/4213146634 shutdown_connections 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 --2- 172.21.15.135:0/4213146634 >> v2:172.21.15.183:3300/0 conn(0x7fa1341535a0 0x7fa13406a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 --2- 172.21.15.135:0/4213146634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa13406aea0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 -- 172.21.15.135:0/4213146634 >> 172.21.15.135:0/4213146634 conn(0x7fa13406daf0 msgr2=0x7fa13406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 -- 172.21.15.135:0/4213146634 shutdown_connections 2024-05-08T21:22:25.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.378+0000 7fa138bed700 1 -- 172.21.15.135:0/4213146634 wait complete. 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.379+0000 7fa138bed700 1 Processor -- start 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.379+0000 7fa138bed700 1 -- start start 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa138bed700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa134072ae0 0x7fa134150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa138bed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa134153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa138bed700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1341535a0 0x7fa134154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa138bed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa134150560 con 0x7fa1340cbf50 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa138bed700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1341e5cb0 con 0x7fa1341535a0 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa138bed700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa134150e30 con 0x7fa134072ae0 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa134153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa134153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59086/0 (socket says 172.21.15.135:59086) 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 -- 172.21.15.135:0/2802160801 learned_addr learned my addr 172.21.15.135:0/2802160801 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:25.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa13259c700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa134072ae0 0x7fa134150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa132d9d700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1341535a0 0x7fa134154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 -- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa134072ae0 msgr2=0x7fa134150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa134072ae0 0x7fa134150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 -- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1341535a0 msgr2=0x7fa134154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1341535a0 0x7fa134154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 -- 172.21.15.135:0/2802160801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280094a0 con 0x7fa1340cbf50 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa132d9d700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1341535a0 0x7fa134154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.380+0000 7fa131d9b700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa134153e00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa13406d230 tx=0x7fa128004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.381+0000 7fa122ffd700 1 -- 172.21.15.135:0/2802160801 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280038a0 con 0x7fa1340cbf50 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.381+0000 7fa122ffd700 1 -- 172.21.15.135:0/2802160801 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12801f070 con 0x7fa1340cbf50 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.381+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1340c8910 con 0x7fa1340cbf50 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.381+0000 7fa122ffd700 1 -- 172.21.15.135:0/2802160801 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128003c20 con 0x7fa1340cbf50 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.381+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1341ef640 con 0x7fa1340cbf50 2024-05-08T21:22:25.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.382+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1340c33c0 con 0x7fa1340cbf50 2024-05-08T21:22:25.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.382+0000 7fa122ffd700 1 -- 172.21.15.135:0/2802160801 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa12801a430 con 0x7fa1340cbf50 2024-05-08T21:22:25.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.382+0000 7fa122ffd700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa11406ac90 0x7fa11406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:25.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.383+0000 7fa13259c700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa11406ac90 0x7fa11406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:25.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.383+0000 7fa122ffd700 1 -- 172.21.15.135:0/2802160801 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa128021070 con 0x7fa1340cbf50 2024-05-08T21:22:25.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.383+0000 7fa13259c700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa11406ac90 0x7fa11406d150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa124009ad0 tx=0x7fa124008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:25.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.387+0000 7fa122ffd700 1 -- 172.21.15.135:0/2802160801 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa128055e00 con 0x7fa1340cbf50 2024-05-08T21:22:25.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.579+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa134153980 con 0x7fa11406ac90 2024-05-08T21:22:25.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.589+0000 7fa122ffd700 1 -- 172.21.15.135:0/2802160801 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+374056 (secure 0 0 0) 0x7fa124011750 con 0x7fa11406ac90 2024-05-08T21:22:25.595 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:22:25.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa11406ac90 msgr2=0x7fa11406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:25.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa11406ac90 0x7fa11406d150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa124009ad0 tx=0x7fa124008040 comp rx=0 tx=0).stop 2024-05-08T21:22:25.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 msgr2=0x7fa134153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:25.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa134153e00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa13406d230 tx=0x7fa128004750 comp rx=0 tx=0).stop 2024-05-08T21:22:25.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 shutdown_connections 2024-05-08T21:22:25.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa11406ac90 0x7fa11406d150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1341535a0 0x7fa134154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa134072ae0 0x7fa134150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 --2- 172.21.15.135:0/2802160801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1340cbf50 0x7fa134153e00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:25.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 >> 172.21.15.135:0/2802160801 conn(0x7fa13406daf0 msgr2=0x7fa1340c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:25.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 shutdown_connections 2024-05-08T21:22:25.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:25.593+0000 7fa138bed700 1 -- 172.21.15.135:0/2802160801 wait complete. 2024-05-08T21:22:25.599 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:22:25.606 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":849,"stamp":"2024-05-08T21:22:24.836499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244155444,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3047,"num_read_kb":7630,"num_write":179646,"num_write_kb":3998170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257560,"ondisk_log_size":257560,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3868776,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3389491,"kb_avail":751105944,"statfs":{"total":773094113280,"available":769132486656,"internally_reserved":0,"allocated":490708992,"data_stored":489258184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3470839353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003586"},"pg_stats":[{"pgid":"3.3f","version":"27'774","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:12.425025+0000","last_change":"2024-05-08T21:22:12.425159+0000","last_active":"2024-05-08T21:22:12.425025+0000","last_peered":"2024-05-08T21:22:12.425025+0000","last_clean":"2024-05-08T21:22:12.425025+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:22:12.425025+0000","last_undegraded":"2024-05-08T21:22:12.425025+0000","last_fullsized":"2024-05-08T21:22:12.425025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'774","last_scrub_stamp":"2024-05-08T21:22:12.424995+0000","last_deep_scrub":"27'774","last_deep_scrub_stamp":"2024-05-08T21:22:12.424995+0000","last_clean_scrub_stamp":"2024-05-08T21:22:12.424995+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:11.385722+0000","scrub_duration":0.0096575919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'772","reported_seq":812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:49.932891+0000","last_change":"2024-05-08T21:21:49.932891+0000","last_active":"2024-05-08T21:21:49.932891+0000","last_peered":"2024-05-08T21:21:49.932891+0000","last_clean":"2024-05-08T21:21:49.932891+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:49.932891+0000","last_undegraded":"2024-05-08T21:21:49.932891+0000","last_fullsized":"2024-05-08T21:21:49.932891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'772","last_scrub_stamp":"2024-05-08T21:21:49.932752+0000","last_deep_scrub":"27'772","last_deep_scrub_stamp":"2024-05-08T21:21:49.932752+0000","last_clean_scrub_stamp":"2024-05-08T21:21:49.932752+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:13.196819+0000","scrub_duration":0.0068780669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'862","reported_seq":903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.036948+0000","last_change":"2024-05-08T21:21:30.036948+0000","last_active":"2024-05-08T21:21:30.036948+0000","last_peered":"2024-05-08T21:21:30.036948+0000","last_clean":"2024-05-08T21:21:30.036948+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:30.036948+0000","last_undegraded":"2024-05-08T21:21:30.036948+0000","last_fullsized":"2024-05-08T21:21:30.036948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'862","last_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_deep_scrub":"27'862","last_deep_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.036832+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:55.453142+0000","scrub_duration":0.0074728939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'823","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.751890+0000","last_change":"2024-05-08T21:21:27.751988+0000","last_active":"2024-05-08T21:21:27.751890+0000","last_peered":"2024-05-08T21:21:27.751890+0000","last_clean":"2024-05-08T21:21:27.751890+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:27.751890+0000","last_undegraded":"2024-05-08T21:21:27.751890+0000","last_fullsized":"2024-05-08T21:21:27.751890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'823","last_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_deep_scrub":"27'823","last_deep_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.751862+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.537249+0000","scrub_duration":0.0019687749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'860","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:02.419054+0000","last_change":"2024-05-08T21:22:02.419182+0000","last_active":"2024-05-08T21:22:02.419054+0000","last_peered":"2024-05-08T21:22:02.419054+0000","last_clean":"2024-05-08T21:22:02.419054+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:22:02.419054+0000","last_undegraded":"2024-05-08T21:22:02.419054+0000","last_fullsized":"2024-05-08T21:22:02.419054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'860","last_scrub_stamp":"2024-05-08T21:22:02.419027+0000","last_deep_scrub":"27'860","last_deep_scrub_stamp":"2024-05-08T21:22:02.419027+0000","last_clean_scrub_stamp":"2024-05-08T21:22:02.419027+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:11.298342+0000","scrub_duration":0.011455531999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'767","reported_seq":804,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:02.881567+0000","last_change":"2024-05-08T21:22:02.881692+0000","last_active":"2024-05-08T21:22:02.881567+0000","last_peered":"2024-05-08T21:22:02.881567+0000","last_clean":"2024-05-08T21:22:02.881567+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:22:02.881567+0000","last_undegraded":"2024-05-08T21:22:02.881567+0000","last_fullsized":"2024-05-08T21:22:02.881567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'767","last_scrub_stamp":"2024-05-08T21:22:02.881541+0000","last_deep_scrub":"27'767","last_deep_scrub_stamp":"2024-05-08T21:22:02.881541+0000","last_clean_scrub_stamp":"2024-05-08T21:22:02.881541+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:15.993754+0000","scrub_duration":0.0037850589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'811","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.339467+0000","last_change":"2024-05-08T21:21:57.339570+0000","last_active":"2024-05-08T21:21:57.339467+0000","last_peered":"2024-05-08T21:21:57.339467+0000","last_clean":"2024-05-08T21:21:57.339467+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:57.339467+0000","last_undegraded":"2024-05-08T21:21:57.339467+0000","last_fullsized":"2024-05-08T21:21:57.339467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'811","last_scrub_stamp":"2024-05-08T21:21:57.339438+0000","last_deep_scrub":"27'811","last_deep_scrub_stamp":"2024-05-08T21:21:57.339438+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.339438+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:55.528420+0000","scrub_duration":0.0020686020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'788","reported_seq":826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:53.904218+0000","last_change":"2024-05-08T21:21:53.904335+0000","last_active":"2024-05-08T21:21:53.904218+0000","last_peered":"2024-05-08T21:21:53.904218+0000","last_clean":"2024-05-08T21:21:53.904218+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:53.904218+0000","last_undegraded":"2024-05-08T21:21:53.904218+0000","last_fullsized":"2024-05-08T21:21:53.904218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'788","last_scrub_stamp":"2024-05-08T21:21:53.904193+0000","last_deep_scrub":"27'788","last_deep_scrub_stamp":"2024-05-08T21:21:53.904193+0000","last_clean_scrub_stamp":"2024-05-08T21:21:53.904193+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:49.742590+0000","scrub_duration":0.0021721689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'846","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:09.421915+0000","last_change":"2024-05-08T21:22:09.422021+0000","last_active":"2024-05-08T21:22:09.421915+0000","last_peered":"2024-05-08T21:22:09.421915+0000","last_clean":"2024-05-08T21:22:09.421915+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:22:09.421915+0000","last_undegraded":"2024-05-08T21:22:09.421915+0000","last_fullsized":"2024-05-08T21:22:09.421915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'846","last_scrub_stamp":"2024-05-08T21:22:09.421887+0000","last_deep_scrub":"27'846","last_deep_scrub_stamp":"2024-05-08T21:22:09.421887+0000","last_clean_scrub_stamp":"2024-05-08T21:22:09.421887+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:46.494698+0000","scrub_duration":0.0057582989999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'809","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:54.921077+0000","last_change":"2024-05-08T21:21:54.921177+0000","last_active":"2024-05-08T21:21:54.921077+0000","last_peered":"2024-05-08T21:21:54.921077+0000","last_clean":"2024-05-08T21:21:54.921077+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:54.921077+0000","last_undegraded":"2024-05-08T21:21:54.921077+0000","last_fullsized":"2024-05-08T21:21:54.921077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:54.921049+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:54.921049+0000","last_clean_scrub_stamp":"2024-05-08T21:21:54.921049+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:03.800363+0000","scrub_duration":0.0031844239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'819","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.996816+0000","last_change":"2024-05-08T21:21:42.996970+0000","last_active":"2024-05-08T21:21:42.996816+0000","last_peered":"2024-05-08T21:21:42.996816+0000","last_clean":"2024-05-08T21:21:42.996816+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:42.996816+0000","last_undegraded":"2024-05-08T21:21:42.996816+0000","last_fullsized":"2024-05-08T21:21:42.996816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:42.996772+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:42.996772+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.996772+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:06.260839+0000","scrub_duration":0.0065513519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'794","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.413622+0000","last_change":"2024-05-08T21:21:45.413781+0000","last_active":"2024-05-08T21:21:45.413622+0000","last_peered":"2024-05-08T21:21:45.413622+0000","last_clean":"2024-05-08T21:21:45.413622+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:45.413622+0000","last_undegraded":"2024-05-08T21:21:45.413622+0000","last_fullsized":"2024-05-08T21:21:45.413622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'794","last_scrub_stamp":"2024-05-08T21:21:45.413576+0000","last_deep_scrub":"27'794","last_deep_scrub_stamp":"2024-05-08T21:21:45.413576+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.413576+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:40.286412+0000","scrub_duration":0.0018887540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'813","reported_seq":852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.863029+0000","last_change":"2024-05-08T21:21:25.863029+0000","last_active":"2024-05-08T21:21:25.863029+0000","last_peered":"2024-05-08T21:21:25.863029+0000","last_clean":"2024-05-08T21:21:25.863029+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:25.863029+0000","last_undegraded":"2024-05-08T21:21:25.863029+0000","last_fullsized":"2024-05-08T21:21:25.863029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'813","last_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_deep_scrub":"27'813","last_deep_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.862894+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:16.467912+0000","scrub_duration":0.0075367910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'802","reported_seq":841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.062238+0000","last_change":"2024-05-08T21:21:42.062360+0000","last_active":"2024-05-08T21:21:42.062238+0000","last_peered":"2024-05-08T21:21:42.062238+0000","last_clean":"2024-05-08T21:21:42.062238+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:42.062238+0000","last_undegraded":"2024-05-08T21:21:42.062238+0000","last_fullsized":"2024-05-08T21:21:42.062238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'802","last_scrub_stamp":"2024-05-08T21:21:42.062211+0000","last_deep_scrub":"27'802","last_deep_scrub_stamp":"2024-05-08T21:21:42.062211+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.062211+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:36.935046+0000","scrub_duration":0.0040292820000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'853","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:53.855569+0000","last_change":"2024-05-08T21:21:53.855702+0000","last_active":"2024-05-08T21:21:53.855569+0000","last_peered":"2024-05-08T21:21:53.855569+0000","last_clean":"2024-05-08T21:21:53.855569+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:53.855569+0000","last_undegraded":"2024-05-08T21:21:53.855569+0000","last_fullsized":"2024-05-08T21:21:53.855569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'853","last_scrub_stamp":"2024-05-08T21:21:53.855539+0000","last_deep_scrub":"27'853","last_deep_scrub_stamp":"2024-05-08T21:21:53.855539+0000","last_clean_scrub_stamp":"2024-05-08T21:21:53.855539+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:10.074609+0000","scrub_duration":0.0073019199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'809","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.736377+0000","last_change":"2024-05-08T21:21:25.736503+0000","last_active":"2024-05-08T21:21:25.736377+0000","last_peered":"2024-05-08T21:21:25.736377+0000","last_clean":"2024-05-08T21:21:25.736377+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:25.736377+0000","last_undegraded":"2024-05-08T21:21:25.736377+0000","last_fullsized":"2024-05-08T21:21:25.736377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.736348+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:53.810852+0000","scrub_duration":0.00189824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'870","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:48.736103+0000","last_change":"2024-05-08T21:21:48.736241+0000","last_active":"2024-05-08T21:21:48.736103+0000","last_peered":"2024-05-08T21:21:48.736103+0000","last_clean":"2024-05-08T21:21:48.736103+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:48.736103+0000","last_undegraded":"2024-05-08T21:21:48.736103+0000","last_fullsized":"2024-05-08T21:21:48.736103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'870","last_scrub_stamp":"2024-05-08T21:21:48.736071+0000","last_deep_scrub":"27'870","last_deep_scrub_stamp":"2024-05-08T21:21:48.736071+0000","last_clean_scrub_stamp":"2024-05-08T21:21:48.736071+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:35.037429+0000","scrub_duration":0.0071336680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'789","reported_seq":828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.635345+0000","last_change":"2024-05-08T21:21:29.635458+0000","last_active":"2024-05-08T21:21:29.635345+0000","last_peered":"2024-05-08T21:21:29.635345+0000","last_clean":"2024-05-08T21:21:29.635345+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:29.635345+0000","last_undegraded":"2024-05-08T21:21:29.635345+0000","last_fullsized":"2024-05-08T21:21:29.635345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'789","last_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_deep_scrub":"27'789","last_deep_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.635318+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:25.420704+0000","scrub_duration":0.002176664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:14.456425+0000","last_change":"2024-05-08T21:22:14.456521+0000","last_active":"2024-05-08T21:22:14.456425+0000","last_peered":"2024-05-08T21:22:14.456425+0000","last_clean":"2024-05-08T21:22:14.456425+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:22:14.456425+0000","last_undegraded":"2024-05-08T21:22:14.456425+0000","last_fullsized":"2024-05-08T21:22:14.456425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:22:14.456399+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:22:14.456399+0000","last_clean_scrub_stamp":"2024-05-08T21:22:14.456399+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:38.319500+0000","scrub_duration":0.0072349060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:11.066250+0000","last_change":"2024-05-08T21:22:11.066409+0000","last_active":"2024-05-08T21:22:11.066250+0000","last_peered":"2024-05-08T21:22:11.066250+0000","last_clean":"2024-05-08T21:22:11.066250+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:22:11.066250+0000","last_undegraded":"2024-05-08T21:22:11.066250+0000","last_fullsized":"2024-05-08T21:22:11.066250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3785","last_scrub_stamp":"2024-05-08T21:22:11.066225+0000","last_deep_scrub":"27'3785","last_deep_scrub_stamp":"2024-05-08T21:22:11.066225+0000","last_clean_scrub_stamp":"2024-05-08T21:22:11.066225+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:15.583450+0000","scrub_duration":0.019995764999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1871","reported_seq":1913,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.072592+0000","last_change":"2024-05-08T21:21:22.072592+0000","last_active":"2024-05-08T21:21:22.072592+0000","last_peered":"2024-05-08T21:21:22.072592+0000","last_clean":"2024-05-08T21:21:22.072592+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:22.072592+0000","last_undegraded":"2024-05-08T21:21:22.072592+0000","last_fullsized":"2024-05-08T21:21:22.072592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1871","last_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_deep_scrub":"27'1871","last_deep_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.072441+0000","objects_scrubbed":3,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:17.857827+0000","scrub_duration":0.015741767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'809","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.904062+0000","last_change":"2024-05-08T21:21:27.904160+0000","last_active":"2024-05-08T21:21:27.904062+0000","last_peered":"2024-05-08T21:21:27.904062+0000","last_clean":"2024-05-08T21:21:27.904062+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:27.904062+0000","last_undegraded":"2024-05-08T21:21:27.904062+0000","last_fullsized":"2024-05-08T21:21:27.904062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.904035+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.689421+0000","scrub_duration":0.0050121590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3732,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:54.480851+0000","last_change":"2024-05-08T21:21:54.481012+0000","last_active":"2024-05-08T21:21:54.480851+0000","last_peered":"2024-05-08T21:21:54.480851+0000","last_clean":"2024-05-08T21:21:54.480851+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:54.480851+0000","last_undegraded":"2024-05-08T21:21:54.480851+0000","last_fullsized":"2024-05-08T21:21:54.480851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3695","last_scrub_stamp":"2024-05-08T21:21:54.480824+0000","last_deep_scrub":"27'3695","last_deep_scrub_stamp":"2024-05-08T21:21:54.480824+0000","last_clean_scrub_stamp":"2024-05-08T21:21:54.480824+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:10.699893+0000","scrub_duration":0.014220731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4026","reported_seq":4068,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.919821+0000","last_change":"2024-05-08T21:21:28.919926+0000","last_active":"2024-05-08T21:21:28.919821+0000","last_peered":"2024-05-08T21:21:28.919821+0000","last_clean":"2024-05-08T21:21:28.919821+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:28.919821+0000","last_undegraded":"2024-05-08T21:21:28.919821+0000","last_fullsized":"2024-05-08T21:21:28.919821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4026","last_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_deep_scrub":"27'4026","last_deep_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.919793+0000","objects_scrubbed":1,"log_size":4026,"log_dups_size":0,"ondisk_log_size":4026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.835728+0000","scrub_duration":0.016721056000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'779","reported_seq":820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.014532+0000","last_change":"2024-05-08T21:21:47.014532+0000","last_active":"2024-05-08T21:21:47.014532+0000","last_peered":"2024-05-08T21:21:47.014532+0000","last_clean":"2024-05-08T21:21:47.014532+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:47.014532+0000","last_undegraded":"2024-05-08T21:21:47.014532+0000","last_fullsized":"2024-05-08T21:21:47.014532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-05-08T21:21:47.014362+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-05-08T21:21:47.014362+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.014362+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:42.852759+0000","scrub_duration":0.0082407149999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3657,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.912070+0000","last_change":"2024-05-08T20:55:04.109976+0000","last_active":"2024-05-08T21:21:06.912070+0000","last_peered":"2024-05-08T21:21:06.912070+0000","last_clean":"2024-05-08T21:21:06.912070+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:21:06.912070+0000","last_undegraded":"2024-05-08T21:21:06.912070+0000","last_fullsized":"2024-05-08T21:21:06.912070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4865","reported_seq":4904,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.241416+0000","last_change":"2024-05-08T21:21:50.241523+0000","last_active":"2024-05-08T21:21:50.241416+0000","last_peered":"2024-05-08T21:21:50.241416+0000","last_clean":"2024-05-08T21:21:50.241416+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:50.241416+0000","last_undegraded":"2024-05-08T21:21:50.241416+0000","last_fullsized":"2024-05-08T21:21:50.241416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4865","last_scrub_stamp":"2024-05-08T21:21:50.241390+0000","last_deep_scrub":"27'4865","last_deep_scrub_stamp":"2024-05-08T21:21:50.241390+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.241390+0000","objects_scrubbed":3,"log_size":4865,"log_dups_size":0,"ondisk_log_size":4865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:25.583510+0000","scrub_duration":0.029835649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'861","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:10.934057+0000","last_change":"2024-05-08T21:22:10.934168+0000","last_active":"2024-05-08T21:22:10.934057+0000","last_peered":"2024-05-08T21:22:10.934057+0000","last_clean":"2024-05-08T21:22:10.934057+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:22:10.934057+0000","last_undegraded":"2024-05-08T21:22:10.934057+0000","last_fullsized":"2024-05-08T21:22:10.934057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'861","last_scrub_stamp":"2024-05-08T21:22:10.934028+0000","last_deep_scrub":"27'861","last_deep_scrub_stamp":"2024-05-08T21:22:10.934028+0000","last_clean_scrub_stamp":"2024-05-08T21:22:10.934028+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:48.006838+0000","scrub_duration":0.0016026289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:56.503468+0000","last_change":"2024-05-08T21:21:56.503623+0000","last_active":"2024-05-08T21:21:56.503468+0000","last_peered":"2024-05-08T21:21:56.503468+0000","last_clean":"2024-05-08T21:21:56.503468+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:56.503468+0000","last_undegraded":"2024-05-08T21:21:56.503468+0000","last_fullsized":"2024-05-08T21:21:56.503468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3447","last_scrub_stamp":"2024-05-08T21:21:56.503441+0000","last_deep_scrub":"27'3447","last_deep_scrub_stamp":"2024-05-08T21:21:56.503441+0000","last_clean_scrub_stamp":"2024-05-08T21:21:56.503441+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:54.692423+0000","scrub_duration":0.016081088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1177","reported_seq":1216,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.088816+0000","last_change":"2024-05-08T21:21:44.088912+0000","last_active":"2024-05-08T21:21:44.088816+0000","last_peered":"2024-05-08T21:21:44.088816+0000","last_clean":"2024-05-08T21:21:44.088816+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:44.088816+0000","last_undegraded":"2024-05-08T21:21:44.088816+0000","last_fullsized":"2024-05-08T21:21:44.088816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1177","last_scrub_stamp":"2024-05-08T21:21:44.088787+0000","last_deep_scrub":"27'1177","last_deep_scrub_stamp":"2024-05-08T21:21:44.088787+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.088787+0000","objects_scrubbed":2,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:23.965184+0000","scrub_duration":0.014020988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'834","reported_seq":871,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:08.946981+0000","last_change":"2024-05-08T21:22:08.947082+0000","last_active":"2024-05-08T21:22:08.946981+0000","last_peered":"2024-05-08T21:22:08.946981+0000","last_clean":"2024-05-08T21:22:08.946981+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:22:08.946981+0000","last_undegraded":"2024-05-08T21:22:08.946981+0000","last_fullsized":"2024-05-08T21:22:08.946981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'834","last_scrub_stamp":"2024-05-08T21:22:08.946954+0000","last_deep_scrub":"27'834","last_deep_scrub_stamp":"2024-05-08T21:22:08.946954+0000","last_clean_scrub_stamp":"2024-05-08T21:22:08.946954+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:21.578076+0000","scrub_duration":0.0035358989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3586,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:12.099526+0000","last_change":"2024-05-08T21:22:12.099689+0000","last_active":"2024-05-08T21:22:12.099526+0000","last_peered":"2024-05-08T21:22:12.099526+0000","last_clean":"2024-05-08T21:22:12.099526+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:22:12.099526+0000","last_undegraded":"2024-05-08T21:22:12.099526+0000","last_fullsized":"2024-05-08T21:22:12.099526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3550","last_scrub_stamp":"2024-05-08T21:22:12.099498+0000","last_deep_scrub":"27'3550","last_deep_scrub_stamp":"2024-05-08T21:22:12.099498+0000","last_clean_scrub_stamp":"2024-05-08T21:22:12.099498+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:11.060224+0000","scrub_duration":0.018093129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2317","reported_seq":2356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.926492+0000","last_change":"2024-05-08T21:21:29.926575+0000","last_active":"2024-05-08T21:21:29.926492+0000","last_peered":"2024-05-08T21:21:29.926492+0000","last_clean":"2024-05-08T21:21:29.926492+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:29.926492+0000","last_undegraded":"2024-05-08T21:21:29.926492+0000","last_fullsized":"2024-05-08T21:21:29.926492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2317","last_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_deep_scrub":"27'2317","last_deep_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.926468+0000","objects_scrubbed":2,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.064661+0000","scrub_duration":0.024143202999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'829","reported_seq":867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.066384+0000","last_change":"2024-05-08T21:21:31.066489+0000","last_active":"2024-05-08T21:21:31.066384+0000","last_peered":"2024-05-08T21:21:31.066384+0000","last_clean":"2024-05-08T21:21:31.066384+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:31.066384+0000","last_undegraded":"2024-05-08T21:21:31.066384+0000","last_fullsized":"2024-05-08T21:21:31.066384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'829","last_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_deep_scrub":"27'829","last_deep_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.066360+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:42.055961+0000","scrub_duration":0.0042842599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3570,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.608319+0000","last_change":"2024-05-08T21:21:30.608460+0000","last_active":"2024-05-08T21:21:30.608319+0000","last_peered":"2024-05-08T21:21:30.608319+0000","last_clean":"2024-05-08T21:21:30.608319+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:30.608319+0000","last_undegraded":"2024-05-08T21:21:30.608319+0000","last_fullsized":"2024-05-08T21:21:30.608319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3534","last_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_deep_scrub":"27'3534","last_deep_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.608289+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:43.524223+0000","scrub_duration":0.017888930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4378","reported_seq":4416,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.988161+0000","last_change":"2024-05-08T21:21:24.988284+0000","last_active":"2024-05-08T21:21:24.988161+0000","last_peered":"2024-05-08T21:21:24.988161+0000","last_clean":"2024-05-08T21:21:24.988161+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:24.988161+0000","last_undegraded":"2024-05-08T21:21:24.988161+0000","last_fullsized":"2024-05-08T21:21:24.988161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4378","last_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_deep_scrub":"27'4378","last_deep_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.988136+0000","objects_scrubbed":2,"log_size":4378,"log_dups_size":0,"ondisk_log_size":4378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:35.977737+0000","scrub_duration":0.026713068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'818","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.076134+0000","last_change":"2024-05-08T21:21:29.076253+0000","last_active":"2024-05-08T21:21:29.076134+0000","last_peered":"2024-05-08T21:21:29.076134+0000","last_clean":"2024-05-08T21:21:29.076134+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:29.076134+0000","last_undegraded":"2024-05-08T21:21:29.076134+0000","last_fullsized":"2024-05-08T21:21:29.076134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.076108+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:53.637005+0000","scrub_duration":0.0043393650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3648,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:19.559046+0000","last_change":"2024-05-08T21:22:19.559221+0000","last_active":"2024-05-08T21:22:19.559046+0000","last_peered":"2024-05-08T21:22:19.559046+0000","last_clean":"2024-05-08T21:22:19.559046+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:22:19.559046+0000","last_undegraded":"2024-05-08T21:22:19.559046+0000","last_fullsized":"2024-05-08T21:22:19.559046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3609","last_scrub_stamp":"2024-05-08T21:22:19.559020+0000","last_deep_scrub":"27'3609","last_deep_scrub_stamp":"2024-05-08T21:22:19.559020+0000","last_clean_scrub_stamp":"2024-05-08T21:22:19.559020+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:06.960639+0000","scrub_duration":0.014314807000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1717","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.960412+0000","last_change":"2024-05-08T21:21:30.960412+0000","last_active":"2024-05-08T21:21:30.960412+0000","last_peered":"2024-05-08T21:21:30.960412+0000","last_clean":"2024-05-08T21:21:30.960412+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:30.960412+0000","last_undegraded":"2024-05-08T21:21:30.960412+0000","last_fullsized":"2024-05-08T21:21:30.960412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1717","last_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_deep_scrub":"27'1717","last_deep_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.960286+0000","objects_scrubbed":2,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.942541+0000","scrub_duration":0.026136829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'881","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.980335+0000","last_change":"2024-05-08T21:21:32.980335+0000","last_active":"2024-05-08T21:21:32.980335+0000","last_peered":"2024-05-08T21:21:32.980335+0000","last_clean":"2024-05-08T21:21:32.980335+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:32.980335+0000","last_undegraded":"2024-05-08T21:21:32.980335+0000","last_fullsized":"2024-05-08T21:21:32.980335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'881","last_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_deep_scrub":"27'881","last_deep_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.980155+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:57.541052+0000","scrub_duration":0.0015580380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3588,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.043015+0000","last_change":"2024-05-08T21:21:57.043200+0000","last_active":"2024-05-08T21:21:57.043015+0000","last_peered":"2024-05-08T21:21:57.043015+0000","last_clean":"2024-05-08T21:21:57.043015+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:57.043015+0000","last_undegraded":"2024-05-08T21:21:57.043015+0000","last_fullsized":"2024-05-08T21:21:57.043015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3549","last_scrub_stamp":"2024-05-08T21:21:57.042969+0000","last_deep_scrub":"27'3549","last_deep_scrub_stamp":"2024-05-08T21:21:57.042969+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.042969+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:10.155182+0000","scrub_duration":0.011593343000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5273","reported_seq":5312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.857565+0000","last_change":"2024-05-08T21:21:29.857565+0000","last_active":"2024-05-08T21:21:29.857565+0000","last_peered":"2024-05-08T21:21:29.857565+0000","last_clean":"2024-05-08T21:21:29.857565+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:21:29.857565+0000","last_undegraded":"2024-05-08T21:21:29.857565+0000","last_fullsized":"2024-05-08T21:21:29.857565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5273","last_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_deep_scrub":"27'5273","last_deep_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.857411+0000","objects_scrubbed":4,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:42.773346+0000","scrub_duration":0.054139549000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'827","reported_seq":865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:48.892457+0000","last_change":"2024-05-08T21:21:48.892570+0000","last_active":"2024-05-08T21:21:48.892457+0000","last_peered":"2024-05-08T21:21:48.892457+0000","last_clean":"2024-05-08T21:21:48.892457+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:48.892457+0000","last_undegraded":"2024-05-08T21:21:48.892457+0000","last_fullsized":"2024-05-08T21:21:48.892457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'827","last_scrub_stamp":"2024-05-08T21:21:48.892428+0000","last_deep_scrub":"27'827","last_deep_scrub_stamp":"2024-05-08T21:21:48.892428+0000","last_clean_scrub_stamp":"2024-05-08T21:21:48.892428+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:24.234549+0000","scrub_duration":0.0069871000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:09.013177+0000","last_change":"2024-05-08T21:22:09.013324+0000","last_active":"2024-05-08T21:22:09.013177+0000","last_peered":"2024-05-08T21:22:09.013177+0000","last_clean":"2024-05-08T21:22:09.013177+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:22:09.013177+0000","last_undegraded":"2024-05-08T21:22:09.013177+0000","last_fullsized":"2024-05-08T21:22:09.013177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3388","last_scrub_stamp":"2024-05-08T21:22:09.013152+0000","last_deep_scrub":"27'3388","last_deep_scrub_stamp":"2024-05-08T21:22:09.013152+0000","last_clean_scrub_stamp":"2024-05-08T21:22:09.013152+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:21.644273+0000","scrub_duration":0.014579356999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2694","reported_seq":3304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.008413+0000","last_change":"2024-05-08T21:21:40.008506+0000","last_active":"2024-05-08T21:21:40.008413+0000","last_peered":"2024-05-08T21:21:40.008413+0000","last_clean":"2024-05-08T21:21:40.008413+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:40.008413+0000","last_undegraded":"2024-05-08T21:21:40.008413+0000","last_fullsized":"2024-05-08T21:21:40.008413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2694","last_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_deep_scrub":"27'2694","last_deep_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.008388+0000","objects_scrubbed":5,"log_size":2694,"log_dups_size":0,"ondisk_log_size":2694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:26.309746+0000","scrub_duration":0.051681431999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1795,"num_write":2691,"num_write_kb":19159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'812","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.594810+0000","last_change":"2024-05-08T21:21:32.594810+0000","last_active":"2024-05-08T21:21:32.594810+0000","last_peered":"2024-05-08T21:21:32.594810+0000","last_clean":"2024-05-08T21:21:32.594810+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:32.594810+0000","last_undegraded":"2024-05-08T21:21:32.594810+0000","last_fullsized":"2024-05-08T21:21:32.594810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'812","last_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_deep_scrub":"27'812","last_deep_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.594677+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:45.576932+0000","scrub_duration":0.002123504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.067659+0000","last_change":"2024-05-08T21:21:59.067805+0000","last_active":"2024-05-08T21:21:59.067659+0000","last_peered":"2024-05-08T21:21:59.067659+0000","last_clean":"2024-05-08T21:21:59.067659+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:59.067659+0000","last_undegraded":"2024-05-08T21:21:59.067659+0000","last_fullsized":"2024-05-08T21:21:59.067659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3316","last_scrub_stamp":"2024-05-08T21:21:59.067632+0000","last_deep_scrub":"27'3316","last_deep_scrub_stamp":"2024-05-08T21:21:59.067632+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.067632+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:57.256614+0000","scrub_duration":0.014948201,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3355","reported_seq":3394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.765436+0000","last_change":"2024-05-08T21:21:31.765436+0000","last_active":"2024-05-08T21:21:31.765436+0000","last_peered":"2024-05-08T21:21:31.765436+0000","last_clean":"2024-05-08T21:21:31.765436+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:31.765436+0000","last_undegraded":"2024-05-08T21:21:31.765436+0000","last_fullsized":"2024-05-08T21:21:31.765436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3355","last_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_deep_scrub":"27'3355","last_deep_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.765305+0000","objects_scrubbed":1,"log_size":3355,"log_dups_size":0,"ondisk_log_size":3355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:44.747560+0000","scrub_duration":0.018616456999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'825","reported_seq":864,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:43.085998+0000","last_change":"2024-05-08T21:21:43.086103+0000","last_active":"2024-05-08T21:21:43.085998+0000","last_peered":"2024-05-08T21:21:43.085998+0000","last_clean":"2024-05-08T21:21:43.085998+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:43.085998+0000","last_undegraded":"2024-05-08T21:21:43.085998+0000","last_fullsized":"2024-05-08T21:21:43.085998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'825","last_scrub_stamp":"2024-05-08T21:21:43.085971+0000","last_deep_scrub":"27'825","last_deep_scrub_stamp":"2024-05-08T21:21:43.085971+0000","last_clean_scrub_stamp":"2024-05-08T21:21:43.085971+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:29.387329+0000","scrub_duration":0.0058775499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4052,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:00.549828+0000","last_change":"2024-05-08T21:22:00.549972+0000","last_active":"2024-05-08T21:22:00.549828+0000","last_peered":"2024-05-08T21:22:00.549828+0000","last_clean":"2024-05-08T21:22:00.549828+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:22:00.549828+0000","last_undegraded":"2024-05-08T21:22:00.549828+0000","last_fullsized":"2024-05-08T21:22:00.549828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4015","last_scrub_stamp":"2024-05-08T21:22:00.549799+0000","last_deep_scrub":"27'4015","last_deep_scrub_stamp":"2024-05-08T21:22:00.549799+0000","last_clean_scrub_stamp":"2024-05-08T21:22:00.549799+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:13.662012+0000","scrub_duration":0.013658672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4049","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.877466+0000","last_change":"2024-05-08T21:21:31.877466+0000","last_active":"2024-05-08T21:21:31.877466+0000","last_peered":"2024-05-08T21:21:31.877466+0000","last_clean":"2024-05-08T21:21:31.877466+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:31.877466+0000","last_undegraded":"2024-05-08T21:21:31.877466+0000","last_fullsized":"2024-05-08T21:21:31.877466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4049","last_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_deep_scrub":"27'4049","last_deep_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.877246+0000","objects_scrubbed":3,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:56.438144+0000","scrub_duration":0.021654677000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4056,"num_write_kb":23095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'833","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:33.106298+0000","last_change":"2024-05-08T21:21:33.106409+0000","last_active":"2024-05-08T21:21:33.106298+0000","last_peered":"2024-05-08T21:21:33.106298+0000","last_clean":"2024-05-08T21:21:33.106298+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:33.106298+0000","last_undegraded":"2024-05-08T21:21:33.106298+0000","last_fullsized":"2024-05-08T21:21:33.106298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'833","last_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_deep_scrub":"27'833","last_deep_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_clean_scrub_stamp":"2024-05-08T21:21:33.106270+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:21.028217+0000","scrub_duration":0.0015875640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3582,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:04.876242+0000","last_change":"2024-05-08T21:22:04.876392+0000","last_active":"2024-05-08T21:22:04.876242+0000","last_peered":"2024-05-08T21:22:04.876242+0000","last_clean":"2024-05-08T21:22:04.876242+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:22:04.876242+0000","last_undegraded":"2024-05-08T21:22:04.876242+0000","last_fullsized":"2024-05-08T21:22:04.876242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3545","last_scrub_stamp":"2024-05-08T21:22:04.876214+0000","last_deep_scrub":"27'3545","last_deep_scrub_stamp":"2024-05-08T21:22:04.876214+0000","last_clean_scrub_stamp":"2024-05-08T21:22:04.876214+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:17.507335+0000","scrub_duration":0.01515615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4551","reported_seq":4590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.984044+0000","last_change":"2024-05-08T21:21:26.984139+0000","last_active":"2024-05-08T21:21:26.984044+0000","last_peered":"2024-05-08T21:21:26.984044+0000","last_clean":"2024-05-08T21:21:26.984044+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:26.984044+0000","last_undegraded":"2024-05-08T21:21:26.984044+0000","last_fullsized":"2024-05-08T21:21:26.984044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4551","last_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_deep_scrub":"27'4551","last_deep_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.984019+0000","objects_scrubbed":5,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:14.905965+0000","scrub_duration":0.030483375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'805","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:07.421256+0000","last_change":"2024-05-08T21:22:07.421374+0000","last_active":"2024-05-08T21:22:07.421256+0000","last_peered":"2024-05-08T21:22:07.421256+0000","last_clean":"2024-05-08T21:22:07.421256+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:22:07.421256+0000","last_undegraded":"2024-05-08T21:22:07.421256+0000","last_fullsized":"2024-05-08T21:22:07.421256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'805","last_scrub_stamp":"2024-05-08T21:22:07.421212+0000","last_deep_scrub":"27'805","last_deep_scrub_stamp":"2024-05-08T21:22:07.421212+0000","last_clean_scrub_stamp":"2024-05-08T21:22:07.421212+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:20.052333+0000","scrub_duration":0.0030578810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:13.981400+0000","last_change":"2024-05-08T21:22:13.981580+0000","last_active":"2024-05-08T21:22:13.981400+0000","last_peered":"2024-05-08T21:22:13.981400+0000","last_clean":"2024-05-08T21:22:13.981400+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:22:13.981400+0000","last_undegraded":"2024-05-08T21:22:13.981400+0000","last_fullsized":"2024-05-08T21:22:13.981400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3282","last_scrub_stamp":"2024-05-08T21:22:13.981373+0000","last_deep_scrub":"27'3282","last_deep_scrub_stamp":"2024-05-08T21:22:13.981373+0000","last_clean_scrub_stamp":"2024-05-08T21:22:13.981373+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:12.942099+0000","scrub_duration":0.014392591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2511","reported_seq":2551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.046929+0000","last_change":"2024-05-08T21:21:21.047050+0000","last_active":"2024-05-08T21:21:21.046929+0000","last_peered":"2024-05-08T21:21:21.046929+0000","last_clean":"2024-05-08T21:21:21.046929+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:21.046929+0000","last_undegraded":"2024-05-08T21:21:21.046929+0000","last_fullsized":"2024-05-08T21:21:21.046929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2511","last_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_deep_scrub":"27'2511","last_deep_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.046889+0000","objects_scrubbed":3,"log_size":2511,"log_dups_size":0,"ondisk_log_size":2511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:40.172844+0000","scrub_duration":0.017442593999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'800","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.600144+0000","last_change":"2024-05-08T21:21:34.600251+0000","last_active":"2024-05-08T21:21:34.600144+0000","last_peered":"2024-05-08T21:21:34.600144+0000","last_clean":"2024-05-08T21:21:34.600144+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:34.600144+0000","last_undegraded":"2024-05-08T21:21:34.600144+0000","last_fullsized":"2024-05-08T21:21:34.600144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'800","last_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_deep_scrub":"27'800","last_deep_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.600116+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:59.161013+0000","scrub_duration":0.0021058320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:04.013981+0000","last_change":"2024-05-08T21:22:04.014126+0000","last_active":"2024-05-08T21:22:04.013981+0000","last_peered":"2024-05-08T21:22:04.013981+0000","last_clean":"2024-05-08T21:22:04.013981+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:22:04.013981+0000","last_undegraded":"2024-05-08T21:22:04.013981+0000","last_fullsized":"2024-05-08T21:22:04.013981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3402","last_scrub_stamp":"2024-05-08T21:22:04.013951+0000","last_deep_scrub":"27'3402","last_deep_scrub_stamp":"2024-05-08T21:22:04.013951+0000","last_clean_scrub_stamp":"2024-05-08T21:22:04.013951+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:12.893266+0000","scrub_duration":0.011919971999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.741038+0000","last_change":"2024-05-08T21:21:45.741178+0000","last_active":"2024-05-08T21:21:45.741038+0000","last_peered":"2024-05-08T21:21:45.741038+0000","last_clean":"2024-05-08T21:21:45.741038+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:45.741038+0000","last_undegraded":"2024-05-08T21:21:45.741038+0000","last_fullsized":"2024-05-08T21:21:45.741038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T21:21:45.740993+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T21:21:45.740993+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.740993+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.617390+0000","scrub_duration":0.0038103590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'834","reported_seq":873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:55.298082+0000","last_change":"2024-05-08T21:21:55.298236+0000","last_active":"2024-05-08T21:21:55.298082+0000","last_peered":"2024-05-08T21:21:55.298082+0000","last_clean":"2024-05-08T21:21:55.298082+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:55.298082+0000","last_undegraded":"2024-05-08T21:21:55.298082+0000","last_fullsized":"2024-05-08T21:21:55.298082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'834","last_scrub_stamp":"2024-05-08T21:21:55.298042+0000","last_deep_scrub":"27'834","last_deep_scrub_stamp":"2024-05-08T21:21:55.298042+0000","last_clean_scrub_stamp":"2024-05-08T21:21:55.298042+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:11.517112+0000","scrub_duration":0.001697879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3562,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:10.043589+0000","last_change":"2024-05-08T21:22:10.043742+0000","last_active":"2024-05-08T21:22:10.043589+0000","last_peered":"2024-05-08T21:22:10.043589+0000","last_clean":"2024-05-08T21:22:10.043589+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:22:10.043589+0000","last_undegraded":"2024-05-08T21:22:10.043589+0000","last_fullsized":"2024-05-08T21:22:10.043589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3525","last_scrub_stamp":"2024-05-08T21:22:10.043563+0000","last_deep_scrub":"27'3525","last_deep_scrub_stamp":"2024-05-08T21:22:10.043563+0000","last_clean_scrub_stamp":"2024-05-08T21:22:10.043563+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:18.513082+0000","scrub_duration":0.014352624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1101","reported_seq":1140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:39.018005+0000","last_change":"2024-05-08T21:21:39.018107+0000","last_active":"2024-05-08T21:21:39.018005+0000","last_peered":"2024-05-08T21:21:39.018005+0000","last_clean":"2024-05-08T21:21:39.018005+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:39.018005+0000","last_undegraded":"2024-05-08T21:21:39.018005+0000","last_fullsized":"2024-05-08T21:21:39.018005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1101","last_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_deep_scrub":"27'1101","last_deep_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_clean_scrub_stamp":"2024-05-08T21:21:39.017978+0000","objects_scrubbed":2,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:33.890814+0000","scrub_duration":0.026486484000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'819","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.003346+0000","last_change":"2024-05-08T21:21:44.003447+0000","last_active":"2024-05-08T21:21:44.003346+0000","last_peered":"2024-05-08T21:21:44.003346+0000","last_clean":"2024-05-08T21:21:44.003346+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:44.003346+0000","last_undegraded":"2024-05-08T21:21:44.003346+0000","last_fullsized":"2024-05-08T21:21:44.003346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:44.003318+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:44.003318+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.003318+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.841715+0000","scrub_duration":0.001906243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:08.082823+0000","last_change":"2024-05-08T21:22:08.082973+0000","last_active":"2024-05-08T21:22:08.082823+0000","last_peered":"2024-05-08T21:22:08.082823+0000","last_clean":"2024-05-08T21:22:08.082823+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:22:08.082823+0000","last_undegraded":"2024-05-08T21:22:08.082823+0000","last_fullsized":"2024-05-08T21:22:08.082823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3307","last_scrub_stamp":"2024-05-08T21:22:08.082798+0000","last_deep_scrub":"27'3307","last_deep_scrub_stamp":"2024-05-08T21:22:08.082798+0000","last_clean_scrub_stamp":"2024-05-08T21:22:08.082798+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:07.043524+0000","scrub_duration":0.013310571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1830","reported_seq":1870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.673979+0000","last_change":"2024-05-08T21:21:25.674104+0000","last_active":"2024-05-08T21:21:25.673979+0000","last_peered":"2024-05-08T21:21:25.673979+0000","last_clean":"2024-05-08T21:21:25.673979+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:25.673979+0000","last_undegraded":"2024-05-08T21:21:25.673979+0000","last_fullsized":"2024-05-08T21:21:25.673979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1830","last_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_deep_scrub":"27'1830","last_deep_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.673951+0000","objects_scrubbed":6,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:42.700633+0000","scrub_duration":0.019234405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'858","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.214224+0000","last_change":"2024-05-08T21:21:51.214331+0000","last_active":"2024-05-08T21:21:51.214224+0000","last_peered":"2024-05-08T21:21:51.214224+0000","last_clean":"2024-05-08T21:21:51.214224+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:51.214224+0000","last_undegraded":"2024-05-08T21:21:51.214224+0000","last_fullsized":"2024-05-08T21:21:51.214224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'858","last_scrub_stamp":"2024-05-08T21:21:51.214198+0000","last_deep_scrub":"27'858","last_deep_scrub_stamp":"2024-05-08T21:21:51.214198+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.214198+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:14.478266+0000","scrub_duration":0.00159553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:11.580475+0000","last_change":"2024-05-08T21:22:11.580623+0000","last_active":"2024-05-08T21:22:11.580475+0000","last_peered":"2024-05-08T21:22:11.580475+0000","last_clean":"2024-05-08T21:22:11.580475+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:22:11.580475+0000","last_undegraded":"2024-05-08T21:22:11.580475+0000","last_fullsized":"2024-05-08T21:22:11.580475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3360","last_scrub_stamp":"2024-05-08T21:22:11.580446+0000","last_deep_scrub":"27'3360","last_deep_scrub_stamp":"2024-05-08T21:22:11.580446+0000","last_clean_scrub_stamp":"2024-05-08T21:22:11.580446+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:10.541172+0000","scrub_duration":0.015333697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1832","reported_seq":1873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.055783+0000","last_change":"2024-05-08T21:21:28.055783+0000","last_active":"2024-05-08T21:21:28.055783+0000","last_peered":"2024-05-08T21:21:28.055783+0000","last_clean":"2024-05-08T21:21:28.055783+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:28.055783+0000","last_undegraded":"2024-05-08T21:21:28.055783+0000","last_fullsized":"2024-05-08T21:21:28.055783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1832","last_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_deep_scrub":"27'1832","last_deep_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.055611+0000","objects_scrubbed":2,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:40.971546+0000","scrub_duration":0.014408755000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'841","reported_seq":881,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.197534+0000","last_change":"2024-05-08T21:21:24.197534+0000","last_active":"2024-05-08T21:21:24.197534+0000","last_peered":"2024-05-08T21:21:24.197534+0000","last_clean":"2024-05-08T21:21:24.197534+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:24.197534+0000","last_undegraded":"2024-05-08T21:21:24.197534+0000","last_fullsized":"2024-05-08T21:21:24.197534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'841","last_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_deep_scrub":"27'841","last_deep_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.197404+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:14.802421+0000","scrub_duration":0.001513105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:55.910186+0000","last_change":"2024-05-08T21:21:55.910186+0000","last_active":"2024-05-08T21:21:55.910186+0000","last_peered":"2024-05-08T21:21:55.910186+0000","last_clean":"2024-05-08T21:21:55.910186+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:55.910186+0000","last_undegraded":"2024-05-08T21:21:55.910186+0000","last_fullsized":"2024-05-08T21:21:55.910186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4215","last_scrub_stamp":"2024-05-08T21:21:55.909994+0000","last_deep_scrub":"27'4215","last_deep_scrub_stamp":"2024-05-08T21:21:55.909994+0000","last_clean_scrub_stamp":"2024-05-08T21:21:55.909994+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:54.098976+0000","scrub_duration":0.016427773999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1215","reported_seq":1256,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.896292+0000","last_change":"2024-05-08T21:21:22.896292+0000","last_active":"2024-05-08T21:21:22.896292+0000","last_peered":"2024-05-08T21:21:22.896292+0000","last_clean":"2024-05-08T21:21:22.896292+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:22.896292+0000","last_undegraded":"2024-05-08T21:21:22.896292+0000","last_fullsized":"2024-05-08T21:21:22.896292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1215","last_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_deep_scrub":"27'1215","last_deep_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.896177+0000","objects_scrubbed":1,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:50.970681+0000","scrub_duration":0.015373217999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'822","reported_seq":862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.852458+0000","last_change":"2024-05-08T21:21:52.852458+0000","last_active":"2024-05-08T21:21:52.852458+0000","last_peered":"2024-05-08T21:21:52.852458+0000","last_clean":"2024-05-08T21:21:52.852458+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:52.852458+0000","last_undegraded":"2024-05-08T21:21:52.852458+0000","last_fullsized":"2024-05-08T21:21:52.852458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'822","last_scrub_stamp":"2024-05-08T21:21:52.852328+0000","last_deep_scrub":"27'822","last_deep_scrub_stamp":"2024-05-08T21:21:52.852328+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.852328+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:48.690725+0000","scrub_duration":0.0038734249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3511,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:06.889900+0000","last_change":"2024-05-08T20:55:41.599810+0000","last_active":"2024-05-08T21:21:06.889900+0000","last_peered":"2024-05-08T21:21:06.889900+0000","last_clean":"2024-05-08T21:21:06.889900+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:21:06.889900+0000","last_undegraded":"2024-05-08T21:21:06.889900+0000","last_fullsized":"2024-05-08T21:21:06.889900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5324","reported_seq":5365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:35.739165+0000","last_change":"2024-05-08T21:21:35.739165+0000","last_active":"2024-05-08T21:21:35.739165+0000","last_peered":"2024-05-08T21:21:35.739165+0000","last_clean":"2024-05-08T21:21:35.739165+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:35.739165+0000","last_undegraded":"2024-05-08T21:21:35.739165+0000","last_fullsized":"2024-05-08T21:21:35.739165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5324","last_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_deep_scrub":"27'5324","last_deep_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_clean_scrub_stamp":"2024-05-08T21:21:35.739051+0000","objects_scrubbed":6,"log_size":5324,"log_dups_size":0,"ondisk_log_size":5324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:01.155361+0000","scrub_duration":0.059511772999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007490,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5317,"num_write_kb":42298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'815","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:43.325345+0000","last_change":"2024-05-08T21:21:43.325345+0000","last_active":"2024-05-08T21:21:43.325345+0000","last_peered":"2024-05-08T21:21:43.325345+0000","last_clean":"2024-05-08T21:21:43.325345+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:43.325345+0000","last_undegraded":"2024-05-08T21:21:43.325345+0000","last_fullsized":"2024-05-08T21:21:43.325345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'815","last_scrub_stamp":"2024-05-08T21:21:43.325201+0000","last_deep_scrub":"27'815","last_deep_scrub_stamp":"2024-05-08T21:21:43.325201+0000","last_clean_scrub_stamp":"2024-05-08T21:21:43.325201+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:23.201599+0000","scrub_duration":0.0025464149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3418","reported_seq":3456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:00.818321+0000","last_change":"2024-05-08T21:22:00.818459+0000","last_active":"2024-05-08T21:22:00.818321+0000","last_peered":"2024-05-08T21:22:00.818321+0000","last_clean":"2024-05-08T21:22:00.818321+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:22:00.818321+0000","last_undegraded":"2024-05-08T21:22:00.818321+0000","last_fullsized":"2024-05-08T21:22:00.818321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3418","last_scrub_stamp":"2024-05-08T21:22:00.818290+0000","last_deep_scrub":"27'3418","last_deep_scrub_stamp":"2024-05-08T21:22:00.818290+0000","last_clean_scrub_stamp":"2024-05-08T21:22:00.818290+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:37.583512+0000","scrub_duration":0.013355994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'844","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.927146+0000","last_change":"2024-05-08T21:21:50.927241+0000","last_active":"2024-05-08T21:21:50.927146+0000","last_peered":"2024-05-08T21:21:50.927146+0000","last_clean":"2024-05-08T21:21:50.927146+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:50.927146+0000","last_undegraded":"2024-05-08T21:21:50.927146+0000","last_fullsized":"2024-05-08T21:21:50.927146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:50.927119+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:50.927119+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.927119+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:46.765517+0000","scrub_duration":0.001723739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.633436+0000","last_change":"2024-05-08T21:21:27.633436+0000","last_active":"2024-05-08T21:21:27.633436+0000","last_peered":"2024-05-08T21:21:27.633436+0000","last_clean":"2024-05-08T21:21:27.633436+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:27.633436+0000","last_undegraded":"2024-05-08T21:21:27.633436+0000","last_fullsized":"2024-05-08T21:21:27.633436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3945","last_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_deep_scrub":"27'3945","last_deep_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.633289+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:18.238307+0000","scrub_duration":0.0021982780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:04.787598+0000","last_change":"2024-05-08T21:22:04.787598+0000","last_active":"2024-05-08T21:22:04.787598+0000","last_peered":"2024-05-08T21:22:04.787598+0000","last_clean":"2024-05-08T21:22:04.787598+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:22:04.787598+0000","last_undegraded":"2024-05-08T21:22:04.787598+0000","last_fullsized":"2024-05-08T21:22:04.787598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4015","last_scrub_stamp":"2024-05-08T21:22:04.787419+0000","last_deep_scrub":"27'4015","last_deep_scrub_stamp":"2024-05-08T21:22:04.787419+0000","last_clean_scrub_stamp":"2024-05-08T21:22:04.787419+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:03.748145+0000","scrub_duration":0.016271010999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'844","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.626410+0000","last_change":"2024-05-08T21:21:31.626525+0000","last_active":"2024-05-08T21:21:31.626410+0000","last_peered":"2024-05-08T21:21:31.626410+0000","last_clean":"2024-05-08T21:21:31.626410+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:31.626410+0000","last_undegraded":"2024-05-08T21:21:31.626410+0000","last_fullsized":"2024-05-08T21:21:31.626410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.626385+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:26.764578+0000","scrub_duration":0.002149495,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2356","reported_seq":2397,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.779163+0000","last_change":"2024-05-08T21:21:30.779163+0000","last_active":"2024-05-08T21:21:30.779163+0000","last_peered":"2024-05-08T21:21:30.779163+0000","last_clean":"2024-05-08T21:21:30.779163+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:30.779163+0000","last_undegraded":"2024-05-08T21:21:30.779163+0000","last_fullsized":"2024-05-08T21:21:30.779163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2356","last_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_deep_scrub":"27'2356","last_deep_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.779025+0000","objects_scrubbed":2,"log_size":2356,"log_dups_size":0,"ondisk_log_size":2356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.917218+0000","scrub_duration":0.024843976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.235943+0000","last_change":"2024-05-08T21:21:28.236054+0000","last_active":"2024-05-08T21:21:28.235943+0000","last_peered":"2024-05-08T21:21:28.235943+0000","last_clean":"2024-05-08T21:21:28.235943+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:21:28.235943+0000","last_undegraded":"2024-05-08T21:21:28.235943+0000","last_fullsized":"2024-05-08T21:21:28.235943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.235917+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.151852+0000","scrub_duration":0.011500560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3615,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:03.124727+0000","last_change":"2024-05-08T21:22:03.124881+0000","last_active":"2024-05-08T21:22:03.124727+0000","last_peered":"2024-05-08T21:22:03.124727+0000","last_clean":"2024-05-08T21:22:03.124727+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:22:03.124727+0000","last_undegraded":"2024-05-08T21:22:03.124727+0000","last_fullsized":"2024-05-08T21:22:03.124727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3577","last_scrub_stamp":"2024-05-08T21:22:03.124701+0000","last_deep_scrub":"27'3577","last_deep_scrub_stamp":"2024-05-08T21:22:03.124701+0000","last_clean_scrub_stamp":"2024-05-08T21:22:03.124701+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:15.755822+0000","scrub_duration":0.013538625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'788","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.126691+0000","last_change":"2024-05-08T21:21:27.126691+0000","last_active":"2024-05-08T21:21:27.126691+0000","last_peered":"2024-05-08T21:21:27.126691+0000","last_clean":"2024-05-08T21:21:27.126691+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:27.126691+0000","last_undegraded":"2024-05-08T21:21:27.126691+0000","last_fullsized":"2024-05-08T21:21:27.126691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'788","last_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_deep_scrub":"27'788","last_deep_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.126529+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:40.108784+0000","scrub_duration":0.0023240880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4041","reported_seq":4083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.245520+0000","last_change":"2024-05-08T21:21:30.245636+0000","last_active":"2024-05-08T21:21:30.245520+0000","last_peered":"2024-05-08T21:21:30.245520+0000","last_clean":"2024-05-08T21:21:30.245520+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:30.245520+0000","last_undegraded":"2024-05-08T21:21:30.245520+0000","last_fullsized":"2024-05-08T21:21:30.245520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4041","last_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_deep_scrub":"27'4041","last_deep_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.245496+0000","objects_scrubbed":3,"log_size":4041,"log_dups_size":0,"ondisk_log_size":4041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.227751+0000","scrub_duration":0.033406524999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:05.119777+0000","last_change":"2024-05-08T21:22:05.119777+0000","last_active":"2024-05-08T21:22:05.119777+0000","last_peered":"2024-05-08T21:22:05.119777+0000","last_clean":"2024-05-08T21:22:05.119777+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:22:05.119777+0000","last_undegraded":"2024-05-08T21:22:05.119777+0000","last_fullsized":"2024-05-08T21:22:05.119777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3326","last_scrub_stamp":"2024-05-08T21:22:05.119652+0000","last_deep_scrub":"27'3326","last_deep_scrub_stamp":"2024-05-08T21:22:05.119652+0000","last_clean_scrub_stamp":"2024-05-08T21:22:05.119652+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:42.192462+0000","scrub_duration":0.011095244000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2956","reported_seq":2998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.155283+0000","last_change":"2024-05-08T21:21:34.155283+0000","last_active":"2024-05-08T21:21:34.155283+0000","last_peered":"2024-05-08T21:21:34.155283+0000","last_clean":"2024-05-08T21:21:34.155283+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:34.155283+0000","last_undegraded":"2024-05-08T21:21:34.155283+0000","last_fullsized":"2024-05-08T21:21:34.155283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2956","last_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_deep_scrub":"27'2956","last_deep_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.155158+0000","objects_scrubbed":1,"log_size":2956,"log_dups_size":0,"ondisk_log_size":2956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:59.571468+0000","scrub_duration":0.015577423999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.871328+0000","last_change":"2024-05-08T21:21:42.871328+0000","last_active":"2024-05-08T21:21:42.871328+0000","last_peered":"2024-05-08T21:21:42.871328+0000","last_clean":"2024-05-08T21:21:42.871328+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:42.871328+0000","last_undegraded":"2024-05-08T21:21:42.871328+0000","last_fullsized":"2024-05-08T21:21:42.871328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:21:42.871178+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:21:42.871178+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.871178+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:22.747575+0000","scrub_duration":0.0049309480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3605,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.004491+0000","last_change":"2024-05-08T21:21:57.004649+0000","last_active":"2024-05-08T21:21:57.004491+0000","last_peered":"2024-05-08T21:21:57.004491+0000","last_clean":"2024-05-08T21:21:57.004491+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:57.004491+0000","last_undegraded":"2024-05-08T21:21:57.004491+0000","last_fullsized":"2024-05-08T21:21:57.004491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3566","last_scrub_stamp":"2024-05-08T21:21:57.004462+0000","last_deep_scrub":"27'3566","last_deep_scrub_stamp":"2024-05-08T21:21:57.004462+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.004462+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:13.223532+0000","scrub_duration":0.017708050999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2161","reported_seq":2201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.877526+0000","last_change":"2024-05-08T21:21:24.877608+0000","last_active":"2024-05-08T21:21:24.877526+0000","last_peered":"2024-05-08T21:21:24.877526+0000","last_clean":"2024-05-08T21:21:24.877526+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:24.877526+0000","last_undegraded":"2024-05-08T21:21:24.877526+0000","last_fullsized":"2024-05-08T21:21:24.877526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2161","last_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_deep_scrub":"27'2161","last_deep_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.877501+0000","objects_scrubbed":4,"log_size":2161,"log_dups_size":0,"ondisk_log_size":2161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.662888+0000","scrub_duration":0.036106909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2748,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'779","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.957532+0000","last_change":"2024-05-08T21:21:47.957630+0000","last_active":"2024-05-08T21:21:47.957532+0000","last_peered":"2024-05-08T21:21:47.957532+0000","last_clean":"2024-05-08T21:21:47.957532+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:47.957532+0000","last_undegraded":"2024-05-08T21:21:47.957532+0000","last_fullsized":"2024-05-08T21:21:47.957532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-05-08T21:21:47.957506+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-05-08T21:21:47.957506+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.957506+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:42.830342+0000","scrub_duration":0.0063647870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.490702+0000","last_change":"2024-05-08T21:21:50.490702+0000","last_active":"2024-05-08T21:21:50.490702+0000","last_peered":"2024-05-08T21:21:50.490702+0000","last_clean":"2024-05-08T21:21:50.490702+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:50.490702+0000","last_undegraded":"2024-05-08T21:21:50.490702+0000","last_fullsized":"2024-05-08T21:21:50.490702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3331","last_scrub_stamp":"2024-05-08T21:21:50.490507+0000","last_deep_scrub":"27'3331","last_deep_scrub_stamp":"2024-05-08T21:21:50.490507+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.490507+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:46.328904+0000","scrub_duration":0.015760401,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1267","reported_seq":1307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:36.960796+0000","last_change":"2024-05-08T21:21:36.960886+0000","last_active":"2024-05-08T21:21:36.960796+0000","last_peered":"2024-05-08T21:21:36.960796+0000","last_clean":"2024-05-08T21:21:36.960796+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:36.960796+0000","last_undegraded":"2024-05-08T21:21:36.960796+0000","last_fullsized":"2024-05-08T21:21:36.960796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1267","last_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_deep_scrub":"27'1267","last_deep_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_clean_scrub_stamp":"2024-05-08T21:21:36.960770+0000","objects_scrubbed":2,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:16.837167+0000","scrub_duration":0.013455020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'819","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.045835+0000","last_change":"2024-05-08T21:21:40.045946+0000","last_active":"2024-05-08T21:21:40.045835+0000","last_peered":"2024-05-08T21:21:40.045835+0000","last_clean":"2024-05-08T21:21:40.045835+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:40.045835+0000","last_undegraded":"2024-05-08T21:21:40.045835+0000","last_fullsized":"2024-05-08T21:21:40.045835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.045808+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:19.922206+0000","scrub_duration":0.003983337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3671,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:06.590765+0000","last_change":"2024-05-08T21:22:06.590765+0000","last_active":"2024-05-08T21:22:06.590765+0000","last_peered":"2024-05-08T21:22:06.590765+0000","last_clean":"2024-05-08T21:22:06.590765+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:22:06.590765+0000","last_undegraded":"2024-05-08T21:22:06.590765+0000","last_fullsized":"2024-05-08T21:22:06.590765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3633","last_scrub_stamp":"2024-05-08T21:22:06.590576+0000","last_deep_scrub":"27'3633","last_deep_scrub_stamp":"2024-05-08T21:22:06.590576+0000","last_clean_scrub_stamp":"2024-05-08T21:22:06.590576+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:19.221697+0000","scrub_duration":0.015038565,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1127","reported_seq":1168,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:46.127654+0000","last_change":"2024-05-08T21:21:46.127752+0000","last_active":"2024-05-08T21:21:46.127654+0000","last_peered":"2024-05-08T21:21:46.127654+0000","last_clean":"2024-05-08T21:21:46.127654+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:46.127654+0000","last_undegraded":"2024-05-08T21:21:46.127654+0000","last_fullsized":"2024-05-08T21:21:46.127654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1127","last_scrub_stamp":"2024-05-08T21:21:46.127626+0000","last_deep_scrub":"27'1127","last_deep_scrub_stamp":"2024-05-08T21:21:46.127626+0000","last_clean_scrub_stamp":"2024-05-08T21:21:46.127626+0000","objects_scrubbed":1,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:41.000462+0000","scrub_duration":0.013414069000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.053152+0000","last_change":"2024-05-08T21:21:29.053278+0000","last_active":"2024-05-08T21:21:29.053152+0000","last_peered":"2024-05-08T21:21:29.053152+0000","last_clean":"2024-05-08T21:21:29.053152+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:29.053152+0000","last_undegraded":"2024-05-08T21:21:29.053152+0000","last_fullsized":"2024-05-08T21:21:29.053152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.053124+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.191318+0000","scrub_duration":0.0019797819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.828927+0000","last_change":"2024-05-08T21:21:59.828927+0000","last_active":"2024-05-08T21:21:59.828927+0000","last_peered":"2024-05-08T21:21:59.828927+0000","last_clean":"2024-05-08T21:21:59.828927+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:59.828927+0000","last_undegraded":"2024-05-08T21:21:59.828927+0000","last_fullsized":"2024-05-08T21:21:59.828927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3469","last_scrub_stamp":"2024-05-08T21:21:59.828717+0000","last_deep_scrub":"27'3469","last_deep_scrub_stamp":"2024-05-08T21:21:59.828717+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.828717+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:25.850036+0000","scrub_duration":0.012228011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2227","reported_seq":2267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.905689+0000","last_change":"2024-05-08T21:21:32.905786+0000","last_active":"2024-05-08T21:21:32.905689+0000","last_peered":"2024-05-08T21:21:32.905689+0000","last_clean":"2024-05-08T21:21:32.905689+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:32.905689+0000","last_undegraded":"2024-05-08T21:21:32.905689+0000","last_fullsized":"2024-05-08T21:21:32.905689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2227","last_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_deep_scrub":"27'2227","last_deep_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.905663+0000","objects_scrubbed":2,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:58.321972+0000","scrub_duration":0.026572928999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'888","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.888496+0000","last_change":"2024-05-08T21:21:26.888635+0000","last_active":"2024-05-08T21:21:26.888496+0000","last_peered":"2024-05-08T21:21:26.888496+0000","last_clean":"2024-05-08T21:21:26.888496+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:26.888496+0000","last_undegraded":"2024-05-08T21:21:26.888496+0000","last_fullsized":"2024-05-08T21:21:26.888496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'888","last_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_deep_scrub":"27'888","last_deep_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.888468+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:46.014423+0000","scrub_duration":0.0039110660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:46.473294+0000","last_change":"2024-05-08T21:21:46.473294+0000","last_active":"2024-05-08T21:21:46.473294+0000","last_peered":"2024-05-08T21:21:46.473294+0000","last_clean":"2024-05-08T21:21:46.473294+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:46.473294+0000","last_undegraded":"2024-05-08T21:21:46.473294+0000","last_fullsized":"2024-05-08T21:21:46.473294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3756","last_scrub_stamp":"2024-05-08T21:21:46.473129+0000","last_deep_scrub":"27'3756","last_deep_scrub_stamp":"2024-05-08T21:21:46.473129+0000","last_clean_scrub_stamp":"2024-05-08T21:21:46.473129+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:32.774488+0000","scrub_duration":0.015135117999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3680","reported_seq":3720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.885021+0000","last_change":"2024-05-08T21:21:29.885123+0000","last_active":"2024-05-08T21:21:29.885021+0000","last_peered":"2024-05-08T21:21:29.885021+0000","last_clean":"2024-05-08T21:21:29.885021+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:29.885021+0000","last_undegraded":"2024-05-08T21:21:29.885021+0000","last_fullsized":"2024-05-08T21:21:29.885021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3680","last_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_deep_scrub":"27'3680","last_deep_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.884993+0000","objects_scrubbed":2,"log_size":3680,"log_dups_size":0,"ondisk_log_size":3680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.867249+0000","scrub_duration":0.031053055999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'844","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.879171+0000","last_change":"2024-05-08T21:21:51.879171+0000","last_active":"2024-05-08T21:21:51.879171+0000","last_peered":"2024-05-08T21:21:51.879171+0000","last_clean":"2024-05-08T21:21:51.879171+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:51.879171+0000","last_undegraded":"2024-05-08T21:21:51.879171+0000","last_fullsized":"2024-05-08T21:21:51.879171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:51.879027+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:51.879027+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.879027+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:27.221148+0000","scrub_duration":0.00408691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3525,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:08.604647+0000","last_change":"2024-05-08T21:22:08.604799+0000","last_active":"2024-05-08T21:22:08.604647+0000","last_peered":"2024-05-08T21:22:08.604647+0000","last_clean":"2024-05-08T21:22:08.604647+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:22:08.604647+0000","last_undegraded":"2024-05-08T21:22:08.604647+0000","last_fullsized":"2024-05-08T21:22:08.604647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3487","last_scrub_stamp":"2024-05-08T21:22:08.604619+0000","last_deep_scrub":"27'3487","last_deep_scrub_stamp":"2024-05-08T21:22:08.604619+0000","last_clean_scrub_stamp":"2024-05-08T21:22:08.604619+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:45.677429+0000","scrub_duration":0.013727754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4109","reported_seq":4150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.255874+0000","last_change":"2024-05-08T21:21:29.255874+0000","last_active":"2024-05-08T21:21:29.255874+0000","last_peered":"2024-05-08T21:21:29.255874+0000","last_clean":"2024-05-08T21:21:29.255874+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:29.255874+0000","last_undegraded":"2024-05-08T21:21:29.255874+0000","last_fullsized":"2024-05-08T21:21:29.255874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4109","last_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_deep_scrub":"27'4109","last_deep_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.255742+0000","objects_scrubbed":3,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.393936+0000","scrub_duration":0.030240922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'810","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:49.878919+0000","last_change":"2024-05-08T21:21:49.879015+0000","last_active":"2024-05-08T21:21:49.878919+0000","last_peered":"2024-05-08T21:21:49.878919+0000","last_clean":"2024-05-08T21:21:49.878919+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:49.878919+0000","last_undegraded":"2024-05-08T21:21:49.878919+0000","last_fullsized":"2024-05-08T21:21:49.878919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'810","last_scrub_stamp":"2024-05-08T21:21:49.878891+0000","last_deep_scrub":"27'810","last_deep_scrub_stamp":"2024-05-08T21:21:49.878891+0000","last_clean_scrub_stamp":"2024-05-08T21:21:49.878891+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:48.067874+0000","scrub_duration":0.001602535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:07.710824+0000","last_change":"2024-05-08T20:55:41.605046+0000","last_active":"2024-05-08T21:21:07.710824+0000","last_peered":"2024-05-08T21:21:07.710824+0000","last_clean":"2024-05-08T21:21:07.710824+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:21:07.710824+0000","last_undegraded":"2024-05-08T21:21:07.710824+0000","last_fullsized":"2024-05-08T21:21:07.710824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3441","reported_seq":3482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.602580+0000","last_change":"2024-05-08T21:21:21.602580+0000","last_active":"2024-05-08T21:21:21.602580+0000","last_peered":"2024-05-08T21:21:21.602580+0000","last_clean":"2024-05-08T21:21:21.602580+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:21.602580+0000","last_undegraded":"2024-05-08T21:21:21.602580+0000","last_fullsized":"2024-05-08T21:21:21.602580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3441","last_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_deep_scrub":"27'3441","last_deep_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.602478+0000","objects_scrubbed":5,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:12.507196+0000","scrub_duration":0.053816461000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'810","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.215510+0000","last_change":"2024-05-08T21:21:26.215510+0000","last_active":"2024-05-08T21:21:26.215510+0000","last_peered":"2024-05-08T21:21:26.215510+0000","last_clean":"2024-05-08T21:21:26.215510+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:26.215510+0000","last_undegraded":"2024-05-08T21:21:26.215510+0000","last_fullsized":"2024-05-08T21:21:26.215510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'810","last_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_deep_scrub":"27'810","last_deep_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.215374+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:22.000760+0000","scrub_duration":0.0030007150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3730,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:20.515626+0000","last_change":"2024-05-08T20:55:41.613686+0000","last_active":"2024-05-08T21:21:20.515626+0000","last_peered":"2024-05-08T21:21:20.515626+0000","last_clean":"2024-05-08T21:21:20.515626+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:21:20.515626+0000","last_undegraded":"2024-05-08T21:21:20.515626+0000","last_fullsized":"2024-05-08T21:21:20.515626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:55:03.078897+0000","last_clean_scrub_stamp":"2024-05-08T20:55:03.078897+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3911","reported_seq":3951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.858266+0000","last_change":"2024-05-08T21:21:21.858266+0000","last_active":"2024-05-08T21:21:21.858266+0000","last_peered":"2024-05-08T21:21:21.858266+0000","last_clean":"2024-05-08T21:21:21.858266+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:21.858266+0000","last_undegraded":"2024-05-08T21:21:21.858266+0000","last_fullsized":"2024-05-08T21:21:21.858266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3911","last_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_deep_scrub":"27'3911","last_deep_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.858055+0000","objects_scrubbed":2,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:12.384037+0000","scrub_duration":0.015982177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'819","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:56.841143+0000","last_change":"2024-05-08T21:21:56.841143+0000","last_active":"2024-05-08T21:21:56.841143+0000","last_peered":"2024-05-08T21:21:56.841143+0000","last_clean":"2024-05-08T21:21:56.841143+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:56.841143+0000","last_undegraded":"2024-05-08T21:21:56.841143+0000","last_fullsized":"2024-05-08T21:21:56.841143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:56.841000+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:56.841000+0000","last_clean_scrub_stamp":"2024-05-08T21:21:56.841000+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:13.060070+0000","scrub_duration":0.0020392829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3426,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:16.039799+0000","last_change":"2024-05-08T21:22:16.039962+0000","last_active":"2024-05-08T21:22:16.039799+0000","last_peered":"2024-05-08T21:22:16.039799+0000","last_clean":"2024-05-08T21:22:16.039799+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:22:16.039799+0000","last_undegraded":"2024-05-08T21:22:16.039799+0000","last_fullsized":"2024-05-08T21:22:16.039799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3388","last_scrub_stamp":"2024-05-08T21:22:16.039771+0000","last_deep_scrub":"27'3388","last_deep_scrub_stamp":"2024-05-08T21:22:16.039771+0000","last_clean_scrub_stamp":"2024-05-08T21:22:16.039771+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:39.902871+0000","scrub_duration":0.016518066000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1802","reported_seq":1843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.593429+0000","last_change":"2024-05-08T21:21:22.593429+0000","last_active":"2024-05-08T21:21:22.593429+0000","last_peered":"2024-05-08T21:21:22.593429+0000","last_clean":"2024-05-08T21:21:22.593429+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:22.593429+0000","last_undegraded":"2024-05-08T21:21:22.593429+0000","last_fullsized":"2024-05-08T21:21:22.593429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1802","last_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_deep_scrub":"27'1802","last_deep_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.593300+0000","objects_scrubbed":1,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:44.040446+0000","scrub_duration":0.0043429840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'818","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.201091+0000","last_change":"2024-05-08T21:21:52.201091+0000","last_active":"2024-05-08T21:21:52.201091+0000","last_peered":"2024-05-08T21:21:52.201091+0000","last_clean":"2024-05-08T21:21:52.201091+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:52.201091+0000","last_undegraded":"2024-05-08T21:21:52.201091+0000","last_fullsized":"2024-05-08T21:21:52.201091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:52.200940+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:52.200940+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.200940+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:48.039338+0000","scrub_duration":0.0051215999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'845","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.887670+0000","last_change":"2024-05-08T21:21:59.887670+0000","last_active":"2024-05-08T21:21:59.887670+0000","last_peered":"2024-05-08T21:21:59.887670+0000","last_clean":"2024-05-08T21:21:59.887670+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:59.887670+0000","last_undegraded":"2024-05-08T21:21:59.887670+0000","last_fullsized":"2024-05-08T21:21:59.887670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'845","last_scrub_stamp":"2024-05-08T21:21:59.887533+0000","last_deep_scrub":"27'845","last_deep_scrub_stamp":"2024-05-08T21:21:59.887533+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.887533+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:12.518654+0000","scrub_duration":0.0022607679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'869","reported_seq":918,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.662357+0000","last_change":"2024-05-08T21:21:28.662357+0000","last_active":"2024-05-08T21:21:28.662357+0000","last_peered":"2024-05-08T21:21:28.662357+0000","last_clean":"2024-05-08T21:21:28.662357+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:28.662357+0000","last_undegraded":"2024-05-08T21:21:28.662357+0000","last_fullsized":"2024-05-08T21:21:28.662357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'869","last_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_deep_scrub":"27'869","last_deep_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.662201+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:47.788156+0000","scrub_duration":0.0052510159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'817","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.739823+0000","last_change":"2024-05-08T21:21:24.739823+0000","last_active":"2024-05-08T21:21:24.739823+0000","last_peered":"2024-05-08T21:21:24.739823+0000","last_clean":"2024-05-08T21:21:24.739823+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:24.739823+0000","last_undegraded":"2024-05-08T21:21:24.739823+0000","last_fullsized":"2024-05-08T21:21:24.739823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'817","last_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_deep_scrub":"27'817","last_deep_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.739660+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:15.265642+0000","scrub_duration":0.002018003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'848","reported_seq":889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.015747+0000","last_change":"2024-05-08T21:21:51.015747+0000","last_active":"2024-05-08T21:21:51.015747+0000","last_peered":"2024-05-08T21:21:51.015747+0000","last_clean":"2024-05-08T21:21:51.015747+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:51.015747+0000","last_undegraded":"2024-05-08T21:21:51.015747+0000","last_fullsized":"2024-05-08T21:21:51.015747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'848","last_scrub_stamp":"2024-05-08T21:21:51.015622+0000","last_deep_scrub":"27'848","last_deep_scrub_stamp":"2024-05-08T21:21:51.015622+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.015622+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:07.234691+0000","scrub_duration":0.0025535380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'814","reported_seq":854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.874297+0000","last_change":"2024-05-08T21:21:52.874413+0000","last_active":"2024-05-08T21:21:52.874297+0000","last_peered":"2024-05-08T21:21:52.874297+0000","last_clean":"2024-05-08T21:21:52.874297+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:52.874297+0000","last_undegraded":"2024-05-08T21:21:52.874297+0000","last_fullsized":"2024-05-08T21:21:52.874297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'814","last_scrub_stamp":"2024-05-08T21:21:52.874259+0000","last_deep_scrub":"27'814","last_deep_scrub_stamp":"2024-05-08T21:21:52.874259+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.874259+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:16.138326+0000","scrub_duration":0.001750756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'818","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.965165+0000","last_change":"2024-05-08T21:21:44.965262+0000","last_active":"2024-05-08T21:21:44.965165+0000","last_peered":"2024-05-08T21:21:44.965165+0000","last_clean":"2024-05-08T21:21:44.965165+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:44.965165+0000","last_undegraded":"2024-05-08T21:21:44.965165+0000","last_fullsized":"2024-05-08T21:21:44.965165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:44.965141+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:44.965141+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.965141+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:39.837977+0000","scrub_duration":0.0064359550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'882","reported_seq":921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:01.857579+0000","last_change":"2024-05-08T21:22:01.857676+0000","last_active":"2024-05-08T21:22:01.857579+0000","last_peered":"2024-05-08T21:22:01.857579+0000","last_clean":"2024-05-08T21:22:01.857579+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:22:01.857579+0000","last_undegraded":"2024-05-08T21:22:01.857579+0000","last_fullsized":"2024-05-08T21:22:01.857579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'882","last_scrub_stamp":"2024-05-08T21:22:01.857552+0000","last_deep_scrub":"27'882","last_deep_scrub_stamp":"2024-05-08T21:22:01.857552+0000","last_clean_scrub_stamp":"2024-05-08T21:22:01.857552+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:38.930362+0000","scrub_duration":0.0015362259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'808","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.790030+0000","last_change":"2024-05-08T21:21:23.790119+0000","last_active":"2024-05-08T21:21:23.790030+0000","last_peered":"2024-05-08T21:21:23.790030+0000","last_clean":"2024-05-08T21:21:23.790030+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:23.790030+0000","last_undegraded":"2024-05-08T21:21:23.790030+0000","last_fullsized":"2024-05-08T21:21:23.790030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'808","last_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_deep_scrub":"27'808","last_deep_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_clean_scrub_stamp":"2024-05-08T21:21:23.790007+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:31.585133+0000","scrub_duration":0.0053510820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'808","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.760633+0000","last_change":"2024-05-08T21:21:47.760795+0000","last_active":"2024-05-08T21:21:47.760633+0000","last_peered":"2024-05-08T21:21:47.760633+0000","last_clean":"2024-05-08T21:21:47.760633+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:47.760633+0000","last_undegraded":"2024-05-08T21:21:47.760633+0000","last_fullsized":"2024-05-08T21:21:47.760633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'808","last_scrub_stamp":"2024-05-08T21:21:47.760591+0000","last_deep_scrub":"27'808","last_deep_scrub_stamp":"2024-05-08T21:21:47.760591+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.760591+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:42.633427+0000","scrub_duration":0.0020371019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'798","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.956784+0000","last_change":"2024-05-08T21:21:45.956784+0000","last_active":"2024-05-08T21:21:45.956784+0000","last_peered":"2024-05-08T21:21:45.956784+0000","last_clean":"2024-05-08T21:21:45.956784+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:45.956784+0000","last_undegraded":"2024-05-08T21:21:45.956784+0000","last_fullsized":"2024-05-08T21:21:45.956784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'798","last_scrub_stamp":"2024-05-08T21:21:45.956652+0000","last_deep_scrub":"27'798","last_deep_scrub_stamp":"2024-05-08T21:21:45.956652+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.956652+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.833049+0000","scrub_duration":0.0027042889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'833","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:58.840570+0000","last_change":"2024-05-08T21:21:58.840570+0000","last_active":"2024-05-08T21:21:58.840570+0000","last_peered":"2024-05-08T21:21:58.840570+0000","last_clean":"2024-05-08T21:21:58.840570+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:58.840570+0000","last_undegraded":"2024-05-08T21:21:58.840570+0000","last_fullsized":"2024-05-08T21:21:58.840570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'833","last_scrub_stamp":"2024-05-08T21:21:58.840443+0000","last_deep_scrub":"27'833","last_deep_scrub_stamp":"2024-05-08T21:21:58.840443+0000","last_clean_scrub_stamp":"2024-05-08T21:21:58.840443+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:57.029426+0000","scrub_duration":0.0016211890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'841","reported_seq":881,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.961917+0000","last_change":"2024-05-08T21:21:52.961917+0000","last_active":"2024-05-08T21:21:52.961917+0000","last_peered":"2024-05-08T21:21:52.961917+0000","last_clean":"2024-05-08T21:21:52.961917+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:52.961917+0000","last_undegraded":"2024-05-08T21:21:52.961917+0000","last_fullsized":"2024-05-08T21:21:52.961917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'841","last_scrub_stamp":"2024-05-08T21:21:52.961795+0000","last_deep_scrub":"27'841","last_deep_scrub_stamp":"2024-05-08T21:21:52.961795+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.961795+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:51.150777+0000","scrub_duration":0.0037096870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'836","reported_seq":875,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.919525+0000","last_change":"2024-05-08T21:21:47.919525+0000","last_active":"2024-05-08T21:21:47.919525+0000","last_peered":"2024-05-08T21:21:47.919525+0000","last_clean":"2024-05-08T21:21:47.919525+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:47.919525+0000","last_undegraded":"2024-05-08T21:21:47.919525+0000","last_fullsized":"2024-05-08T21:21:47.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'836","last_scrub_stamp":"2024-05-08T21:21:47.919374+0000","last_deep_scrub":"27'836","last_deep_scrub_stamp":"2024-05-08T21:21:47.919374+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.919374+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:04.138444+0000","scrub_duration":0.001520024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86560,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113556,"ondisk_log_size":113556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52760,"ondisk_log_size":52760,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243565076,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2931,"num_read_kb":7530,"num_write":91807,"num_write_kb":660236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487194624,"data_stored":487130152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91125,"ondisk_log_size":91125,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575183,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520812,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":454398,"kb_avail":93851028,"statfs":{"total":96636764160,"available":96103452672,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":465304011},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.47099999999999997},"min":{"1min":0.247,"5min":0.216,"15min":0.191},"max":{"1min":2.996,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.67200000000000004,"15min":0.501},"min":{"1min":0.30299999999999999,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":2.121,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.752,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.5660000000000001,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.67400000000000004,"15min":0.51800000000000002},"min":{"1min":0.25800000000000001,"5min":0.22,"15min":0.20499999999999999},"max":{"1min":1.385,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.497}]},{"osd":2,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59599999999999997,"15min":0.5},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":2.3519999999999999,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.621,"15min":0.50700000000000001},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.3380000000000001,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.56100000000000005}]},{"osd":3,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.77300000000000002,"15min":0.56000000000000005},"min":{"1min":0.29399999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.1269999999999998,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.1319999999999999,"5min":0.81599999999999995,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":9.0800000000000001,"5min":9.0800000000000001,"15min":9.0800000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.505},"min":{"1min":0.29999999999999999,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":1.0329999999999999,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67600000000000005,"15min":0.54200000000000004},"min":{"1min":0.34300000000000003,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":2.7589999999999999,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.39200000000000002}]},{"osd":5,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.68300000000000005,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":1.304,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.76100000000000001,"15min":0.58899999999999997},"min":{"1min":0.39500000000000002,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":1.472,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.47599999999999998}]},{"osd":6,"last update":"Wed May 8 21:21:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.68400000000000005,"15min":0.55700000000000005},"min":{"1min":0.35699999999999998,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":0.83299999999999996,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.60399999999999998},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.312},"max":{"1min":3.0310000000000001,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575183,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.27600000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":4.0460000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":9.1980000000000004,"5min":9.1980000000000004,"15min":9.1980000000000004},"last":0.66500000000000004}]},{"osd":1,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.58799999999999997,"15min":0.505},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":0.67100000000000004,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.849,"5min":0.79200000000000004,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":26.343,"5min":26.343,"15min":26.343},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":3.694,"15min":3.694},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.64000000000000001,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":9.1539999999999999,"5min":9.1539999999999999,"15min":9.1539999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":2.278,"15min":3.8250000000000002},"last":0.63},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":2.3039999999999998,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":4.5670000000000002,"5min":4.5670000000000002,"15min":7.3810000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":1.089,"5min":0.70999999999999996,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.222},"max":{"1min":12.109999999999999,"5min":12.109999999999999,"15min":12.109999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.8680000000000001,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.57299999999999995},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":0.80700000000000005,"5min":3.024,"15min":4.0119999999999996},"last":0.51600000000000001}]},{"osd":7,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.86199999999999999,"5min":2.2989999999999999,"15min":3.8100000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.56899999999999995},"min":{"1min":0.441,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":0.75600000000000001,"5min":2.919,"15min":3.8780000000000001},"last":0.64200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575183,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581444,"kb_used_data":81084,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790396,"statfs":{"total":96636764160,"available":96041365504,"internally_reserved":0,"allocated":83030016,"data_stored":82846318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.47399999999999998,"15min":0.36899999999999999},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":1.349,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.44700000000000001,"15min":0.38500000000000001},"min":{"1min":0.185,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.52500000000000002,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.47699999999999998}]},{"osd":2,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41899999999999998,"15min":0.39200000000000002},"min":{"1min":0.22900000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":1.448,"5min":5.141,"15min":5.141},"last":0.501},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.55300000000000005,"15min":0.46400000000000002},"min":{"1min":0.311,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.4750000000000001,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.64000000000000001,"15min":0.501},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.321,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.51600000000000001,"15min":0.46100000000000002},"min":{"1min":0.23999999999999999,"5min":0.223,"15min":0.19},"max":{"1min":0.67700000000000005,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.57599999999999996}]},{"osd":4,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.55400000000000005,"15min":0.50600000000000001},"min":{"1min":0.254,"5min":0.25,"15min":0.247},"max":{"1min":0.84299999999999997,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.66100000000000003,"15min":0.54800000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":1.2829999999999999,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56999999999999995,"15min":0.50700000000000001},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":1.006,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.59599999999999997,"15min":0.56100000000000005},"min":{"1min":0.32200000000000001,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":0.80900000000000005,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.66900000000000004}]},{"osd":6,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.67100000000000004,"15min":0.55800000000000005},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0369999999999999,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.63100000000000001,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.28499999999999998},"max":{"1min":0.86499999999999999,"5min":6.766,"15min":6.766},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed May 8 21:21:37 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.746,"15min":0.60399999999999998},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":1.377,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69999999999999996,"15min":0.61699999999999999},"min":{"1min":0.38100000000000001,"5min":0.34200000000000003,"15min":0.33900000000000002},"max":{"1min":0.96599999999999997,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.76600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575184,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375604,"kb_used_data":29548,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996236,"statfs":{"total":96636764160,"available":96252145664,"internally_reserved":0,"allocated":30257152,"data_stored":30069546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40500000000000003,"15min":0.34699999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.86099999999999999,"5min":3.823,"15min":3.823},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.45200000000000001,"15min":0.41199999999999998},"min":{"1min":0.27600000000000002,"5min":0.23100000000000001,"15min":0.19},"max":{"1min":2.734,"5min":3.879,"15min":4.5919999999999996},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.45700000000000002,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20999999999999999,"15min":0.17399999999999999},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.9870000000000001},"last":0.436}]},{"osd":3,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.49199999999999999,"15min":0.438},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":2.4900000000000002,"5min":3.7160000000000002,"15min":3.895},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.498,"15min":0.44400000000000001},"min":{"1min":0.26500000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":2.4750000000000001,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.34699999999999998}]},{"osd":4,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.48499999999999999},"min":{"1min":0.38500000000000001,"5min":0.26400000000000001,"15min":0.254},"max":{"1min":1.127,"5min":3.794,"15min":5.6559999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.496,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.76400000000000001,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.69499999999999995}]},{"osd":5,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.55500000000000005,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":4.298,"5min":4.298,"15min":4.298},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.77100000000000002,"15min":0.60299999999999998},"min":{"1min":0.40300000000000002,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":1.206,"5min":14.901,"15min":14.901},"last":0.623}]},{"osd":6,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":1.0329999999999999,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.60199999999999998,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":2.7669999999999999,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.31900000000000001},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":5.0220000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.61699999999999999},"min":{"1min":0.45300000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":1.1739999999999999,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.75}]}]},{"osd":2,"up_from":13,"seq":55834575183,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.39200000000000002,"15min":0.34200000000000003},"min":{"1min":0.19600000000000001,"5min":0.17899999999999999,"15min":0.17399999999999999},"max":{"1min":0.42999999999999999,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.44900000000000001,"15min":0.40699999999999997},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.91500000000000004,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.56399999999999995}]},{"osd":1,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.44900000000000001,"15min":0.39600000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.186},"max":{"1min":0.47599999999999998,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.58299999999999996,"15min":0.47399999999999998},"min":{"1min":0.23300000000000001,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.41199999999999998,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.433,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.20999999999999999,"15min":0.20200000000000001},"max":{"1min":2.0019999999999998,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.496},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.249,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":0.64800000000000002,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.54400000000000004}]},{"osd":4,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.60999999999999999,"15min":0.58199999999999996},"min":{"1min":0.30299999999999999,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":0.70799999999999996,"5min":7.3799999999999999,"15min":16.651},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.629,"15min":0.63},"min":{"1min":0.28699999999999998,"5min":0.28499999999999998,"15min":0.27400000000000002},"max":{"1min":0.88400000000000001,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.754}]},{"osd":5,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.66800000000000004,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":2.04,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.69399999999999995,"15min":0.60999999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86899999999999999,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.61099999999999999,"15min":0.58599999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.79700000000000004,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.54100000000000004},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.309},"max":{"1min":2.0920000000000001,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed May 8 21:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.745,"15min":0.627},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.34399999999999997},"max":{"1min":0.83799999999999997,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.73399999999999999,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.35099999999999998},"max":{"1min":2.0659999999999998,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575183,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505452,"kb_used_data":37156,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866388,"statfs":{"total":96636764160,"available":96119181312,"internally_reserved":0,"allocated":38047744,"data_stored":37867820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.49099999999999999,"15min":0.42999999999999999},"min":{"1min":0.19500000000000001,"5min":0.19,"15min":0.16900000000000001},"max":{"1min":1.0549999999999999,"5min":6.407,"15min":6.407},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.69699999999999995,"15min":0.504},"min":{"1min":0.23200000000000001,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":1.2150000000000001,"5min":16.724,"15min":16.724},"last":0.57299999999999995}]},{"osd":1,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.86599999999999999,"15min":0.60299999999999998},"min":{"1min":0.20799999999999999,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":4.4740000000000002,"5min":13.058,"15min":15.259},"last":0.501},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.53700000000000003},"min":{"1min":0.249,"5min":0.217,"15min":0.192},"max":{"1min":4.2009999999999996,"5min":9.5370000000000008,"15min":10.831},"last":0.54400000000000004}]},{"osd":2,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.214},"max":{"1min":0.81799999999999995,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.70599999999999996,"15min":0.52900000000000003},"min":{"1min":0.29799999999999999,"5min":0.23999999999999999,"15min":0.224},"max":{"1min":5.6539999999999999,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.82699999999999996,"15min":0.71099999999999997},"min":{"1min":0.31,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82499999999999996,"5min":9.7759999999999998,"15min":9.7759999999999998},"last":0.622},{"interface":"front","average":{"1min":1.155,"5min":1.0700000000000001,"15min":0.81000000000000005},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":5.5549999999999997,"5min":11.755000000000001,"15min":15.224},"last":0.64200000000000002}]},{"osd":5,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0289999999999999,"5min":2.403,"15min":4.3860000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71299999999999997,"15min":0.63600000000000001},"min":{"1min":0.40899999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.6419999999999999,"5min":5.548,"15min":5.548},"last":0.752}]},{"osd":6,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.95099999999999996,"15min":0.70599999999999996},"min":{"1min":0.41399999999999998,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":5.5990000000000002,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.68400000000000005,"15min":0.621},"min":{"1min":0.39700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.997,"5min":4.1100000000000003,"15min":5.2530000000000001},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed May 8 21:21:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.85099999999999998,"15min":0.68400000000000005},"min":{"1min":0.39300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84799999999999998,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.212,"5min":1.0489999999999999,"15min":0.753},"min":{"1min":0.45500000000000002,"5min":0.39400000000000002,"15min":0.35599999999999998},"max":{"1min":5.6299999999999999,"5min":12.939,"15min":12.939},"last":0.73799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575183,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.61299999999999999,"15min":0.495},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.018,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.752},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.63,"15min":0.5},"min":{"1min":0.28199999999999997,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":9.4900000000000002,"5min":9.4900000000000002,"15min":9.4900000000000002},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":0.84199999999999997,"15min":0.56899999999999995},"min":{"1min":0.26400000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":18.529,"5min":18.529,"15min":18.529},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56200000000000006,"15min":0.54000000000000004},"min":{"1min":0.27800000000000002,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":2.129,"5min":7.343,"15min":7.4370000000000003},"last":0.57399999999999995}]},{"osd":2,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":0.77800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29399999999999998,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":15.917,"5min":15.917,"15min":15.917},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.35699999999999998,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":2.1579999999999999,"5min":3.9900000000000002,"15min":6.617},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.79000000000000004,"15min":0.60699999999999998},"min":{"1min":0.32900000000000001,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":9.3759999999999994,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.405,"5min":0.80400000000000005,"15min":0.61599999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28299999999999997},"max":{"1min":15.956,"5min":15.956,"15min":15.956},"last":0.79700000000000004}]},{"osd":5,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":0.67800000000000005,"15min":0.56899999999999995},"min":{"1min":0.249,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":15.766,"5min":15.766,"15min":15.766},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.69599999999999995,"15min":0.58799999999999997},"min":{"1min":0.35899999999999999,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":9.5259999999999998,"5min":9.5259999999999998,"15min":9.5259999999999998},"last":0.68000000000000005}]},{"osd":6,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":0.79700000000000004,"15min":0.622},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":18.463000000000001,"5min":18.463000000000001,"15min":18.463000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.621,"15min":0.63},"min":{"1min":0.35499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0469999999999999,"5min":5.0860000000000003,"15min":9.4550000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Wed May 8 21:21:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.74299999999999999,"15min":0.63200000000000001},"min":{"1min":0.38500000000000001,"5min":0.34899999999999998,"15min":0.28000000000000003},"max":{"1min":9.4320000000000004,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.621},{"interface":"front","average":{"1min":1.6120000000000001,"5min":0.88700000000000001,"15min":0.71899999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.315},"max":{"1min":18.5,"5min":18.5,"15min":18.5},"last":0.77000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575183,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544972,"kb_used_data":98884,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826868,"statfs":{"total":96636764160,"available":96078712832,"internally_reserved":0,"allocated":101257216,"data_stored":101075772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.54900000000000004,"15min":0.48699999999999999},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.17899999999999999},"max":{"1min":1.4299999999999999,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.66100000000000003,"15min":0.623},"min":{"1min":0.26500000000000001,"5min":0.22900000000000001,"15min":0.22800000000000001},"max":{"1min":1.276,"5min":9.2059999999999995,"15min":24.800000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.66000000000000003,"15min":0.626},"min":{"1min":0.222,"5min":0.218,"15min":0.215},"max":{"1min":2.2000000000000002,"5min":15.426,"15min":27.719000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.63300000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":1.9219999999999999,"5min":7.1399999999999997,"15min":24.826000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.65100000000000002,"15min":0.54900000000000004},"min":{"1min":0.34599999999999997,"5min":0.254,"15min":0.24099999999999999},"max":{"1min":5.9130000000000003,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.504},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.629,"15min":0.56599999999999995},"min":{"1min":0.29599999999999999,"5min":0.28699999999999998,"15min":0.24199999999999999},"max":{"1min":1.4590000000000001,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.629}]},{"osd":3,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75700000000000001,"15min":0.69399999999999995},"min":{"1min":0.308,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":4.8780000000000001,"5min":6.6559999999999997,"15min":24.606000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.73199999999999998,"15min":0.61799999999999999},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.253},"max":{"1min":3.165,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.62,"15min":0.81599999999999995},"min":{"1min":0.27000000000000002,"5min":0.248,"15min":0.22600000000000001},"max":{"1min":2.5409999999999999,"5min":10.319000000000001,"15min":71.634},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.79500000000000004,"15min":1.004},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":2.8380000000000001,"5min":10.032,"15min":101.794},"last":0.48899999999999999}]},{"osd":6,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.745,"15min":0.623},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.254},"max":{"1min":1.4730000000000001,"5min":14.997,"15min":14.997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.81200000000000006,"15min":0.72999999999999998},"min":{"1min":0.34899999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":2.3999999999999999,"5min":19.137,"15min":28.053999999999998},"last":0.61299999999999999}]},{"osd":7,"last update":"Wed May 8 21:21:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":1.5660000000000001,"15min":1.024},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.30499999999999999},"max":{"1min":1.399,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.577,"15min":1.006},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.31},"max":{"1min":2.4910000000000001,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82739200,"data_stored":82727906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100966400,"data_stored":100957360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:22:25.612 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:25.613 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:25.614 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:25.614 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T20:55:03.078897+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=55, tm_sec=3, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=21, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:22:25.614 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:22:32.282 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:32.286 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:45.615 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:22:45.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.748+0000 7fdd64f51700 1 Processor -- start 2024-05-08T21:22:45.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.748+0000 7fdd64f51700 1 -- start start 2024-05-08T21:22:45.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd64f51700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 0x7fdd600c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd64f51700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600c8780 con 0x7fdd601514b0 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd64f51700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6015b790 con 0x7fdd600cca80 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd64f51700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd601571e0 con 0x7fdd600c8980 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5e59c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7fdd601514b0 0x7fdd60157910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35656/0 (socket says 172.21.15.135:35656) 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5e59c700 1 -- 172.21.15.135:0/3496738567 learned_addr learned my addr 172.21.15.135:0/3496738567 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5dd9b700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 0x7fdd600c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219648579 0 0) 0x7fdd600c8780 con 0x7fdd601514b0 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd480035b0 con 0x7fdd601514b0 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2025376459 0 0) 0x7fdd480035b0 con 0x7fdd601514b0 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 msgr2=0x7fdd600c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 0x7fdd600c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 >> v1:172.21.15.183:6789/0 conn(0x7fdd600cca80 legacy=0x7fdd60161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:45.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6015ac10 con 0x7fdd601514b0 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7fdd50001670 con 0x7fdd601514b0 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.749+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 >> v1:172.21.15.135:6789/0 conn(0x7fdd601514b0 legacy=0x7fdd60157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48003a30 0x7fdd48003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 0x7fdd48004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd48004d90 0x7fdd48005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd601571e0 con 0x7fdd48004d90 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4800bb50 con 0x7fdd48003a30 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4800bd10 con 0x7fdd600c8980 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5ed9d700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd48004d90 0x7fdd48005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5e59c700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48003a30 0x7fdd48003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5dd9b700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 0x7fdd48004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5ed9d700 1 -- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 msgr2=0x7fdd48004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5ed9d700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd600c8980 0x7fdd48004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5ed9d700 1 -- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48003a30 msgr2=0x7fdd48003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5ed9d700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48003a30 0x7fdd48003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5ed9d700 1 -- 172.21.15.135:0/3496738567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480035b0 con 0x7fdd48004d90 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5ed9d700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd48004d90 0x7fdd48005210 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c160 tx=0x7fdd48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb2335e7bcd9a7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58001db0 con 0x7fdd48004d90 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800cca0 con 0x7fdd48004d90 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.750+0000 7fdd5d59a700 1 -- 172.21.15.135:0/3496738567 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58003c40 con 0x7fdd48004d90 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.751+0000 7fdd64f51700 1 -- 172.21.15.135:0/3496738567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd48004d90 msgr2=0x7fdd48005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.751+0000 7fdd64f51700 1 --2- 172.21.15.135:0/3496738567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd48004d90 0x7fdd48005210 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800c160 tx=0x7fdd48005880 comp rx=0 tx=0).stop 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.751+0000 7fdd5ed9d700 1 -- 172.21.15.135:0/3496738567 reap_dead start 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.751+0000 7fdd64f51700 1 -- 172.21.15.135:0/3496738567 shutdown_connections 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.751+0000 7fdd64f51700 1 -- 172.21.15.135:0/3496738567 >> 172.21.15.135:0/3496738567 conn(0x7fdd6006a960 msgr2=0x7fdd6006ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.751+0000 7fdd64f51700 1 -- 172.21.15.135:0/3496738567 shutdown_connections 2024-05-08T21:22:45.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.751+0000 7fdd64f51700 1 -- 172.21.15.135:0/3496738567 wait complete. 2024-05-08T21:22:45.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.752+0000 7fdd64f51700 1 Processor -- start 2024-05-08T21:22:45.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.752+0000 7fdd64f51700 1 -- start start 2024-05-08T21:22:45.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd64f51700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48004d90 0x7fdd601ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd64f51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd600c43f0 0x7fdd60151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd64f51700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6014d4c0 0x7fdd6014d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd64f51700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c56b0 con 0x7fdd600c43f0 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd64f51700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c5950 con 0x7fdd48004d90 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd64f51700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c5c30 con 0x7fdd6014d4c0 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd600c43f0 0x7fdd60151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd600c43f0 0x7fdd60151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49382/0 (socket says 172.21.15.135:49382) 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 -- 172.21.15.135:0/2755259791 learned_addr learned my addr 172.21.15.135:0/2755259791 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5ed9d700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6014d4c0 0x7fdd6014d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5e59c700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48004d90 0x7fdd601ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 -- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6014d4c0 msgr2=0x7fdd6014d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6014d4c0 0x7fdd6014d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 -- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48004d90 msgr2=0x7fdd601ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48004d90 0x7fdd601ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 -- 172.21.15.135:0/2755259791 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd601ece00 con 0x7fdd600c43f0 2024-05-08T21:22:45.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.753+0000 7fdd5dd9b700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd600c43f0 0x7fdd60151b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdd54011aa0 tx=0x7fdd54011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.754+0000 7fdd4effd700 1 -- 172.21.15.135:0/2755259791 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54011ed0 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.754+0000 7fdd4effd700 1 -- 172.21.15.135:0/2755259791 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400f940 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.754+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd601ed0e0 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.754+0000 7fdd4effd700 1 -- 172.21.15.135:0/2755259791 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400fcf0 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.754+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd600c5f10 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.755+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd60067fa0 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.755+0000 7fdd4effd700 1 -- 172.21.15.135:0/2755259791 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd54014440 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.755+0000 7fdd4effd700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdd4006ac90 0x7fdd4006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.756+0000 7fdd4effd700 1 -- 172.21.15.135:0/2755259791 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd54089d10 con 0x7fdd600c43f0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.756+0000 7fdd5e59c700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdd4006ac90 0x7fdd4006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:45.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.756+0000 7fdd5e59c700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdd4006ac90 0x7fdd4006d150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd50001c90 tx=0x7fdd50001c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:45.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.760+0000 7fdd4effd700 1 -- 172.21.15.135:0/2755259791 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdd54054bf0 con 0x7fdd600c43f0 2024-05-08T21:22:45.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.953+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 --> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd6015b4b0 con 0x7fdd4006ac90 2024-05-08T21:22:45.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.963+0000 7fdd4effd700 1 -- 172.21.15.135:0/2755259791 <== mgr.4104 v2:172.21.15.135:6832/46829 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+374765 (secure 0 0 0) 0x7fdd50007170 con 0x7fdd4006ac90 2024-05-08T21:22:45.970 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:22:45.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdd4006ac90 msgr2=0x7fdd4006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:45.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdd4006ac90 0x7fdd4006d150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd50001c90 tx=0x7fdd50001c00 comp rx=0 tx=0).stop 2024-05-08T21:22:45.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd600c43f0 msgr2=0x7fdd60151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:45.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd600c43f0 0x7fdd60151b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdd54011aa0 tx=0x7fdd54011db0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 shutdown_connections 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fdd4006ac90 0x7fdd4006d150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd48004d90 0x7fdd601ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6014d4c0 0x7fdd6014d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 --2- 172.21.15.135:0/2755259791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd600c43f0 0x7fdd60151b30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 >> 172.21.15.135:0/2755259791 conn(0x7fdd6006a960 msgr2=0x7fdd600b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 shutdown_connections 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:45.967+0000 7fdd64f51700 1 -- 172.21.15.135:0/2755259791 wait complete. 2024-05-08T21:22:45.974 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-05-08T21:22:45.982 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":859,"stamp":"2024-05-08T21:22:44.842133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":244155444,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":3047,"num_read_kb":7630,"num_write":179646,"num_write_kb":3998170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":257560,"ondisk_log_size":257560,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3868776,"kb_used_data":479208,"kb_used_omap":12,"kb_used_meta":3389491,"kb_avail":751105944,"statfs":{"total":773094113280,"available":769132486656,"internally_reserved":0,"allocated":490708992,"data_stored":489258184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":3470839353},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003551"},"pg_stats":[{"pgid":"3.3f","version":"27'774","reported_seq":815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:12.425025+0000","last_change":"2024-05-08T21:22:12.425159+0000","last_active":"2024-05-08T21:22:12.425025+0000","last_peered":"2024-05-08T21:22:12.425025+0000","last_clean":"2024-05-08T21:22:12.425025+0000","last_became_active":"2024-05-08T20:55:00.096058+0000","last_became_peered":"2024-05-08T20:55:00.096058+0000","last_unstale":"2024-05-08T21:22:12.425025+0000","last_undegraded":"2024-05-08T21:22:12.425025+0000","last_fullsized":"2024-05-08T21:22:12.425025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'774","last_scrub_stamp":"2024-05-08T21:22:12.424995+0000","last_deep_scrub":"27'774","last_deep_scrub_stamp":"2024-05-08T21:22:12.424995+0000","last_clean_scrub_stamp":"2024-05-08T21:22:12.424995+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:11.385722+0000","scrub_duration":0.0096575919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"27'772","reported_seq":812,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:49.932891+0000","last_change":"2024-05-08T21:21:49.932891+0000","last_active":"2024-05-08T21:21:49.932891+0000","last_peered":"2024-05-08T21:21:49.932891+0000","last_clean":"2024-05-08T21:21:49.932891+0000","last_became_active":"2024-05-08T20:55:00.089555+0000","last_became_peered":"2024-05-08T20:55:00.089555+0000","last_unstale":"2024-05-08T21:21:49.932891+0000","last_undegraded":"2024-05-08T21:21:49.932891+0000","last_fullsized":"2024-05-08T21:21:49.932891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'772","last_scrub_stamp":"2024-05-08T21:21:49.932752+0000","last_deep_scrub":"27'772","last_deep_scrub_stamp":"2024-05-08T21:21:49.932752+0000","last_clean_scrub_stamp":"2024-05-08T21:21:49.932752+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:13.196819+0000","scrub_duration":0.0068780669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"27'862","reported_seq":903,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.036948+0000","last_change":"2024-05-08T21:21:30.036948+0000","last_active":"2024-05-08T21:21:30.036948+0000","last_peered":"2024-05-08T21:21:30.036948+0000","last_clean":"2024-05-08T21:21:30.036948+0000","last_became_active":"2024-05-08T20:55:00.089199+0000","last_became_peered":"2024-05-08T20:55:00.089199+0000","last_unstale":"2024-05-08T21:21:30.036948+0000","last_undegraded":"2024-05-08T21:21:30.036948+0000","last_fullsized":"2024-05-08T21:21:30.036948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'862","last_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_deep_scrub":"27'862","last_deep_scrub_stamp":"2024-05-08T21:21:30.036832+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.036832+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:55.453142+0000","scrub_duration":0.0074728939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'823","reported_seq":863,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.751890+0000","last_change":"2024-05-08T21:21:27.751988+0000","last_active":"2024-05-08T21:21:27.751890+0000","last_peered":"2024-05-08T21:21:27.751890+0000","last_clean":"2024-05-08T21:21:27.751890+0000","last_became_active":"2024-05-08T20:55:00.092118+0000","last_became_peered":"2024-05-08T20:55:00.092118+0000","last_unstale":"2024-05-08T21:21:27.751890+0000","last_undegraded":"2024-05-08T21:21:27.751890+0000","last_fullsized":"2024-05-08T21:21:27.751890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'823","last_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_deep_scrub":"27'823","last_deep_scrub_stamp":"2024-05-08T21:21:27.751862+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.751862+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.537249+0000","scrub_duration":0.0019687749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'860","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:02.419182+0000","last_change":"2024-05-08T21:22:02.419182+0000","last_active":"2024-05-08T21:22:02.419182+0000","last_peered":"2024-05-08T21:22:02.419182+0000","last_clean":"2024-05-08T21:22:02.419182+0000","last_became_active":"2024-05-08T20:55:00.093441+0000","last_became_peered":"2024-05-08T20:55:00.093441+0000","last_unstale":"2024-05-08T21:22:02.419182+0000","last_undegraded":"2024-05-08T21:22:02.419182+0000","last_fullsized":"2024-05-08T21:22:02.419182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'860","last_scrub_stamp":"2024-05-08T21:22:02.419027+0000","last_deep_scrub":"27'860","last_deep_scrub_stamp":"2024-05-08T21:22:02.419027+0000","last_clean_scrub_stamp":"2024-05-08T21:22:02.419027+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:11.298342+0000","scrub_duration":0.011455531999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'767","reported_seq":805,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:02.881692+0000","last_change":"2024-05-08T21:22:02.881692+0000","last_active":"2024-05-08T21:22:02.881692+0000","last_peered":"2024-05-08T21:22:02.881692+0000","last_clean":"2024-05-08T21:22:02.881692+0000","last_became_active":"2024-05-08T20:55:00.091837+0000","last_became_peered":"2024-05-08T20:55:00.091837+0000","last_unstale":"2024-05-08T21:22:02.881692+0000","last_undegraded":"2024-05-08T21:22:02.881692+0000","last_fullsized":"2024-05-08T21:22:02.881692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'767","last_scrub_stamp":"2024-05-08T21:22:02.881541+0000","last_deep_scrub":"27'767","last_deep_scrub_stamp":"2024-05-08T21:22:02.881541+0000","last_clean_scrub_stamp":"2024-05-08T21:22:02.881541+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:15.993754+0000","scrub_duration":0.0037850589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'811","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.339570+0000","last_change":"2024-05-08T21:21:57.339570+0000","last_active":"2024-05-08T21:21:57.339570+0000","last_peered":"2024-05-08T21:21:57.339570+0000","last_clean":"2024-05-08T21:21:57.339570+0000","last_became_active":"2024-05-08T20:55:00.102314+0000","last_became_peered":"2024-05-08T20:55:00.102314+0000","last_unstale":"2024-05-08T21:21:57.339570+0000","last_undegraded":"2024-05-08T21:21:57.339570+0000","last_fullsized":"2024-05-08T21:21:57.339570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'811","last_scrub_stamp":"2024-05-08T21:21:57.339438+0000","last_deep_scrub":"27'811","last_deep_scrub_stamp":"2024-05-08T21:21:57.339438+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.339438+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:55.528420+0000","scrub_duration":0.0020686020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"27'788","reported_seq":827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:53.904335+0000","last_change":"2024-05-08T21:21:53.904335+0000","last_active":"2024-05-08T21:21:53.904335+0000","last_peered":"2024-05-08T21:21:53.904335+0000","last_clean":"2024-05-08T21:21:53.904335+0000","last_became_active":"2024-05-08T20:55:00.098449+0000","last_became_peered":"2024-05-08T20:55:00.098449+0000","last_unstale":"2024-05-08T21:21:53.904335+0000","last_undegraded":"2024-05-08T21:21:53.904335+0000","last_fullsized":"2024-05-08T21:21:53.904335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'788","last_scrub_stamp":"2024-05-08T21:21:53.904193+0000","last_deep_scrub":"27'788","last_deep_scrub_stamp":"2024-05-08T21:21:53.904193+0000","last_clean_scrub_stamp":"2024-05-08T21:21:53.904193+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:49.742590+0000","scrub_duration":0.0021721689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"27'846","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:09.421915+0000","last_change":"2024-05-08T21:22:09.422021+0000","last_active":"2024-05-08T21:22:09.421915+0000","last_peered":"2024-05-08T21:22:09.421915+0000","last_clean":"2024-05-08T21:22:09.421915+0000","last_became_active":"2024-05-08T20:55:00.095446+0000","last_became_peered":"2024-05-08T20:55:00.095446+0000","last_unstale":"2024-05-08T21:22:09.421915+0000","last_undegraded":"2024-05-08T21:22:09.421915+0000","last_fullsized":"2024-05-08T21:22:09.421915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'846","last_scrub_stamp":"2024-05-08T21:22:09.421887+0000","last_deep_scrub":"27'846","last_deep_scrub_stamp":"2024-05-08T21:22:09.421887+0000","last_clean_scrub_stamp":"2024-05-08T21:22:09.421887+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:46.494698+0000","scrub_duration":0.0057582989999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"27'809","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:54.921077+0000","last_change":"2024-05-08T21:21:54.921177+0000","last_active":"2024-05-08T21:21:54.921077+0000","last_peered":"2024-05-08T21:21:54.921077+0000","last_clean":"2024-05-08T21:21:54.921077+0000","last_became_active":"2024-05-08T20:55:00.096998+0000","last_became_peered":"2024-05-08T20:55:00.096998+0000","last_unstale":"2024-05-08T21:21:54.921077+0000","last_undegraded":"2024-05-08T21:21:54.921077+0000","last_fullsized":"2024-05-08T21:21:54.921077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:54.921049+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:54.921049+0000","last_clean_scrub_stamp":"2024-05-08T21:21:54.921049+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:03.800363+0000","scrub_duration":0.0031844239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"27'819","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.996816+0000","last_change":"2024-05-08T21:21:42.996970+0000","last_active":"2024-05-08T21:21:42.996816+0000","last_peered":"2024-05-08T21:21:42.996816+0000","last_clean":"2024-05-08T21:21:42.996816+0000","last_became_active":"2024-05-08T20:55:00.097834+0000","last_became_peered":"2024-05-08T20:55:00.097834+0000","last_unstale":"2024-05-08T21:21:42.996816+0000","last_undegraded":"2024-05-08T21:21:42.996816+0000","last_fullsized":"2024-05-08T21:21:42.996816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:42.996772+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:42.996772+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.996772+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:06.260839+0000","scrub_duration":0.0065513519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'794","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.413622+0000","last_change":"2024-05-08T21:21:45.413781+0000","last_active":"2024-05-08T21:21:45.413622+0000","last_peered":"2024-05-08T21:21:45.413622+0000","last_clean":"2024-05-08T21:21:45.413622+0000","last_became_active":"2024-05-08T20:55:00.082143+0000","last_became_peered":"2024-05-08T20:55:00.082143+0000","last_unstale":"2024-05-08T21:21:45.413622+0000","last_undegraded":"2024-05-08T21:21:45.413622+0000","last_fullsized":"2024-05-08T21:21:45.413622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'794","last_scrub_stamp":"2024-05-08T21:21:45.413576+0000","last_deep_scrub":"27'794","last_deep_scrub_stamp":"2024-05-08T21:21:45.413576+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.413576+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:40.286412+0000","scrub_duration":0.0018887540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"27'813","reported_seq":852,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.863029+0000","last_change":"2024-05-08T21:21:25.863029+0000","last_active":"2024-05-08T21:21:25.863029+0000","last_peered":"2024-05-08T21:21:25.863029+0000","last_clean":"2024-05-08T21:21:25.863029+0000","last_became_active":"2024-05-08T20:55:00.086170+0000","last_became_peered":"2024-05-08T20:55:00.086170+0000","last_unstale":"2024-05-08T21:21:25.863029+0000","last_undegraded":"2024-05-08T21:21:25.863029+0000","last_fullsized":"2024-05-08T21:21:25.863029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'813","last_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_deep_scrub":"27'813","last_deep_scrub_stamp":"2024-05-08T21:21:25.862894+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.862894+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:16.467912+0000","scrub_duration":0.0075367910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"27'802","reported_seq":841,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.062238+0000","last_change":"2024-05-08T21:21:42.062360+0000","last_active":"2024-05-08T21:21:42.062238+0000","last_peered":"2024-05-08T21:21:42.062238+0000","last_clean":"2024-05-08T21:21:42.062238+0000","last_became_active":"2024-05-08T20:55:00.087908+0000","last_became_peered":"2024-05-08T20:55:00.087908+0000","last_unstale":"2024-05-08T21:21:42.062238+0000","last_undegraded":"2024-05-08T21:21:42.062238+0000","last_fullsized":"2024-05-08T21:21:42.062238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'802","last_scrub_stamp":"2024-05-08T21:21:42.062211+0000","last_deep_scrub":"27'802","last_deep_scrub_stamp":"2024-05-08T21:21:42.062211+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.062211+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:36.935046+0000","scrub_duration":0.0040292820000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'853","reported_seq":891,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:53.855569+0000","last_change":"2024-05-08T21:21:53.855702+0000","last_active":"2024-05-08T21:21:53.855569+0000","last_peered":"2024-05-08T21:21:53.855569+0000","last_clean":"2024-05-08T21:21:53.855569+0000","last_became_active":"2024-05-08T20:55:00.073848+0000","last_became_peered":"2024-05-08T20:55:00.073848+0000","last_unstale":"2024-05-08T21:21:53.855569+0000","last_undegraded":"2024-05-08T21:21:53.855569+0000","last_fullsized":"2024-05-08T21:21:53.855569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'853","last_scrub_stamp":"2024-05-08T21:21:53.855539+0000","last_deep_scrub":"27'853","last_deep_scrub_stamp":"2024-05-08T21:21:53.855539+0000","last_clean_scrub_stamp":"2024-05-08T21:21:53.855539+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:10.074609+0000","scrub_duration":0.0073019199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"27'809","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.736377+0000","last_change":"2024-05-08T21:21:25.736503+0000","last_active":"2024-05-08T21:21:25.736377+0000","last_peered":"2024-05-08T21:21:25.736377+0000","last_clean":"2024-05-08T21:21:25.736377+0000","last_became_active":"2024-05-08T20:55:00.091346+0000","last_became_peered":"2024-05-08T20:55:00.091346+0000","last_unstale":"2024-05-08T21:21:25.736377+0000","last_undegraded":"2024-05-08T21:21:25.736377+0000","last_fullsized":"2024-05-08T21:21:25.736377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:25.736348+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.736348+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:53.810852+0000","scrub_duration":0.00189824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"27'870","reported_seq":908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:48.736103+0000","last_change":"2024-05-08T21:21:48.736241+0000","last_active":"2024-05-08T21:21:48.736103+0000","last_peered":"2024-05-08T21:21:48.736103+0000","last_clean":"2024-05-08T21:21:48.736103+0000","last_became_active":"2024-05-08T20:55:00.102583+0000","last_became_peered":"2024-05-08T20:55:00.102583+0000","last_unstale":"2024-05-08T21:21:48.736103+0000","last_undegraded":"2024-05-08T21:21:48.736103+0000","last_fullsized":"2024-05-08T21:21:48.736103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'870","last_scrub_stamp":"2024-05-08T21:21:48.736071+0000","last_deep_scrub":"27'870","last_deep_scrub_stamp":"2024-05-08T21:21:48.736071+0000","last_clean_scrub_stamp":"2024-05-08T21:21:48.736071+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:35.037429+0000","scrub_duration":0.0071336680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"27'789","reported_seq":828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.635345+0000","last_change":"2024-05-08T21:21:29.635458+0000","last_active":"2024-05-08T21:21:29.635345+0000","last_peered":"2024-05-08T21:21:29.635345+0000","last_clean":"2024-05-08T21:21:29.635345+0000","last_became_active":"2024-05-08T20:55:00.080834+0000","last_became_peered":"2024-05-08T20:55:00.080834+0000","last_unstale":"2024-05-08T21:21:29.635345+0000","last_undegraded":"2024-05-08T21:21:29.635345+0000","last_fullsized":"2024-05-08T21:21:29.635345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'789","last_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_deep_scrub":"27'789","last_deep_scrub_stamp":"2024-05-08T21:21:29.635318+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.635318+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:25.420704+0000","scrub_duration":0.002176664,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:14.456425+0000","last_change":"2024-05-08T21:22:14.456521+0000","last_active":"2024-05-08T21:22:14.456425+0000","last_peered":"2024-05-08T21:22:14.456425+0000","last_clean":"2024-05-08T21:22:14.456425+0000","last_became_active":"2024-05-08T20:55:00.094156+0000","last_became_peered":"2024-05-08T20:55:00.094156+0000","last_unstale":"2024-05-08T21:22:14.456425+0000","last_undegraded":"2024-05-08T21:22:14.456425+0000","last_fullsized":"2024-05-08T21:22:14.456425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:22:14.456399+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:22:14.456399+0000","last_clean_scrub_stamp":"2024-05-08T21:22:14.456399+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:38.319500+0000","scrub_duration":0.0072349060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"27'3785","reported_seq":3822,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:11.066250+0000","last_change":"2024-05-08T21:22:11.066409+0000","last_active":"2024-05-08T21:22:11.066250+0000","last_peered":"2024-05-08T21:22:11.066250+0000","last_clean":"2024-05-08T21:22:11.066250+0000","last_became_active":"2024-05-08T20:55:04.215204+0000","last_became_peered":"2024-05-08T20:55:04.215204+0000","last_unstale":"2024-05-08T21:22:11.066250+0000","last_undegraded":"2024-05-08T21:22:11.066250+0000","last_fullsized":"2024-05-08T21:22:11.066250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3785","last_scrub_stamp":"2024-05-08T21:22:11.066225+0000","last_deep_scrub":"27'3785","last_deep_scrub_stamp":"2024-05-08T21:22:11.066225+0000","last_clean_scrub_stamp":"2024-05-08T21:22:11.066225+0000","objects_scrubbed":0,"log_size":3785,"log_dups_size":0,"ondisk_log_size":3785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:15.583450+0000","scrub_duration":0.019995764999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2948,"num_write_kb":119578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"27'1871","reported_seq":1913,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.072592+0000","last_change":"2024-05-08T21:21:22.072592+0000","last_active":"2024-05-08T21:21:22.072592+0000","last_peered":"2024-05-08T21:21:22.072592+0000","last_clean":"2024-05-08T21:21:22.072592+0000","last_became_active":"2024-05-08T20:54:59.627199+0000","last_became_peered":"2024-05-08T20:54:59.627199+0000","last_unstale":"2024-05-08T21:21:22.072592+0000","last_undegraded":"2024-05-08T21:21:22.072592+0000","last_fullsized":"2024-05-08T21:21:22.072592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1871","last_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_deep_scrub":"27'1871","last_deep_scrub_stamp":"2024-05-08T21:21:22.072441+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.072441+0000","objects_scrubbed":3,"log_size":1871,"log_dups_size":0,"ondisk_log_size":1871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:17.857827+0000","scrub_duration":0.015741767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1881,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'809","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.904062+0000","last_change":"2024-05-08T21:21:27.904160+0000","last_active":"2024-05-08T21:21:27.904062+0000","last_peered":"2024-05-08T21:21:27.904062+0000","last_clean":"2024-05-08T21:21:27.904062+0000","last_became_active":"2024-05-08T20:55:00.085124+0000","last_became_peered":"2024-05-08T20:55:00.085124+0000","last_unstale":"2024-05-08T21:21:27.904062+0000","last_undegraded":"2024-05-08T21:21:27.904062+0000","last_fullsized":"2024-05-08T21:21:27.904062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'809","last_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_deep_scrub":"27'809","last_deep_scrub_stamp":"2024-05-08T21:21:27.904035+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.904035+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:23.689421+0000","scrub_duration":0.0050121590000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'3695","reported_seq":3732,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:54.480851+0000","last_change":"2024-05-08T21:21:54.481012+0000","last_active":"2024-05-08T21:21:54.480851+0000","last_peered":"2024-05-08T21:21:54.480851+0000","last_clean":"2024-05-08T21:21:54.480851+0000","last_became_active":"2024-05-08T20:55:04.110273+0000","last_became_peered":"2024-05-08T20:55:04.110273+0000","last_unstale":"2024-05-08T21:21:54.480851+0000","last_undegraded":"2024-05-08T21:21:54.480851+0000","last_fullsized":"2024-05-08T21:21:54.480851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3695","last_scrub_stamp":"2024-05-08T21:21:54.480824+0000","last_deep_scrub":"27'3695","last_deep_scrub_stamp":"2024-05-08T21:21:54.480824+0000","last_clean_scrub_stamp":"2024-05-08T21:21:54.480824+0000","objects_scrubbed":0,"log_size":3695,"log_dups_size":0,"ondisk_log_size":3695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:10.699893+0000","scrub_duration":0.014220731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2849,"num_write_kb":125239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"27'4026","reported_seq":4068,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.919821+0000","last_change":"2024-05-08T21:21:28.919926+0000","last_active":"2024-05-08T21:21:28.919821+0000","last_peered":"2024-05-08T21:21:28.919821+0000","last_clean":"2024-05-08T21:21:28.919821+0000","last_became_active":"2024-05-08T20:54:59.627778+0000","last_became_peered":"2024-05-08T20:54:59.627778+0000","last_unstale":"2024-05-08T21:21:28.919821+0000","last_undegraded":"2024-05-08T21:21:28.919821+0000","last_fullsized":"2024-05-08T21:21:28.919821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4026","last_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_deep_scrub":"27'4026","last_deep_scrub_stamp":"2024-05-08T21:21:28.919793+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.919793+0000","objects_scrubbed":1,"log_size":4026,"log_dups_size":0,"ondisk_log_size":4026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.835728+0000","scrub_duration":0.016721056000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4027,"num_write_kb":30491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'779","reported_seq":820,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.014532+0000","last_change":"2024-05-08T21:21:47.014532+0000","last_active":"2024-05-08T21:21:47.014532+0000","last_peered":"2024-05-08T21:21:47.014532+0000","last_clean":"2024-05-08T21:21:47.014532+0000","last_became_active":"2024-05-08T20:55:00.097318+0000","last_became_peered":"2024-05-08T20:55:00.097318+0000","last_unstale":"2024-05-08T21:21:47.014532+0000","last_undegraded":"2024-05-08T21:21:47.014532+0000","last_fullsized":"2024-05-08T21:21:47.014532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-05-08T21:21:47.014362+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-05-08T21:21:47.014362+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.014362+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:42.852759+0000","scrub_duration":0.0082407149999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3632","reported_seq":3669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:27.451795+0000","last_change":"2024-05-08T21:22:27.451795+0000","last_active":"2024-05-08T21:22:27.451795+0000","last_peered":"2024-05-08T21:22:27.451795+0000","last_clean":"2024-05-08T21:22:27.451795+0000","last_became_active":"2024-05-08T20:55:04.109612+0000","last_became_peered":"2024-05-08T20:55:04.109612+0000","last_unstale":"2024-05-08T21:22:27.451795+0000","last_undegraded":"2024-05-08T21:22:27.451795+0000","last_fullsized":"2024-05-08T21:22:27.451795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3632","last_scrub_stamp":"2024-05-08T21:22:27.451604+0000","last_deep_scrub":"27'3632","last_deep_scrub_stamp":"2024-05-08T21:22:27.451604+0000","last_clean_scrub_stamp":"2024-05-08T21:22:27.451604+0000","objects_scrubbed":0,"log_size":3632,"log_dups_size":0,"ondisk_log_size":3632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:14.853222+0000","scrub_duration":0.013541477,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":76911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'4865","reported_seq":4905,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.241523+0000","last_change":"2024-05-08T21:21:50.241523+0000","last_active":"2024-05-08T21:21:50.241523+0000","last_peered":"2024-05-08T21:21:50.241523+0000","last_clean":"2024-05-08T21:21:50.241523+0000","last_became_active":"2024-05-08T20:54:59.633765+0000","last_became_peered":"2024-05-08T20:54:59.633765+0000","last_unstale":"2024-05-08T21:21:50.241523+0000","last_undegraded":"2024-05-08T21:21:50.241523+0000","last_fullsized":"2024-05-08T21:21:50.241523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4865","last_scrub_stamp":"2024-05-08T21:21:50.241390+0000","last_deep_scrub":"27'4865","last_deep_scrub_stamp":"2024-05-08T21:21:50.241390+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.241390+0000","objects_scrubbed":3,"log_size":4865,"log_dups_size":0,"ondisk_log_size":4865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:25.583510+0000","scrub_duration":0.029835649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4865,"num_write_kb":35017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'861","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:10.934168+0000","last_change":"2024-05-08T21:22:10.934168+0000","last_active":"2024-05-08T21:22:10.934168+0000","last_peered":"2024-05-08T21:22:10.934168+0000","last_clean":"2024-05-08T21:22:10.934168+0000","last_became_active":"2024-05-08T20:55:00.089464+0000","last_became_peered":"2024-05-08T20:55:00.089464+0000","last_unstale":"2024-05-08T21:22:10.934168+0000","last_undegraded":"2024-05-08T21:22:10.934168+0000","last_fullsized":"2024-05-08T21:22:10.934168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'861","last_scrub_stamp":"2024-05-08T21:22:10.934028+0000","last_deep_scrub":"27'861","last_deep_scrub_stamp":"2024-05-08T21:22:10.934028+0000","last_clean_scrub_stamp":"2024-05-08T21:22:10.934028+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:48.006838+0000","scrub_duration":0.0016026289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'3447","reported_seq":3484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:56.503623+0000","last_change":"2024-05-08T21:21:56.503623+0000","last_active":"2024-05-08T21:21:56.503623+0000","last_peered":"2024-05-08T21:21:56.503623+0000","last_clean":"2024-05-08T21:21:56.503623+0000","last_became_active":"2024-05-08T20:55:04.109210+0000","last_became_peered":"2024-05-08T20:55:04.109210+0000","last_unstale":"2024-05-08T21:21:56.503623+0000","last_undegraded":"2024-05-08T21:21:56.503623+0000","last_fullsized":"2024-05-08T21:21:56.503623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3447","last_scrub_stamp":"2024-05-08T21:21:56.503441+0000","last_deep_scrub":"27'3447","last_deep_scrub_stamp":"2024-05-08T21:21:56.503441+0000","last_clean_scrub_stamp":"2024-05-08T21:21:56.503441+0000","objects_scrubbed":0,"log_size":3447,"log_dups_size":0,"ondisk_log_size":3447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:54.692423+0000","scrub_duration":0.016081088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2658,"num_write_kb":59757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'1177","reported_seq":1217,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.088912+0000","last_change":"2024-05-08T21:21:44.088912+0000","last_active":"2024-05-08T21:21:44.088912+0000","last_peered":"2024-05-08T21:21:44.088912+0000","last_clean":"2024-05-08T21:21:44.088912+0000","last_became_active":"2024-05-08T20:54:59.629861+0000","last_became_peered":"2024-05-08T20:54:59.629861+0000","last_unstale":"2024-05-08T21:21:44.088912+0000","last_undegraded":"2024-05-08T21:21:44.088912+0000","last_fullsized":"2024-05-08T21:21:44.088912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1177","last_scrub_stamp":"2024-05-08T21:21:44.088787+0000","last_deep_scrub":"27'1177","last_deep_scrub_stamp":"2024-05-08T21:21:44.088787+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.088787+0000","objects_scrubbed":2,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:23.965184+0000","scrub_duration":0.014020988999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1181,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'834","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:08.947082+0000","last_change":"2024-05-08T21:22:08.947082+0000","last_active":"2024-05-08T21:22:08.947082+0000","last_peered":"2024-05-08T21:22:08.947082+0000","last_clean":"2024-05-08T21:22:08.947082+0000","last_became_active":"2024-05-08T20:55:00.089503+0000","last_became_peered":"2024-05-08T20:55:00.089503+0000","last_unstale":"2024-05-08T21:22:08.947082+0000","last_undegraded":"2024-05-08T21:22:08.947082+0000","last_fullsized":"2024-05-08T21:22:08.947082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'834","last_scrub_stamp":"2024-05-08T21:22:08.946954+0000","last_deep_scrub":"27'834","last_deep_scrub_stamp":"2024-05-08T21:22:08.946954+0000","last_clean_scrub_stamp":"2024-05-08T21:22:08.946954+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:21.578076+0000","scrub_duration":0.0035358989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3550","reported_seq":3587,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:12.099689+0000","last_change":"2024-05-08T21:22:12.099689+0000","last_active":"2024-05-08T21:22:12.099689+0000","last_peered":"2024-05-08T21:22:12.099689+0000","last_clean":"2024-05-08T21:22:12.099689+0000","last_became_active":"2024-05-08T20:55:04.108935+0000","last_became_peered":"2024-05-08T20:55:04.108935+0000","last_unstale":"2024-05-08T21:22:12.099689+0000","last_undegraded":"2024-05-08T21:22:12.099689+0000","last_fullsized":"2024-05-08T21:22:12.099689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3550","last_scrub_stamp":"2024-05-08T21:22:12.099498+0000","last_deep_scrub":"27'3550","last_deep_scrub_stamp":"2024-05-08T21:22:12.099498+0000","last_clean_scrub_stamp":"2024-05-08T21:22:12.099498+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:11.060224+0000","scrub_duration":0.018093129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2677,"num_write_kb":112596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"27'2317","reported_seq":2357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.926575+0000","last_change":"2024-05-08T21:21:29.926575+0000","last_active":"2024-05-08T21:21:29.926575+0000","last_peered":"2024-05-08T21:21:29.926575+0000","last_clean":"2024-05-08T21:21:29.926575+0000","last_became_active":"2024-05-08T20:54:59.628921+0000","last_became_peered":"2024-05-08T20:54:59.628921+0000","last_unstale":"2024-05-08T21:21:29.926575+0000","last_undegraded":"2024-05-08T21:21:29.926575+0000","last_fullsized":"2024-05-08T21:21:29.926575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2317","last_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_deep_scrub":"27'2317","last_deep_scrub_stamp":"2024-05-08T21:21:29.926468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.926468+0000","objects_scrubbed":2,"log_size":2317,"log_dups_size":0,"ondisk_log_size":2317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.064661+0000","scrub_duration":0.024143202999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'829","reported_seq":868,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.066489+0000","last_change":"2024-05-08T21:21:31.066489+0000","last_active":"2024-05-08T21:21:31.066489+0000","last_peered":"2024-05-08T21:21:31.066489+0000","last_clean":"2024-05-08T21:21:31.066489+0000","last_became_active":"2024-05-08T20:55:00.074382+0000","last_became_peered":"2024-05-08T20:55:00.074382+0000","last_unstale":"2024-05-08T21:21:31.066489+0000","last_undegraded":"2024-05-08T21:21:31.066489+0000","last_fullsized":"2024-05-08T21:21:31.066489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'829","last_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_deep_scrub":"27'829","last_deep_scrub_stamp":"2024-05-08T21:21:31.066360+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.066360+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:42.055961+0000","scrub_duration":0.0042842599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'3534","reported_seq":3571,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.608460+0000","last_change":"2024-05-08T21:21:30.608460+0000","last_active":"2024-05-08T21:21:30.608460+0000","last_peered":"2024-05-08T21:21:30.608460+0000","last_clean":"2024-05-08T21:21:30.608460+0000","last_became_active":"2024-05-08T20:55:04.109814+0000","last_became_peered":"2024-05-08T20:55:04.109814+0000","last_unstale":"2024-05-08T21:21:30.608460+0000","last_undegraded":"2024-05-08T21:21:30.608460+0000","last_fullsized":"2024-05-08T21:21:30.608460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3534","last_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_deep_scrub":"27'3534","last_deep_scrub_stamp":"2024-05-08T21:21:30.608289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.608289+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":0,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:43.524223+0000","scrub_duration":0.017888930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2692,"num_write_kb":107139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4378","reported_seq":4417,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.988284+0000","last_change":"2024-05-08T21:21:24.988284+0000","last_active":"2024-05-08T21:21:24.988284+0000","last_peered":"2024-05-08T21:21:24.988284+0000","last_clean":"2024-05-08T21:21:24.988284+0000","last_became_active":"2024-05-08T20:54:59.629234+0000","last_became_peered":"2024-05-08T20:54:59.629234+0000","last_unstale":"2024-05-08T21:21:24.988284+0000","last_undegraded":"2024-05-08T21:21:24.988284+0000","last_fullsized":"2024-05-08T21:21:24.988284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4378","last_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_deep_scrub":"27'4378","last_deep_scrub_stamp":"2024-05-08T21:21:24.988136+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.988136+0000","objects_scrubbed":2,"log_size":4378,"log_dups_size":0,"ondisk_log_size":4378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:34:35.977737+0000","scrub_duration":0.026713068999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4382,"num_write_kb":34889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'818","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.076253+0000","last_change":"2024-05-08T21:21:29.076253+0000","last_active":"2024-05-08T21:21:29.076253+0000","last_peered":"2024-05-08T21:21:29.076253+0000","last_clean":"2024-05-08T21:21:29.076253+0000","last_became_active":"2024-05-08T20:55:00.093381+0000","last_became_peered":"2024-05-08T20:55:00.093381+0000","last_unstale":"2024-05-08T21:21:29.076253+0000","last_undegraded":"2024-05-08T21:21:29.076253+0000","last_fullsized":"2024-05-08T21:21:29.076253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:29.076108+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.076108+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:53.637005+0000","scrub_duration":0.0043393650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"27'3609","reported_seq":3648,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:19.559046+0000","last_change":"2024-05-08T21:22:19.559221+0000","last_active":"2024-05-08T21:22:19.559046+0000","last_peered":"2024-05-08T21:22:19.559046+0000","last_clean":"2024-05-08T21:22:19.559046+0000","last_became_active":"2024-05-08T20:55:04.105872+0000","last_became_peered":"2024-05-08T20:55:04.105872+0000","last_unstale":"2024-05-08T21:22:19.559046+0000","last_undegraded":"2024-05-08T21:22:19.559046+0000","last_fullsized":"2024-05-08T21:22:19.559046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3609","last_scrub_stamp":"2024-05-08T21:22:19.559020+0000","last_deep_scrub":"27'3609","last_deep_scrub_stamp":"2024-05-08T21:22:19.559020+0000","last_clean_scrub_stamp":"2024-05-08T21:22:19.559020+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:06.960639+0000","scrub_duration":0.014314807000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":191023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"27'1717","reported_seq":1757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.960412+0000","last_change":"2024-05-08T21:21:30.960412+0000","last_active":"2024-05-08T21:21:30.960412+0000","last_peered":"2024-05-08T21:21:30.960412+0000","last_clean":"2024-05-08T21:21:30.960412+0000","last_became_active":"2024-05-08T20:54:59.630114+0000","last_became_peered":"2024-05-08T20:54:59.630114+0000","last_unstale":"2024-05-08T21:21:30.960412+0000","last_undegraded":"2024-05-08T21:21:30.960412+0000","last_fullsized":"2024-05-08T21:21:30.960412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1717","last_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_deep_scrub":"27'1717","last_deep_scrub_stamp":"2024-05-08T21:21:30.960286+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.960286+0000","objects_scrubbed":2,"log_size":1717,"log_dups_size":0,"ondisk_log_size":1717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.942541+0000","scrub_duration":0.026136829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":13092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'881","reported_seq":920,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.980335+0000","last_change":"2024-05-08T21:21:32.980335+0000","last_active":"2024-05-08T21:21:32.980335+0000","last_peered":"2024-05-08T21:21:32.980335+0000","last_clean":"2024-05-08T21:21:32.980335+0000","last_became_active":"2024-05-08T20:55:00.086322+0000","last_became_peered":"2024-05-08T20:55:00.086322+0000","last_unstale":"2024-05-08T21:21:32.980335+0000","last_undegraded":"2024-05-08T21:21:32.980335+0000","last_fullsized":"2024-05-08T21:21:32.980335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'881","last_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_deep_scrub":"27'881","last_deep_scrub_stamp":"2024-05-08T21:21:32.980155+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.980155+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:57.541052+0000","scrub_duration":0.0015580380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'3549","reported_seq":3588,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.043015+0000","last_change":"2024-05-08T21:21:57.043200+0000","last_active":"2024-05-08T21:21:57.043015+0000","last_peered":"2024-05-08T21:21:57.043015+0000","last_clean":"2024-05-08T21:21:57.043015+0000","last_became_active":"2024-05-08T20:55:04.215742+0000","last_became_peered":"2024-05-08T20:55:04.215742+0000","last_unstale":"2024-05-08T21:21:57.043015+0000","last_undegraded":"2024-05-08T21:21:57.043015+0000","last_fullsized":"2024-05-08T21:21:57.043015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3549","last_scrub_stamp":"2024-05-08T21:21:57.042969+0000","last_deep_scrub":"27'3549","last_deep_scrub_stamp":"2024-05-08T21:21:57.042969+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.042969+0000","objects_scrubbed":0,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:10.155182+0000","scrub_duration":0.011593343000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2751,"num_write_kb":55155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"27'5273","reported_seq":5312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.857565+0000","last_change":"2024-05-08T21:21:29.857565+0000","last_active":"2024-05-08T21:21:29.857565+0000","last_peered":"2024-05-08T21:21:29.857565+0000","last_clean":"2024-05-08T21:21:29.857565+0000","last_became_active":"2024-05-08T20:54:59.629433+0000","last_became_peered":"2024-05-08T20:54:59.629433+0000","last_unstale":"2024-05-08T21:21:29.857565+0000","last_undegraded":"2024-05-08T21:21:29.857565+0000","last_fullsized":"2024-05-08T21:21:29.857565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5273","last_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_deep_scrub":"27'5273","last_deep_scrub_stamp":"2024-05-08T21:21:29.857411+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.857411+0000","objects_scrubbed":4,"log_size":5273,"log_dups_size":0,"ondisk_log_size":5273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:42.773346+0000","scrub_duration":0.054139549000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5263,"num_write_kb":39215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"27'827","reported_seq":865,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:48.892457+0000","last_change":"2024-05-08T21:21:48.892570+0000","last_active":"2024-05-08T21:21:48.892457+0000","last_peered":"2024-05-08T21:21:48.892457+0000","last_clean":"2024-05-08T21:21:48.892457+0000","last_became_active":"2024-05-08T20:55:00.090329+0000","last_became_peered":"2024-05-08T20:55:00.090329+0000","last_unstale":"2024-05-08T21:21:48.892457+0000","last_undegraded":"2024-05-08T21:21:48.892457+0000","last_fullsized":"2024-05-08T21:21:48.892457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'827","last_scrub_stamp":"2024-05-08T21:21:48.892428+0000","last_deep_scrub":"27'827","last_deep_scrub_stamp":"2024-05-08T21:21:48.892428+0000","last_clean_scrub_stamp":"2024-05-08T21:21:48.892428+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:24.234549+0000","scrub_duration":0.0069871000000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'3388","reported_seq":3425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:09.013177+0000","last_change":"2024-05-08T21:22:09.013324+0000","last_active":"2024-05-08T21:22:09.013177+0000","last_peered":"2024-05-08T21:22:09.013177+0000","last_clean":"2024-05-08T21:22:09.013177+0000","last_became_active":"2024-05-08T20:55:04.210429+0000","last_became_peered":"2024-05-08T20:55:04.210429+0000","last_unstale":"2024-05-08T21:22:09.013177+0000","last_undegraded":"2024-05-08T21:22:09.013177+0000","last_fullsized":"2024-05-08T21:22:09.013177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3388","last_scrub_stamp":"2024-05-08T21:22:09.013152+0000","last_deep_scrub":"27'3388","last_deep_scrub_stamp":"2024-05-08T21:22:09.013152+0000","last_clean_scrub_stamp":"2024-05-08T21:22:09.013152+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:21.644273+0000","scrub_duration":0.014579356999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2510,"num_write_kb":79984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"27'2694","reported_seq":3304,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.008413+0000","last_change":"2024-05-08T21:21:40.008506+0000","last_active":"2024-05-08T21:21:40.008413+0000","last_peered":"2024-05-08T21:21:40.008413+0000","last_clean":"2024-05-08T21:21:40.008413+0000","last_became_active":"2024-05-08T20:54:59.629561+0000","last_became_peered":"2024-05-08T20:54:59.629561+0000","last_unstale":"2024-05-08T21:21:40.008413+0000","last_undegraded":"2024-05-08T21:21:40.008413+0000","last_fullsized":"2024-05-08T21:21:40.008413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2694","last_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_deep_scrub":"27'2694","last_deep_scrub_stamp":"2024-05-08T21:21:40.008388+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.008388+0000","objects_scrubbed":5,"log_size":2694,"log_dups_size":0,"ondisk_log_size":2694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:26.309746+0000","scrub_duration":0.051681431999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18229524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1795,"num_write":2691,"num_write_kb":19159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"27'812","reported_seq":845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.594810+0000","last_change":"2024-05-08T21:21:32.594810+0000","last_active":"2024-05-08T21:21:32.594810+0000","last_peered":"2024-05-08T21:21:32.594810+0000","last_clean":"2024-05-08T21:21:32.594810+0000","last_became_active":"2024-05-08T20:55:41.598053+0000","last_became_peered":"2024-05-08T20:55:41.598053+0000","last_unstale":"2024-05-08T21:21:32.594810+0000","last_undegraded":"2024-05-08T21:21:32.594810+0000","last_fullsized":"2024-05-08T21:21:32.594810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'812","last_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_deep_scrub":"27'812","last_deep_scrub_stamp":"2024-05-08T21:21:32.594677+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.594677+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:45.576932+0000","scrub_duration":0.002123504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"27'3316","reported_seq":3353,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.067659+0000","last_change":"2024-05-08T21:21:59.067805+0000","last_active":"2024-05-08T21:21:59.067659+0000","last_peered":"2024-05-08T21:21:59.067659+0000","last_clean":"2024-05-08T21:21:59.067659+0000","last_became_active":"2024-05-08T20:55:04.105587+0000","last_became_peered":"2024-05-08T20:55:04.105587+0000","last_unstale":"2024-05-08T21:21:59.067659+0000","last_undegraded":"2024-05-08T21:21:59.067659+0000","last_fullsized":"2024-05-08T21:21:59.067659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3316","last_scrub_stamp":"2024-05-08T21:21:59.067632+0000","last_deep_scrub":"27'3316","last_deep_scrub_stamp":"2024-05-08T21:21:59.067632+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.067632+0000","objects_scrubbed":0,"log_size":3316,"log_dups_size":0,"ondisk_log_size":3316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:57.256614+0000","scrub_duration":0.014948201,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2481,"num_write_kb":59687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"27'3355","reported_seq":3394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.765436+0000","last_change":"2024-05-08T21:21:31.765436+0000","last_active":"2024-05-08T21:21:31.765436+0000","last_peered":"2024-05-08T21:21:31.765436+0000","last_clean":"2024-05-08T21:21:31.765436+0000","last_became_active":"2024-05-08T20:54:59.630115+0000","last_became_peered":"2024-05-08T20:54:59.630115+0000","last_unstale":"2024-05-08T21:21:31.765436+0000","last_undegraded":"2024-05-08T21:21:31.765436+0000","last_fullsized":"2024-05-08T21:21:31.765436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3355","last_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_deep_scrub":"27'3355","last_deep_scrub_stamp":"2024-05-08T21:21:31.765305+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.765305+0000","objects_scrubbed":1,"log_size":3355,"log_dups_size":0,"ondisk_log_size":3355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:44.747560+0000","scrub_duration":0.018616456999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3352,"num_write_kb":26134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'825","reported_seq":864,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:43.085998+0000","last_change":"2024-05-08T21:21:43.086103+0000","last_active":"2024-05-08T21:21:43.085998+0000","last_peered":"2024-05-08T21:21:43.085998+0000","last_clean":"2024-05-08T21:21:43.085998+0000","last_became_active":"2024-05-08T20:55:00.097309+0000","last_became_peered":"2024-05-08T20:55:00.097309+0000","last_unstale":"2024-05-08T21:21:43.085998+0000","last_undegraded":"2024-05-08T21:21:43.085998+0000","last_fullsized":"2024-05-08T21:21:43.085998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'825","last_scrub_stamp":"2024-05-08T21:21:43.085971+0000","last_deep_scrub":"27'825","last_deep_scrub_stamp":"2024-05-08T21:21:43.085971+0000","last_clean_scrub_stamp":"2024-05-08T21:21:43.085971+0000","objects_scrubbed":0,"log_size":825,"log_dups_size":0,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:29.387329+0000","scrub_duration":0.0058775499999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"27'4015","reported_seq":4052,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:00.549828+0000","last_change":"2024-05-08T21:22:00.549972+0000","last_active":"2024-05-08T21:22:00.549828+0000","last_peered":"2024-05-08T21:22:00.549828+0000","last_clean":"2024-05-08T21:22:00.549828+0000","last_became_active":"2024-05-08T20:55:04.110256+0000","last_became_peered":"2024-05-08T20:55:04.110256+0000","last_unstale":"2024-05-08T21:22:00.549828+0000","last_undegraded":"2024-05-08T21:22:00.549828+0000","last_fullsized":"2024-05-08T21:22:00.549828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4015","last_scrub_stamp":"2024-05-08T21:22:00.549799+0000","last_deep_scrub":"27'4015","last_deep_scrub_stamp":"2024-05-08T21:22:00.549799+0000","last_clean_scrub_stamp":"2024-05-08T21:22:00.549799+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:51:13.662012+0000","scrub_duration":0.013658672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3197,"num_write_kb":379377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4049","reported_seq":4088,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.877466+0000","last_change":"2024-05-08T21:21:31.877466+0000","last_active":"2024-05-08T21:21:31.877466+0000","last_peered":"2024-05-08T21:21:31.877466+0000","last_clean":"2024-05-08T21:21:31.877466+0000","last_became_active":"2024-05-08T20:54:59.627803+0000","last_became_peered":"2024-05-08T20:54:59.627803+0000","last_unstale":"2024-05-08T21:21:31.877466+0000","last_undegraded":"2024-05-08T21:21:31.877466+0000","last_fullsized":"2024-05-08T21:21:31.877466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4049","last_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_deep_scrub":"27'4049","last_deep_scrub_stamp":"2024-05-08T21:21:31.877246+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.877246+0000","objects_scrubbed":3,"log_size":4049,"log_dups_size":0,"ondisk_log_size":4049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:56.438144+0000","scrub_duration":0.021654677000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4056,"num_write_kb":23095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'833","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:33.106298+0000","last_change":"2024-05-08T21:21:33.106409+0000","last_active":"2024-05-08T21:21:33.106298+0000","last_peered":"2024-05-08T21:21:33.106298+0000","last_clean":"2024-05-08T21:21:33.106298+0000","last_became_active":"2024-05-08T20:55:00.091890+0000","last_became_peered":"2024-05-08T20:55:00.091890+0000","last_unstale":"2024-05-08T21:21:33.106298+0000","last_undegraded":"2024-05-08T21:21:33.106298+0000","last_fullsized":"2024-05-08T21:21:33.106298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'833","last_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_deep_scrub":"27'833","last_deep_scrub_stamp":"2024-05-08T21:21:33.106270+0000","last_clean_scrub_stamp":"2024-05-08T21:21:33.106270+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:21.028217+0000","scrub_duration":0.0015875640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"27'3545","reported_seq":3582,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:04.876242+0000","last_change":"2024-05-08T21:22:04.876392+0000","last_active":"2024-05-08T21:22:04.876242+0000","last_peered":"2024-05-08T21:22:04.876242+0000","last_clean":"2024-05-08T21:22:04.876242+0000","last_became_active":"2024-05-08T20:55:04.116596+0000","last_became_peered":"2024-05-08T20:55:04.116596+0000","last_unstale":"2024-05-08T21:22:04.876242+0000","last_undegraded":"2024-05-08T21:22:04.876242+0000","last_fullsized":"2024-05-08T21:22:04.876242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3545","last_scrub_stamp":"2024-05-08T21:22:04.876214+0000","last_deep_scrub":"27'3545","last_deep_scrub_stamp":"2024-05-08T21:22:04.876214+0000","last_clean_scrub_stamp":"2024-05-08T21:22:04.876214+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":0,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:17.507335+0000","scrub_duration":0.01515615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2740,"num_write_kb":132046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'4551","reported_seq":4590,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.984044+0000","last_change":"2024-05-08T21:21:26.984139+0000","last_active":"2024-05-08T21:21:26.984044+0000","last_peered":"2024-05-08T21:21:26.984044+0000","last_clean":"2024-05-08T21:21:26.984044+0000","last_became_active":"2024-05-08T20:54:59.630148+0000","last_became_peered":"2024-05-08T20:54:59.630148+0000","last_unstale":"2024-05-08T21:21:26.984044+0000","last_undegraded":"2024-05-08T21:21:26.984044+0000","last_fullsized":"2024-05-08T21:21:26.984044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4551","last_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_deep_scrub":"27'4551","last_deep_scrub_stamp":"2024-05-08T21:21:26.984019+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.984019+0000","objects_scrubbed":5,"log_size":4551,"log_dups_size":0,"ondisk_log_size":4551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:14.905965+0000","scrub_duration":0.030483375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4544,"num_write_kb":30850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"27'805","reported_seq":844,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:07.421256+0000","last_change":"2024-05-08T21:22:07.421374+0000","last_active":"2024-05-08T21:22:07.421256+0000","last_peered":"2024-05-08T21:22:07.421256+0000","last_clean":"2024-05-08T21:22:07.421256+0000","last_became_active":"2024-05-08T20:55:00.095296+0000","last_became_peered":"2024-05-08T20:55:00.095296+0000","last_unstale":"2024-05-08T21:22:07.421256+0000","last_undegraded":"2024-05-08T21:22:07.421256+0000","last_fullsized":"2024-05-08T21:22:07.421256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'805","last_scrub_stamp":"2024-05-08T21:22:07.421212+0000","last_deep_scrub":"27'805","last_deep_scrub_stamp":"2024-05-08T21:22:07.421212+0000","last_clean_scrub_stamp":"2024-05-08T21:22:07.421212+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:20.052333+0000","scrub_duration":0.0030578810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'3282","reported_seq":3319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:13.981400+0000","last_change":"2024-05-08T21:22:13.981580+0000","last_active":"2024-05-08T21:22:13.981400+0000","last_peered":"2024-05-08T21:22:13.981400+0000","last_clean":"2024-05-08T21:22:13.981400+0000","last_became_active":"2024-05-08T20:55:04.215518+0000","last_became_peered":"2024-05-08T20:55:04.215518+0000","last_unstale":"2024-05-08T21:22:13.981400+0000","last_undegraded":"2024-05-08T21:22:13.981400+0000","last_fullsized":"2024-05-08T21:22:13.981400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3282","last_scrub_stamp":"2024-05-08T21:22:13.981373+0000","last_deep_scrub":"27'3282","last_deep_scrub_stamp":"2024-05-08T21:22:13.981373+0000","last_clean_scrub_stamp":"2024-05-08T21:22:13.981373+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:12.942099+0000","scrub_duration":0.014392591999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2425,"num_write_kb":59313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"27'2511","reported_seq":2551,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.046929+0000","last_change":"2024-05-08T21:21:21.047050+0000","last_active":"2024-05-08T21:21:21.046929+0000","last_peered":"2024-05-08T21:21:21.046929+0000","last_clean":"2024-05-08T21:21:21.046929+0000","last_became_active":"2024-05-08T20:54:59.629020+0000","last_became_peered":"2024-05-08T20:54:59.629020+0000","last_unstale":"2024-05-08T21:21:21.046929+0000","last_undegraded":"2024-05-08T21:21:21.046929+0000","last_fullsized":"2024-05-08T21:21:21.046929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2511","last_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_deep_scrub":"27'2511","last_deep_scrub_stamp":"2024-05-08T21:21:21.046889+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.046889+0000","objects_scrubbed":3,"log_size":2511,"log_dups_size":0,"ondisk_log_size":2511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:40.172844+0000","scrub_duration":0.017442593999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2515,"num_write_kb":17545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"27'800","reported_seq":833,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.600144+0000","last_change":"2024-05-08T21:21:34.600251+0000","last_active":"2024-05-08T21:21:34.600144+0000","last_peered":"2024-05-08T21:21:34.600144+0000","last_clean":"2024-05-08T21:21:34.600144+0000","last_became_active":"2024-05-08T20:55:41.594881+0000","last_became_peered":"2024-05-08T20:55:41.594881+0000","last_unstale":"2024-05-08T21:21:34.600144+0000","last_undegraded":"2024-05-08T21:21:34.600144+0000","last_fullsized":"2024-05-08T21:21:34.600144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'800","last_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_deep_scrub":"27'800","last_deep_scrub_stamp":"2024-05-08T21:21:34.600116+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.600116+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:59.161013+0000","scrub_duration":0.0021058320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"27'3402","reported_seq":3439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:04.013981+0000","last_change":"2024-05-08T21:22:04.014126+0000","last_active":"2024-05-08T21:22:04.013981+0000","last_peered":"2024-05-08T21:22:04.013981+0000","last_clean":"2024-05-08T21:22:04.013981+0000","last_became_active":"2024-05-08T20:55:04.210506+0000","last_became_peered":"2024-05-08T20:55:04.210506+0000","last_unstale":"2024-05-08T21:22:04.013981+0000","last_undegraded":"2024-05-08T21:22:04.013981+0000","last_fullsized":"2024-05-08T21:22:04.013981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3402","last_scrub_stamp":"2024-05-08T21:22:04.013951+0000","last_deep_scrub":"27'3402","last_deep_scrub_stamp":"2024-05-08T21:22:04.013951+0000","last_clean_scrub_stamp":"2024-05-08T21:22:04.013951+0000","objects_scrubbed":0,"log_size":3402,"log_dups_size":0,"ondisk_log_size":3402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:12.893266+0000","scrub_duration":0.011919971999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":53948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.741038+0000","last_change":"2024-05-08T21:21:45.741178+0000","last_active":"2024-05-08T21:21:45.741038+0000","last_peered":"2024-05-08T21:21:45.741038+0000","last_clean":"2024-05-08T21:21:45.741038+0000","last_became_active":"2024-05-08T20:54:59.628144+0000","last_became_peered":"2024-05-08T20:54:59.628144+0000","last_unstale":"2024-05-08T21:21:45.741038+0000","last_undegraded":"2024-05-08T21:21:45.741038+0000","last_fullsized":"2024-05-08T21:21:45.741038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T21:21:45.740993+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T21:21:45.740993+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.740993+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.617390+0000","scrub_duration":0.0038103590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'834","reported_seq":873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:55.298082+0000","last_change":"2024-05-08T21:21:55.298236+0000","last_active":"2024-05-08T21:21:55.298082+0000","last_peered":"2024-05-08T21:21:55.298082+0000","last_clean":"2024-05-08T21:21:55.298082+0000","last_became_active":"2024-05-08T20:55:00.094994+0000","last_became_peered":"2024-05-08T20:55:00.094994+0000","last_unstale":"2024-05-08T21:21:55.298082+0000","last_undegraded":"2024-05-08T21:21:55.298082+0000","last_fullsized":"2024-05-08T21:21:55.298082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'834","last_scrub_stamp":"2024-05-08T21:21:55.298042+0000","last_deep_scrub":"27'834","last_deep_scrub_stamp":"2024-05-08T21:21:55.298042+0000","last_clean_scrub_stamp":"2024-05-08T21:21:55.298042+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:11.517112+0000","scrub_duration":0.001697879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"27'3525","reported_seq":3562,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:10.043589+0000","last_change":"2024-05-08T21:22:10.043742+0000","last_active":"2024-05-08T21:22:10.043589+0000","last_peered":"2024-05-08T21:22:10.043589+0000","last_clean":"2024-05-08T21:22:10.043589+0000","last_became_active":"2024-05-08T20:55:04.214335+0000","last_became_peered":"2024-05-08T20:55:04.214335+0000","last_unstale":"2024-05-08T21:22:10.043589+0000","last_undegraded":"2024-05-08T21:22:10.043589+0000","last_fullsized":"2024-05-08T21:22:10.043589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3525","last_scrub_stamp":"2024-05-08T21:22:10.043563+0000","last_deep_scrub":"27'3525","last_deep_scrub_stamp":"2024-05-08T21:22:10.043563+0000","last_clean_scrub_stamp":"2024-05-08T21:22:10.043563+0000","objects_scrubbed":0,"log_size":3525,"log_dups_size":0,"ondisk_log_size":3525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:16:18.513082+0000","scrub_duration":0.014352624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2674,"num_write_kb":98494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"27'1101","reported_seq":1140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:39.018005+0000","last_change":"2024-05-08T21:21:39.018107+0000","last_active":"2024-05-08T21:21:39.018005+0000","last_peered":"2024-05-08T21:21:39.018005+0000","last_clean":"2024-05-08T21:21:39.018005+0000","last_became_active":"2024-05-08T20:54:59.626940+0000","last_became_peered":"2024-05-08T20:54:59.626940+0000","last_unstale":"2024-05-08T21:21:39.018005+0000","last_undegraded":"2024-05-08T21:21:39.018005+0000","last_fullsized":"2024-05-08T21:21:39.018005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1101","last_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_deep_scrub":"27'1101","last_deep_scrub_stamp":"2024-05-08T21:21:39.017978+0000","last_clean_scrub_stamp":"2024-05-08T21:21:39.017978+0000","objects_scrubbed":2,"log_size":1101,"log_dups_size":0,"ondisk_log_size":1101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:33.890814+0000","scrub_duration":0.026486484000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"27'819","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.003346+0000","last_change":"2024-05-08T21:21:44.003447+0000","last_active":"2024-05-08T21:21:44.003346+0000","last_peered":"2024-05-08T21:21:44.003346+0000","last_clean":"2024-05-08T21:21:44.003346+0000","last_became_active":"2024-05-08T20:55:00.087154+0000","last_became_peered":"2024-05-08T20:55:00.087154+0000","last_unstale":"2024-05-08T21:21:44.003346+0000","last_undegraded":"2024-05-08T21:21:44.003346+0000","last_fullsized":"2024-05-08T21:21:44.003346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:44.003318+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:44.003318+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.003318+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:39.841715+0000","scrub_duration":0.001906243,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"27'3307","reported_seq":3344,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:08.082823+0000","last_change":"2024-05-08T21:22:08.082973+0000","last_active":"2024-05-08T21:22:08.082823+0000","last_peered":"2024-05-08T21:22:08.082823+0000","last_clean":"2024-05-08T21:22:08.082823+0000","last_became_active":"2024-05-08T20:55:04.110822+0000","last_became_peered":"2024-05-08T20:55:04.110822+0000","last_unstale":"2024-05-08T21:22:08.082823+0000","last_undegraded":"2024-05-08T21:22:08.082823+0000","last_fullsized":"2024-05-08T21:22:08.082823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3307","last_scrub_stamp":"2024-05-08T21:22:08.082798+0000","last_deep_scrub":"27'3307","last_deep_scrub_stamp":"2024-05-08T21:22:08.082798+0000","last_clean_scrub_stamp":"2024-05-08T21:22:08.082798+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:07.043524+0000","scrub_duration":0.013310571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2462,"num_write_kb":109690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"27'1830","reported_seq":1870,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:25.673979+0000","last_change":"2024-05-08T21:21:25.674104+0000","last_active":"2024-05-08T21:21:25.673979+0000","last_peered":"2024-05-08T21:21:25.673979+0000","last_clean":"2024-05-08T21:21:25.673979+0000","last_became_active":"2024-05-08T20:54:59.619767+0000","last_became_peered":"2024-05-08T20:54:59.619767+0000","last_unstale":"2024-05-08T21:21:25.673979+0000","last_undegraded":"2024-05-08T21:21:25.673979+0000","last_fullsized":"2024-05-08T21:21:25.673979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1830","last_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_deep_scrub":"27'1830","last_deep_scrub_stamp":"2024-05-08T21:21:25.673951+0000","last_clean_scrub_stamp":"2024-05-08T21:21:25.673951+0000","objects_scrubbed":6,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:42.700633+0000","scrub_duration":0.019234405,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":13175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"27'858","reported_seq":897,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.214224+0000","last_change":"2024-05-08T21:21:51.214331+0000","last_active":"2024-05-08T21:21:51.214224+0000","last_peered":"2024-05-08T21:21:51.214224+0000","last_clean":"2024-05-08T21:21:51.214224+0000","last_became_active":"2024-05-08T20:55:00.102970+0000","last_became_peered":"2024-05-08T20:55:00.102970+0000","last_unstale":"2024-05-08T21:21:51.214224+0000","last_undegraded":"2024-05-08T21:21:51.214224+0000","last_fullsized":"2024-05-08T21:21:51.214224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'858","last_scrub_stamp":"2024-05-08T21:21:51.214198+0000","last_deep_scrub":"27'858","last_deep_scrub_stamp":"2024-05-08T21:21:51.214198+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.214198+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:14.478266+0000","scrub_duration":0.00159553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"27'3360","reported_seq":3398,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:11.580475+0000","last_change":"2024-05-08T21:22:11.580623+0000","last_active":"2024-05-08T21:22:11.580475+0000","last_peered":"2024-05-08T21:22:11.580475+0000","last_clean":"2024-05-08T21:22:11.580475+0000","last_became_active":"2024-05-08T20:55:04.108462+0000","last_became_peered":"2024-05-08T20:55:04.108462+0000","last_unstale":"2024-05-08T21:22:11.580475+0000","last_undegraded":"2024-05-08T21:22:11.580475+0000","last_fullsized":"2024-05-08T21:22:11.580475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3360","last_scrub_stamp":"2024-05-08T21:22:11.580446+0000","last_deep_scrub":"27'3360","last_deep_scrub_stamp":"2024-05-08T21:22:11.580446+0000","last_clean_scrub_stamp":"2024-05-08T21:22:11.580446+0000","objects_scrubbed":0,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:10.541172+0000","scrub_duration":0.015333697,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2533,"num_write_kb":61109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"27'1832","reported_seq":1873,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.055783+0000","last_change":"2024-05-08T21:21:28.055783+0000","last_active":"2024-05-08T21:21:28.055783+0000","last_peered":"2024-05-08T21:21:28.055783+0000","last_clean":"2024-05-08T21:21:28.055783+0000","last_became_active":"2024-05-08T20:54:59.626111+0000","last_became_peered":"2024-05-08T20:54:59.626111+0000","last_unstale":"2024-05-08T21:21:28.055783+0000","last_undegraded":"2024-05-08T21:21:28.055783+0000","last_fullsized":"2024-05-08T21:21:28.055783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1832","last_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_deep_scrub":"27'1832","last_deep_scrub_stamp":"2024-05-08T21:21:28.055611+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.055611+0000","objects_scrubbed":2,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:40.971546+0000","scrub_duration":0.014408755000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":13133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'841","reported_seq":881,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.197534+0000","last_change":"2024-05-08T21:21:24.197534+0000","last_active":"2024-05-08T21:21:24.197534+0000","last_peered":"2024-05-08T21:21:24.197534+0000","last_clean":"2024-05-08T21:21:24.197534+0000","last_became_active":"2024-05-08T20:55:00.094871+0000","last_became_peered":"2024-05-08T20:55:00.094871+0000","last_unstale":"2024-05-08T21:21:24.197534+0000","last_undegraded":"2024-05-08T21:21:24.197534+0000","last_fullsized":"2024-05-08T21:21:24.197534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'841","last_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_deep_scrub":"27'841","last_deep_scrub_stamp":"2024-05-08T21:21:24.197404+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.197404+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:14.802421+0000","scrub_duration":0.001513105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"27'4215","reported_seq":4254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:55.910186+0000","last_change":"2024-05-08T21:21:55.910186+0000","last_active":"2024-05-08T21:21:55.910186+0000","last_peered":"2024-05-08T21:21:55.910186+0000","last_clean":"2024-05-08T21:21:55.910186+0000","last_became_active":"2024-05-08T20:55:04.106090+0000","last_became_peered":"2024-05-08T20:55:04.106090+0000","last_unstale":"2024-05-08T21:21:55.910186+0000","last_undegraded":"2024-05-08T21:21:55.910186+0000","last_fullsized":"2024-05-08T21:21:55.910186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4215","last_scrub_stamp":"2024-05-08T21:21:55.909994+0000","last_deep_scrub":"27'4215","last_deep_scrub_stamp":"2024-05-08T21:21:55.909994+0000","last_clean_scrub_stamp":"2024-05-08T21:21:55.909994+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:54.098976+0000","scrub_duration":0.016427773999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3358,"num_write_kb":116179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"27'1215","reported_seq":1256,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.896292+0000","last_change":"2024-05-08T21:21:22.896292+0000","last_active":"2024-05-08T21:21:22.896292+0000","last_peered":"2024-05-08T21:21:22.896292+0000","last_clean":"2024-05-08T21:21:22.896292+0000","last_became_active":"2024-05-08T20:54:59.625104+0000","last_became_peered":"2024-05-08T20:54:59.625104+0000","last_unstale":"2024-05-08T21:21:22.896292+0000","last_undegraded":"2024-05-08T21:21:22.896292+0000","last_fullsized":"2024-05-08T21:21:22.896292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1215","last_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_deep_scrub":"27'1215","last_deep_scrub_stamp":"2024-05-08T21:21:22.896177+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.896177+0000","objects_scrubbed":1,"log_size":1215,"log_dups_size":0,"ondisk_log_size":1215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:38:50.970681+0000","scrub_duration":0.015373217999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":8742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'822","reported_seq":862,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.852458+0000","last_change":"2024-05-08T21:21:52.852458+0000","last_active":"2024-05-08T21:21:52.852458+0000","last_peered":"2024-05-08T21:21:52.852458+0000","last_clean":"2024-05-08T21:21:52.852458+0000","last_became_active":"2024-05-08T20:55:00.091597+0000","last_became_peered":"2024-05-08T20:55:00.091597+0000","last_unstale":"2024-05-08T21:21:52.852458+0000","last_undegraded":"2024-05-08T21:21:52.852458+0000","last_fullsized":"2024-05-08T21:21:52.852458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'822","last_scrub_stamp":"2024-05-08T21:21:52.852328+0000","last_deep_scrub":"27'822","last_deep_scrub_stamp":"2024-05-08T21:21:52.852328+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.852328+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:48.690725+0000","scrub_duration":0.0038734249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'3486","reported_seq":3522,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:39.039353+0000","last_change":"2024-05-08T21:22:39.039493+0000","last_active":"2024-05-08T21:22:39.039353+0000","last_peered":"2024-05-08T21:22:39.039353+0000","last_clean":"2024-05-08T21:22:39.039353+0000","last_became_active":"2024-05-08T20:55:41.599433+0000","last_became_peered":"2024-05-08T20:55:41.599433+0000","last_unstale":"2024-05-08T21:22:39.039353+0000","last_undegraded":"2024-05-08T21:22:39.039353+0000","last_fullsized":"2024-05-08T21:22:39.039353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3486","last_scrub_stamp":"2024-05-08T21:22:39.039322+0000","last_deep_scrub":"27'3486","last_deep_scrub_stamp":"2024-05-08T21:22:39.039322+0000","last_clean_scrub_stamp":"2024-05-08T21:22:39.039322+0000","objects_scrubbed":0,"log_size":3486,"log_dups_size":0,"ondisk_log_size":3486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:34.046788+0000","scrub_duration":0.017055438999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2630,"num_write_kb":58783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"27'5324","reported_seq":5365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:35.739165+0000","last_change":"2024-05-08T21:21:35.739165+0000","last_active":"2024-05-08T21:21:35.739165+0000","last_peered":"2024-05-08T21:21:35.739165+0000","last_clean":"2024-05-08T21:21:35.739165+0000","last_became_active":"2024-05-08T20:54:59.627764+0000","last_became_peered":"2024-05-08T20:54:59.627764+0000","last_unstale":"2024-05-08T21:21:35.739165+0000","last_undegraded":"2024-05-08T21:21:35.739165+0000","last_fullsized":"2024-05-08T21:21:35.739165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5324","last_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_deep_scrub":"27'5324","last_deep_scrub_stamp":"2024-05-08T21:21:35.739051+0000","last_clean_scrub_stamp":"2024-05-08T21:21:35.739051+0000","objects_scrubbed":6,"log_size":5324,"log_dups_size":0,"ondisk_log_size":5324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:01.155361+0000","scrub_duration":0.059511772999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24007490,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5317,"num_write_kb":42298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'815","reported_seq":856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:43.325345+0000","last_change":"2024-05-08T21:21:43.325345+0000","last_active":"2024-05-08T21:21:43.325345+0000","last_peered":"2024-05-08T21:21:43.325345+0000","last_clean":"2024-05-08T21:21:43.325345+0000","last_became_active":"2024-05-08T20:55:00.085313+0000","last_became_peered":"2024-05-08T20:55:00.085313+0000","last_unstale":"2024-05-08T21:21:43.325345+0000","last_undegraded":"2024-05-08T21:21:43.325345+0000","last_fullsized":"2024-05-08T21:21:43.325345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'815","last_scrub_stamp":"2024-05-08T21:21:43.325201+0000","last_deep_scrub":"27'815","last_deep_scrub_stamp":"2024-05-08T21:21:43.325201+0000","last_clean_scrub_stamp":"2024-05-08T21:21:43.325201+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:23.201599+0000","scrub_duration":0.0025464149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"27'3418","reported_seq":3456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:00.818321+0000","last_change":"2024-05-08T21:22:00.818459+0000","last_active":"2024-05-08T21:22:00.818321+0000","last_peered":"2024-05-08T21:22:00.818321+0000","last_clean":"2024-05-08T21:22:00.818321+0000","last_became_active":"2024-05-08T20:55:04.114512+0000","last_became_peered":"2024-05-08T20:55:04.114512+0000","last_unstale":"2024-05-08T21:22:00.818321+0000","last_undegraded":"2024-05-08T21:22:00.818321+0000","last_fullsized":"2024-05-08T21:22:00.818321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3418","last_scrub_stamp":"2024-05-08T21:22:00.818290+0000","last_deep_scrub":"27'3418","last_deep_scrub_stamp":"2024-05-08T21:22:00.818290+0000","last_clean_scrub_stamp":"2024-05-08T21:22:00.818290+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:15:37.583512+0000","scrub_duration":0.013355994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":51726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'844","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.927146+0000","last_change":"2024-05-08T21:21:50.927241+0000","last_active":"2024-05-08T21:21:50.927146+0000","last_peered":"2024-05-08T21:21:50.927146+0000","last_clean":"2024-05-08T21:21:50.927146+0000","last_became_active":"2024-05-08T20:55:00.075120+0000","last_became_peered":"2024-05-08T20:55:00.075120+0000","last_unstale":"2024-05-08T21:21:50.927146+0000","last_undegraded":"2024-05-08T21:21:50.927146+0000","last_fullsized":"2024-05-08T21:21:50.927146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:50.927119+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:50.927119+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.927119+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:46.765517+0000","scrub_duration":0.001723739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'3945","reported_seq":6346,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.633436+0000","last_change":"2024-05-08T21:21:27.633436+0000","last_active":"2024-05-08T21:21:27.633436+0000","last_peered":"2024-05-08T21:21:27.633436+0000","last_clean":"2024-05-08T21:21:27.633436+0000","last_became_active":"2024-05-08T20:54:59.626481+0000","last_became_peered":"2024-05-08T20:54:59.626481+0000","last_unstale":"2024-05-08T21:21:27.633436+0000","last_undegraded":"2024-05-08T21:21:27.633436+0000","last_fullsized":"2024-05-08T21:21:27.633436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3945","last_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_deep_scrub":"27'3945","last_deep_scrub_stamp":"2024-05-08T21:21:27.633289+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.633289+0000","objects_scrubbed":0,"log_size":3945,"log_dups_size":0,"ondisk_log_size":3945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:25:18.238307+0000","scrub_duration":0.0021982780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2359,"num_read_kb":5735,"num_write":3953,"num_write_kb":18773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"27'4015","reported_seq":4054,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:04.787598+0000","last_change":"2024-05-08T21:22:04.787598+0000","last_active":"2024-05-08T21:22:04.787598+0000","last_peered":"2024-05-08T21:22:04.787598+0000","last_clean":"2024-05-08T21:22:04.787598+0000","last_became_active":"2024-05-08T20:55:04.214523+0000","last_became_peered":"2024-05-08T20:55:04.214523+0000","last_unstale":"2024-05-08T21:22:04.787598+0000","last_undegraded":"2024-05-08T21:22:04.787598+0000","last_fullsized":"2024-05-08T21:22:04.787598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4015","last_scrub_stamp":"2024-05-08T21:22:04.787419+0000","last_deep_scrub":"27'4015","last_deep_scrub_stamp":"2024-05-08T21:22:04.787419+0000","last_clean_scrub_stamp":"2024-05-08T21:22:04.787419+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:05:03.748145+0000","scrub_duration":0.016271010999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3169,"num_write_kb":236658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"27'844","reported_seq":878,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:31.626410+0000","last_change":"2024-05-08T21:21:31.626525+0000","last_active":"2024-05-08T21:21:31.626410+0000","last_peered":"2024-05-08T21:21:31.626410+0000","last_clean":"2024-05-08T21:21:31.626410+0000","last_became_active":"2024-05-08T20:55:41.599077+0000","last_became_peered":"2024-05-08T20:55:41.599077+0000","last_unstale":"2024-05-08T21:21:31.626410+0000","last_undegraded":"2024-05-08T21:21:31.626410+0000","last_fullsized":"2024-05-08T21:21:31.626410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:31.626385+0000","last_clean_scrub_stamp":"2024-05-08T21:21:31.626385+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:26.764578+0000","scrub_duration":0.002149495,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"27'2356","reported_seq":2397,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.779163+0000","last_change":"2024-05-08T21:21:30.779163+0000","last_active":"2024-05-08T21:21:30.779163+0000","last_peered":"2024-05-08T21:21:30.779163+0000","last_clean":"2024-05-08T21:21:30.779163+0000","last_became_active":"2024-05-08T20:54:59.625013+0000","last_became_peered":"2024-05-08T20:54:59.625013+0000","last_unstale":"2024-05-08T21:21:30.779163+0000","last_undegraded":"2024-05-08T21:21:30.779163+0000","last_fullsized":"2024-05-08T21:21:30.779163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2356","last_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_deep_scrub":"27'2356","last_deep_scrub_stamp":"2024-05-08T21:21:30.779025+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.779025+0000","objects_scrubbed":2,"log_size":2356,"log_dups_size":0,"ondisk_log_size":2356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.917218+0000","scrub_duration":0.024843976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2360,"num_write_kb":17485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.235943+0000","last_change":"2024-05-08T21:21:28.236054+0000","last_active":"2024-05-08T21:21:28.235943+0000","last_peered":"2024-05-08T21:21:28.235943+0000","last_clean":"2024-05-08T21:21:28.235943+0000","last_became_active":"2024-05-08T20:54:49.752004+0000","last_became_peered":"2024-05-08T20:54:49.752004+0000","last_unstale":"2024-05-08T21:21:28.235943+0000","last_undegraded":"2024-05-08T21:21:28.235943+0000","last_fullsized":"2024-05-08T21:21:28.235943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-05-08T21:21:28.235917+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.235917+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:41.151852+0000","scrub_duration":0.011500560999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'3577","reported_seq":3615,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:03.124727+0000","last_change":"2024-05-08T21:22:03.124881+0000","last_active":"2024-05-08T21:22:03.124727+0000","last_peered":"2024-05-08T21:22:03.124727+0000","last_clean":"2024-05-08T21:22:03.124727+0000","last_became_active":"2024-05-08T20:55:04.214702+0000","last_became_peered":"2024-05-08T20:55:04.214702+0000","last_unstale":"2024-05-08T21:22:03.124727+0000","last_undegraded":"2024-05-08T21:22:03.124727+0000","last_fullsized":"2024-05-08T21:22:03.124727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3577","last_scrub_stamp":"2024-05-08T21:22:03.124701+0000","last_deep_scrub":"27'3577","last_deep_scrub_stamp":"2024-05-08T21:22:03.124701+0000","last_clean_scrub_stamp":"2024-05-08T21:22:03.124701+0000","objects_scrubbed":0,"log_size":3577,"log_dups_size":0,"ondisk_log_size":3577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:15.755822+0000","scrub_duration":0.013538625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2731,"num_write_kb":97577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"27'788","reported_seq":829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:27.126691+0000","last_change":"2024-05-08T21:21:27.126691+0000","last_active":"2024-05-08T21:21:27.126691+0000","last_peered":"2024-05-08T21:21:27.126691+0000","last_clean":"2024-05-08T21:21:27.126691+0000","last_became_active":"2024-05-08T20:55:00.093155+0000","last_became_peered":"2024-05-08T20:55:00.093155+0000","last_unstale":"2024-05-08T21:21:27.126691+0000","last_undegraded":"2024-05-08T21:21:27.126691+0000","last_fullsized":"2024-05-08T21:21:27.126691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'788","last_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_deep_scrub":"27'788","last_deep_scrub_stamp":"2024-05-08T21:21:27.126529+0000","last_clean_scrub_stamp":"2024-05-08T21:21:27.126529+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:40.108784+0000","scrub_duration":0.0023240880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4041","reported_seq":4083,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:30.245520+0000","last_change":"2024-05-08T21:21:30.245636+0000","last_active":"2024-05-08T21:21:30.245520+0000","last_peered":"2024-05-08T21:21:30.245520+0000","last_clean":"2024-05-08T21:21:30.245520+0000","last_became_active":"2024-05-08T20:54:59.632904+0000","last_became_peered":"2024-05-08T20:54:59.632904+0000","last_unstale":"2024-05-08T21:21:30.245520+0000","last_undegraded":"2024-05-08T21:21:30.245520+0000","last_fullsized":"2024-05-08T21:21:30.245520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4041","last_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_deep_scrub":"27'4041","last_deep_scrub_stamp":"2024-05-08T21:21:30.245496+0000","last_clean_scrub_stamp":"2024-05-08T21:21:30.245496+0000","objects_scrubbed":3,"log_size":4041,"log_dups_size":0,"ondisk_log_size":4041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:43.227751+0000","scrub_duration":0.033406524999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4040,"num_write_kb":30615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'3326","reported_seq":3365,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:05.119777+0000","last_change":"2024-05-08T21:22:05.119777+0000","last_active":"2024-05-08T21:22:05.119777+0000","last_peered":"2024-05-08T21:22:05.119777+0000","last_clean":"2024-05-08T21:22:05.119777+0000","last_became_active":"2024-05-08T20:55:04.210517+0000","last_became_peered":"2024-05-08T20:55:04.210517+0000","last_unstale":"2024-05-08T21:22:05.119777+0000","last_undegraded":"2024-05-08T21:22:05.119777+0000","last_fullsized":"2024-05-08T21:22:05.119777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3326","last_scrub_stamp":"2024-05-08T21:22:05.119652+0000","last_deep_scrub":"27'3326","last_deep_scrub_stamp":"2024-05-08T21:22:05.119652+0000","last_clean_scrub_stamp":"2024-05-08T21:22:05.119652+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:42.192462+0000","scrub_duration":0.011095244000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2431,"num_write_kb":70676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"27'2956","reported_seq":2998,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:34.155283+0000","last_change":"2024-05-08T21:21:34.155283+0000","last_active":"2024-05-08T21:21:34.155283+0000","last_peered":"2024-05-08T21:21:34.155283+0000","last_clean":"2024-05-08T21:21:34.155283+0000","last_became_active":"2024-05-08T20:54:59.633464+0000","last_became_peered":"2024-05-08T20:54:59.633464+0000","last_unstale":"2024-05-08T21:21:34.155283+0000","last_undegraded":"2024-05-08T21:21:34.155283+0000","last_fullsized":"2024-05-08T21:21:34.155283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2956","last_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_deep_scrub":"27'2956","last_deep_scrub_stamp":"2024-05-08T21:21:34.155158+0000","last_clean_scrub_stamp":"2024-05-08T21:21:34.155158+0000","objects_scrubbed":1,"log_size":2956,"log_dups_size":0,"ondisk_log_size":2956,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:59.571468+0000","scrub_duration":0.015577423999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2960,"num_write_kb":21839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:42.871328+0000","last_change":"2024-05-08T21:21:42.871328+0000","last_active":"2024-05-08T21:21:42.871328+0000","last_peered":"2024-05-08T21:21:42.871328+0000","last_clean":"2024-05-08T21:21:42.871328+0000","last_became_active":"2024-05-08T20:55:00.075156+0000","last_became_peered":"2024-05-08T20:55:00.075156+0000","last_unstale":"2024-05-08T21:21:42.871328+0000","last_undegraded":"2024-05-08T21:21:42.871328+0000","last_fullsized":"2024-05-08T21:21:42.871328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:21:42.871178+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:21:42.871178+0000","last_clean_scrub_stamp":"2024-05-08T21:21:42.871178+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:22.747575+0000","scrub_duration":0.0049309480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'3566","reported_seq":3605,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:57.004491+0000","last_change":"2024-05-08T21:21:57.004649+0000","last_active":"2024-05-08T21:21:57.004491+0000","last_peered":"2024-05-08T21:21:57.004491+0000","last_clean":"2024-05-08T21:21:57.004491+0000","last_became_active":"2024-05-08T20:55:04.214453+0000","last_became_peered":"2024-05-08T20:55:04.214453+0000","last_unstale":"2024-05-08T21:21:57.004491+0000","last_undegraded":"2024-05-08T21:21:57.004491+0000","last_fullsized":"2024-05-08T21:21:57.004491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3566","last_scrub_stamp":"2024-05-08T21:21:57.004462+0000","last_deep_scrub":"27'3566","last_deep_scrub_stamp":"2024-05-08T21:21:57.004462+0000","last_clean_scrub_stamp":"2024-05-08T21:21:57.004462+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:13.223532+0000","scrub_duration":0.017708050999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2669,"num_write_kb":113097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2161","reported_seq":2201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.877526+0000","last_change":"2024-05-08T21:21:24.877608+0000","last_active":"2024-05-08T21:21:24.877526+0000","last_peered":"2024-05-08T21:21:24.877526+0000","last_clean":"2024-05-08T21:21:24.877526+0000","last_became_active":"2024-05-08T20:54:59.629637+0000","last_became_peered":"2024-05-08T20:54:59.629637+0000","last_unstale":"2024-05-08T21:21:24.877526+0000","last_undegraded":"2024-05-08T21:21:24.877526+0000","last_fullsized":"2024-05-08T21:21:24.877526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2161","last_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_deep_scrub":"27'2161","last_deep_scrub_stamp":"2024-05-08T21:21:24.877501+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.877501+0000","objects_scrubbed":4,"log_size":2161,"log_dups_size":0,"ondisk_log_size":2161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.662888+0000","scrub_duration":0.036106909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2748,"num_write_kb":14991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'779","reported_seq":819,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.957532+0000","last_change":"2024-05-08T21:21:47.957630+0000","last_active":"2024-05-08T21:21:47.957532+0000","last_peered":"2024-05-08T21:21:47.957532+0000","last_clean":"2024-05-08T21:21:47.957532+0000","last_became_active":"2024-05-08T20:55:00.100081+0000","last_became_peered":"2024-05-08T20:55:00.100081+0000","last_unstale":"2024-05-08T21:21:47.957532+0000","last_undegraded":"2024-05-08T21:21:47.957532+0000","last_fullsized":"2024-05-08T21:21:47.957532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'779","last_scrub_stamp":"2024-05-08T21:21:47.957506+0000","last_deep_scrub":"27'779","last_deep_scrub_stamp":"2024-05-08T21:21:47.957506+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.957506+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:42.830342+0000","scrub_duration":0.0063647870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'3331","reported_seq":3370,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:50.490702+0000","last_change":"2024-05-08T21:21:50.490702+0000","last_active":"2024-05-08T21:21:50.490702+0000","last_peered":"2024-05-08T21:21:50.490702+0000","last_clean":"2024-05-08T21:21:50.490702+0000","last_became_active":"2024-05-08T20:55:04.214514+0000","last_became_peered":"2024-05-08T20:55:04.214514+0000","last_unstale":"2024-05-08T21:21:50.490702+0000","last_undegraded":"2024-05-08T21:21:50.490702+0000","last_fullsized":"2024-05-08T21:21:50.490702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3331","last_scrub_stamp":"2024-05-08T21:21:50.490507+0000","last_deep_scrub":"27'3331","last_deep_scrub_stamp":"2024-05-08T21:21:50.490507+0000","last_clean_scrub_stamp":"2024-05-08T21:21:50.490507+0000","objects_scrubbed":0,"log_size":3331,"log_dups_size":0,"ondisk_log_size":3331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:46.328904+0000","scrub_duration":0.015760401,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2483,"num_write_kb":56962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'1267","reported_seq":1307,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:36.960796+0000","last_change":"2024-05-08T21:21:36.960886+0000","last_active":"2024-05-08T21:21:36.960796+0000","last_peered":"2024-05-08T21:21:36.960796+0000","last_clean":"2024-05-08T21:21:36.960796+0000","last_became_active":"2024-05-08T20:54:59.631274+0000","last_became_peered":"2024-05-08T20:54:59.631274+0000","last_unstale":"2024-05-08T21:21:36.960796+0000","last_undegraded":"2024-05-08T21:21:36.960796+0000","last_fullsized":"2024-05-08T21:21:36.960796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1267","last_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_deep_scrub":"27'1267","last_deep_scrub_stamp":"2024-05-08T21:21:36.960770+0000","last_clean_scrub_stamp":"2024-05-08T21:21:36.960770+0000","objects_scrubbed":2,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:16.837167+0000","scrub_duration":0.013455020999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1282,"num_write_kb":8808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'819","reported_seq":859,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:40.045835+0000","last_change":"2024-05-08T21:21:40.045946+0000","last_active":"2024-05-08T21:21:40.045835+0000","last_peered":"2024-05-08T21:21:40.045835+0000","last_clean":"2024-05-08T21:21:40.045835+0000","last_became_active":"2024-05-08T20:55:00.086922+0000","last_became_peered":"2024-05-08T20:55:00.086922+0000","last_unstale":"2024-05-08T21:21:40.045835+0000","last_undegraded":"2024-05-08T21:21:40.045835+0000","last_fullsized":"2024-05-08T21:21:40.045835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:40.045808+0000","last_clean_scrub_stamp":"2024-05-08T21:21:40.045808+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:19.922206+0000","scrub_duration":0.003983337,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'3633","reported_seq":3671,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:06.590765+0000","last_change":"2024-05-08T21:22:06.590765+0000","last_active":"2024-05-08T21:22:06.590765+0000","last_peered":"2024-05-08T21:22:06.590765+0000","last_clean":"2024-05-08T21:22:06.590765+0000","last_became_active":"2024-05-08T20:55:04.109474+0000","last_became_peered":"2024-05-08T20:55:04.109474+0000","last_unstale":"2024-05-08T21:22:06.590765+0000","last_undegraded":"2024-05-08T21:22:06.590765+0000","last_fullsized":"2024-05-08T21:22:06.590765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3633","last_scrub_stamp":"2024-05-08T21:22:06.590576+0000","last_deep_scrub":"27'3633","last_deep_scrub_stamp":"2024-05-08T21:22:06.590576+0000","last_clean_scrub_stamp":"2024-05-08T21:22:06.590576+0000","objects_scrubbed":0,"log_size":3633,"log_dups_size":0,"ondisk_log_size":3633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:19.221697+0000","scrub_duration":0.015038565,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2767,"num_write_kb":84157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'1127","reported_seq":1168,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:46.127654+0000","last_change":"2024-05-08T21:21:46.127752+0000","last_active":"2024-05-08T21:21:46.127654+0000","last_peered":"2024-05-08T21:21:46.127654+0000","last_clean":"2024-05-08T21:21:46.127654+0000","last_became_active":"2024-05-08T20:54:59.632495+0000","last_became_peered":"2024-05-08T20:54:59.632495+0000","last_unstale":"2024-05-08T21:21:46.127654+0000","last_undegraded":"2024-05-08T21:21:46.127654+0000","last_fullsized":"2024-05-08T21:21:46.127654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1127","last_scrub_stamp":"2024-05-08T21:21:46.127626+0000","last_deep_scrub":"27'1127","last_deep_scrub_stamp":"2024-05-08T21:21:46.127626+0000","last_clean_scrub_stamp":"2024-05-08T21:21:46.127626+0000","objects_scrubbed":1,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:41.000462+0000","scrub_duration":0.013414069000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'839","reported_seq":879,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.053152+0000","last_change":"2024-05-08T21:21:29.053278+0000","last_active":"2024-05-08T21:21:29.053152+0000","last_peered":"2024-05-08T21:21:29.053152+0000","last_clean":"2024-05-08T21:21:29.053152+0000","last_became_active":"2024-05-08T20:55:00.075268+0000","last_became_peered":"2024-05-08T20:55:00.075268+0000","last_unstale":"2024-05-08T21:21:29.053152+0000","last_undegraded":"2024-05-08T21:21:29.053152+0000","last_fullsized":"2024-05-08T21:21:29.053152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'839","last_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_deep_scrub":"27'839","last_deep_scrub_stamp":"2024-05-08T21:21:29.053124+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.053124+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.191318+0000","scrub_duration":0.0019797819999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'3469","reported_seq":3507,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.828927+0000","last_change":"2024-05-08T21:21:59.828927+0000","last_active":"2024-05-08T21:21:59.828927+0000","last_peered":"2024-05-08T21:21:59.828927+0000","last_clean":"2024-05-08T21:21:59.828927+0000","last_became_active":"2024-05-08T20:55:04.211357+0000","last_became_peered":"2024-05-08T20:55:04.211357+0000","last_unstale":"2024-05-08T21:21:59.828927+0000","last_undegraded":"2024-05-08T21:21:59.828927+0000","last_fullsized":"2024-05-08T21:21:59.828927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3469","last_scrub_stamp":"2024-05-08T21:21:59.828717+0000","last_deep_scrub":"27'3469","last_deep_scrub_stamp":"2024-05-08T21:21:59.828717+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.828717+0000","objects_scrubbed":0,"log_size":3469,"log_dups_size":0,"ondisk_log_size":3469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:38:25.850036+0000","scrub_duration":0.012228011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":87239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"27'2227","reported_seq":2267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:32.905689+0000","last_change":"2024-05-08T21:21:32.905786+0000","last_active":"2024-05-08T21:21:32.905689+0000","last_peered":"2024-05-08T21:21:32.905689+0000","last_clean":"2024-05-08T21:21:32.905689+0000","last_became_active":"2024-05-08T20:54:59.622126+0000","last_became_peered":"2024-05-08T20:54:59.622126+0000","last_unstale":"2024-05-08T21:21:32.905689+0000","last_undegraded":"2024-05-08T21:21:32.905689+0000","last_fullsized":"2024-05-08T21:21:32.905689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2227","last_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_deep_scrub":"27'2227","last_deep_scrub_stamp":"2024-05-08T21:21:32.905663+0000","last_clean_scrub_stamp":"2024-05-08T21:21:32.905663+0000","objects_scrubbed":2,"log_size":2227,"log_dups_size":0,"ondisk_log_size":2227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:58.321972+0000","scrub_duration":0.026572928999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2231,"num_write_kb":17409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'888","reported_seq":928,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.888496+0000","last_change":"2024-05-08T21:21:26.888635+0000","last_active":"2024-05-08T21:21:26.888496+0000","last_peered":"2024-05-08T21:21:26.888496+0000","last_clean":"2024-05-08T21:21:26.888496+0000","last_became_active":"2024-05-08T20:55:00.090220+0000","last_became_peered":"2024-05-08T20:55:00.090220+0000","last_unstale":"2024-05-08T21:21:26.888496+0000","last_undegraded":"2024-05-08T21:21:26.888496+0000","last_fullsized":"2024-05-08T21:21:26.888496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'888","last_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_deep_scrub":"27'888","last_deep_scrub_stamp":"2024-05-08T21:21:26.888468+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.888468+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:46.014423+0000","scrub_duration":0.0039110660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"27'3756","reported_seq":3794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:46.473294+0000","last_change":"2024-05-08T21:21:46.473294+0000","last_active":"2024-05-08T21:21:46.473294+0000","last_peered":"2024-05-08T21:21:46.473294+0000","last_clean":"2024-05-08T21:21:46.473294+0000","last_became_active":"2024-05-08T20:55:04.109231+0000","last_became_peered":"2024-05-08T20:55:04.109231+0000","last_unstale":"2024-05-08T21:21:46.473294+0000","last_undegraded":"2024-05-08T21:21:46.473294+0000","last_fullsized":"2024-05-08T21:21:46.473294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3756","last_scrub_stamp":"2024-05-08T21:21:46.473129+0000","last_deep_scrub":"27'3756","last_deep_scrub_stamp":"2024-05-08T21:21:46.473129+0000","last_clean_scrub_stamp":"2024-05-08T21:21:46.473129+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:32.774488+0000","scrub_duration":0.015135117999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2909,"num_write_kb":171596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"27'3680","reported_seq":3720,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.885021+0000","last_change":"2024-05-08T21:21:29.885123+0000","last_active":"2024-05-08T21:21:29.885021+0000","last_peered":"2024-05-08T21:21:29.885021+0000","last_clean":"2024-05-08T21:21:29.885021+0000","last_became_active":"2024-05-08T20:54:59.623539+0000","last_became_peered":"2024-05-08T20:54:59.623539+0000","last_unstale":"2024-05-08T21:21:29.885021+0000","last_undegraded":"2024-05-08T21:21:29.885021+0000","last_fullsized":"2024-05-08T21:21:29.885021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3680","last_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_deep_scrub":"27'3680","last_deep_scrub_stamp":"2024-05-08T21:21:29.884993+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.884993+0000","objects_scrubbed":2,"log_size":3680,"log_dups_size":0,"ondisk_log_size":3680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:42.867249+0000","scrub_duration":0.031053055999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3688,"num_write_kb":26288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"27'844","reported_seq":884,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.879171+0000","last_change":"2024-05-08T21:21:51.879171+0000","last_active":"2024-05-08T21:21:51.879171+0000","last_peered":"2024-05-08T21:21:51.879171+0000","last_clean":"2024-05-08T21:21:51.879171+0000","last_became_active":"2024-05-08T20:55:00.089545+0000","last_became_peered":"2024-05-08T20:55:00.089545+0000","last_unstale":"2024-05-08T21:21:51.879171+0000","last_undegraded":"2024-05-08T21:21:51.879171+0000","last_fullsized":"2024-05-08T21:21:51.879171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'844","last_scrub_stamp":"2024-05-08T21:21:51.879027+0000","last_deep_scrub":"27'844","last_deep_scrub_stamp":"2024-05-08T21:21:51.879027+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.879027+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:27.221148+0000","scrub_duration":0.00408691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'3487","reported_seq":3525,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:08.604647+0000","last_change":"2024-05-08T21:22:08.604799+0000","last_active":"2024-05-08T21:22:08.604647+0000","last_peered":"2024-05-08T21:22:08.604647+0000","last_clean":"2024-05-08T21:22:08.604647+0000","last_became_active":"2024-05-08T20:55:04.108228+0000","last_became_peered":"2024-05-08T20:55:04.108228+0000","last_unstale":"2024-05-08T21:22:08.604647+0000","last_undegraded":"2024-05-08T21:22:08.604647+0000","last_fullsized":"2024-05-08T21:22:08.604647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3487","last_scrub_stamp":"2024-05-08T21:22:08.604619+0000","last_deep_scrub":"27'3487","last_deep_scrub_stamp":"2024-05-08T21:22:08.604619+0000","last_clean_scrub_stamp":"2024-05-08T21:22:08.604619+0000","objects_scrubbed":0,"log_size":3487,"log_dups_size":0,"ondisk_log_size":3487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:45.677429+0000","scrub_duration":0.013727754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2615,"num_write_kb":110103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"27'4109","reported_seq":4150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:29.255874+0000","last_change":"2024-05-08T21:21:29.255874+0000","last_active":"2024-05-08T21:21:29.255874+0000","last_peered":"2024-05-08T21:21:29.255874+0000","last_clean":"2024-05-08T21:21:29.255874+0000","last_became_active":"2024-05-08T20:54:59.632266+0000","last_became_peered":"2024-05-08T20:54:59.632266+0000","last_unstale":"2024-05-08T21:21:29.255874+0000","last_undegraded":"2024-05-08T21:21:29.255874+0000","last_fullsized":"2024-05-08T21:21:29.255874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4109","last_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_deep_scrub":"27'4109","last_deep_scrub_stamp":"2024-05-08T21:21:29.255742+0000","last_clean_scrub_stamp":"2024-05-08T21:21:29.255742+0000","objects_scrubbed":3,"log_size":4109,"log_dups_size":0,"ondisk_log_size":4109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:24.393936+0000","scrub_duration":0.030240922,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4106,"num_write_kb":30611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"27'810","reported_seq":849,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:49.878919+0000","last_change":"2024-05-08T21:21:49.879015+0000","last_active":"2024-05-08T21:21:49.878919+0000","last_peered":"2024-05-08T21:21:49.878919+0000","last_clean":"2024-05-08T21:21:49.878919+0000","last_became_active":"2024-05-08T20:55:00.089579+0000","last_became_peered":"2024-05-08T20:55:00.089579+0000","last_unstale":"2024-05-08T21:21:49.878919+0000","last_undegraded":"2024-05-08T21:21:49.878919+0000","last_fullsized":"2024-05-08T21:21:49.878919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'810","last_scrub_stamp":"2024-05-08T21:21:49.878891+0000","last_deep_scrub":"27'810","last_deep_scrub_stamp":"2024-05-08T21:21:49.878891+0000","last_clean_scrub_stamp":"2024-05-08T21:21:49.878891+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:48.067874+0000","scrub_duration":0.001602535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'3255","reported_seq":3303,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:26.682509+0000","last_change":"2024-05-08T21:22:26.682647+0000","last_active":"2024-05-08T21:22:26.682509+0000","last_peered":"2024-05-08T21:22:26.682509+0000","last_clean":"2024-05-08T21:22:26.682509+0000","last_became_active":"2024-05-08T20:55:41.604539+0000","last_became_peered":"2024-05-08T20:55:41.604539+0000","last_unstale":"2024-05-08T21:22:26.682509+0000","last_undegraded":"2024-05-08T21:22:26.682509+0000","last_fullsized":"2024-05-08T21:22:26.682509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3255","last_scrub_stamp":"2024-05-08T21:22:26.682480+0000","last_deep_scrub":"27'3255","last_deep_scrub_stamp":"2024-05-08T21:22:26.682480+0000","last_clean_scrub_stamp":"2024-05-08T21:22:26.682480+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:21.689946+0000","scrub_duration":0.013210134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":53120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,0],"acting":[6,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"27'3441","reported_seq":3482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.602580+0000","last_change":"2024-05-08T21:21:21.602580+0000","last_active":"2024-05-08T21:21:21.602580+0000","last_peered":"2024-05-08T21:21:21.602580+0000","last_clean":"2024-05-08T21:21:21.602580+0000","last_became_active":"2024-05-08T20:54:59.625096+0000","last_became_peered":"2024-05-08T20:54:59.625096+0000","last_unstale":"2024-05-08T21:21:21.602580+0000","last_undegraded":"2024-05-08T21:21:21.602580+0000","last_fullsized":"2024-05-08T21:21:21.602580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3441","last_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_deep_scrub":"27'3441","last_deep_scrub_stamp":"2024-05-08T21:21:21.602478+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.602478+0000","objects_scrubbed":5,"log_size":3441,"log_dups_size":0,"ondisk_log_size":3441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:12.507196+0000","scrub_duration":0.053816461000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3441,"num_write_kb":26181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'810","reported_seq":850,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:26.215510+0000","last_change":"2024-05-08T21:21:26.215510+0000","last_active":"2024-05-08T21:21:26.215510+0000","last_peered":"2024-05-08T21:21:26.215510+0000","last_clean":"2024-05-08T21:21:26.215510+0000","last_became_active":"2024-05-08T20:55:00.093484+0000","last_became_peered":"2024-05-08T20:55:00.093484+0000","last_unstale":"2024-05-08T21:21:26.215510+0000","last_undegraded":"2024-05-08T21:21:26.215510+0000","last_fullsized":"2024-05-08T21:21:26.215510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'810","last_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_deep_scrub":"27'810","last_deep_scrub_stamp":"2024-05-08T21:21:26.215374+0000","last_clean_scrub_stamp":"2024-05-08T21:21:26.215374+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:22.000760+0000","scrub_duration":0.0030007150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"27'3693","reported_seq":3741,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:23.953677+0000","last_change":"2024-05-08T21:22:23.953833+0000","last_active":"2024-05-08T21:22:23.953677+0000","last_peered":"2024-05-08T21:22:23.953677+0000","last_clean":"2024-05-08T21:22:23.953677+0000","last_became_active":"2024-05-08T20:55:41.613323+0000","last_became_peered":"2024-05-08T20:55:41.613323+0000","last_unstale":"2024-05-08T21:22:23.953677+0000","last_undegraded":"2024-05-08T21:22:23.953677+0000","last_fullsized":"2024-05-08T21:22:23.953677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3693","last_scrub_stamp":"2024-05-08T21:22:23.953649+0000","last_deep_scrub":"27'3693","last_deep_scrub_stamp":"2024-05-08T21:22:23.953649+0000","last_clean_scrub_stamp":"2024-05-08T21:22:23.953649+0000","objects_scrubbed":0,"log_size":3693,"log_dups_size":0,"ondisk_log_size":3693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:31:11.355268+0000","scrub_duration":0.012518892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2846,"num_write_kb":86797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'3911","reported_seq":3951,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:21.858266+0000","last_change":"2024-05-08T21:21:21.858266+0000","last_active":"2024-05-08T21:21:21.858266+0000","last_peered":"2024-05-08T21:21:21.858266+0000","last_clean":"2024-05-08T21:21:21.858266+0000","last_became_active":"2024-05-08T20:54:59.617915+0000","last_became_peered":"2024-05-08T20:54:59.617915+0000","last_unstale":"2024-05-08T21:21:21.858266+0000","last_undegraded":"2024-05-08T21:21:21.858266+0000","last_fullsized":"2024-05-08T21:21:21.858266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3911","last_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_deep_scrub":"27'3911","last_deep_scrub_stamp":"2024-05-08T21:21:21.858055+0000","last_clean_scrub_stamp":"2024-05-08T21:21:21.858055+0000","objects_scrubbed":2,"log_size":3911,"log_dups_size":0,"ondisk_log_size":3911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:12.384037+0000","scrub_duration":0.015982177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3918,"num_write_kb":30474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'819","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:56.841143+0000","last_change":"2024-05-08T21:21:56.841143+0000","last_active":"2024-05-08T21:21:56.841143+0000","last_peered":"2024-05-08T21:21:56.841143+0000","last_clean":"2024-05-08T21:21:56.841143+0000","last_became_active":"2024-05-08T20:55:00.092477+0000","last_became_peered":"2024-05-08T20:55:00.092477+0000","last_unstale":"2024-05-08T21:21:56.841143+0000","last_undegraded":"2024-05-08T21:21:56.841143+0000","last_fullsized":"2024-05-08T21:21:56.841143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'819","last_scrub_stamp":"2024-05-08T21:21:56.841000+0000","last_deep_scrub":"27'819","last_deep_scrub_stamp":"2024-05-08T21:21:56.841000+0000","last_clean_scrub_stamp":"2024-05-08T21:21:56.841000+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:13.060070+0000","scrub_duration":0.0020392829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"27'3388","reported_seq":3426,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:16.039799+0000","last_change":"2024-05-08T21:22:16.039962+0000","last_active":"2024-05-08T21:22:16.039799+0000","last_peered":"2024-05-08T21:22:16.039799+0000","last_clean":"2024-05-08T21:22:16.039799+0000","last_became_active":"2024-05-08T20:55:04.210442+0000","last_became_peered":"2024-05-08T20:55:04.210442+0000","last_unstale":"2024-05-08T21:22:16.039799+0000","last_undegraded":"2024-05-08T21:22:16.039799+0000","last_fullsized":"2024-05-08T21:22:16.039799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3388","last_scrub_stamp":"2024-05-08T21:22:16.039771+0000","last_deep_scrub":"27'3388","last_deep_scrub_stamp":"2024-05-08T21:22:16.039771+0000","last_clean_scrub_stamp":"2024-05-08T21:22:16.039771+0000","objects_scrubbed":0,"log_size":3388,"log_dups_size":0,"ondisk_log_size":3388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:25:39.902871+0000","scrub_duration":0.016518066000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2548,"num_write_kb":59802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"27'1802","reported_seq":1843,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:22.593429+0000","last_change":"2024-05-08T21:21:22.593429+0000","last_active":"2024-05-08T21:21:22.593429+0000","last_peered":"2024-05-08T21:21:22.593429+0000","last_clean":"2024-05-08T21:21:22.593429+0000","last_became_active":"2024-05-08T20:54:59.623650+0000","last_became_peered":"2024-05-08T20:54:59.623650+0000","last_unstale":"2024-05-08T21:21:22.593429+0000","last_undegraded":"2024-05-08T21:21:22.593429+0000","last_fullsized":"2024-05-08T21:21:22.593429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1802","last_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_deep_scrub":"27'1802","last_deep_scrub_stamp":"2024-05-08T21:21:22.593300+0000","last_clean_scrub_stamp":"2024-05-08T21:21:22.593300+0000","objects_scrubbed":1,"log_size":1802,"log_dups_size":0,"ondisk_log_size":1802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:44.040446+0000","scrub_duration":0.0043429840000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":13098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'818","reported_seq":858,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.201091+0000","last_change":"2024-05-08T21:21:52.201091+0000","last_active":"2024-05-08T21:21:52.201091+0000","last_peered":"2024-05-08T21:21:52.201091+0000","last_clean":"2024-05-08T21:21:52.201091+0000","last_became_active":"2024-05-08T20:55:00.095783+0000","last_became_peered":"2024-05-08T20:55:00.095783+0000","last_unstale":"2024-05-08T21:21:52.201091+0000","last_undegraded":"2024-05-08T21:21:52.201091+0000","last_fullsized":"2024-05-08T21:21:52.201091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:52.200940+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:52.200940+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.200940+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:48.039338+0000","scrub_duration":0.0051215999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'845","reported_seq":885,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:59.887670+0000","last_change":"2024-05-08T21:21:59.887670+0000","last_active":"2024-05-08T21:21:59.887670+0000","last_peered":"2024-05-08T21:21:59.887670+0000","last_clean":"2024-05-08T21:21:59.887670+0000","last_became_active":"2024-05-08T20:55:00.090357+0000","last_became_peered":"2024-05-08T20:55:00.090357+0000","last_unstale":"2024-05-08T21:21:59.887670+0000","last_undegraded":"2024-05-08T21:21:59.887670+0000","last_fullsized":"2024-05-08T21:21:59.887670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'845","last_scrub_stamp":"2024-05-08T21:21:59.887533+0000","last_deep_scrub":"27'845","last_deep_scrub_stamp":"2024-05-08T21:21:59.887533+0000","last_clean_scrub_stamp":"2024-05-08T21:21:59.887533+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:12.518654+0000","scrub_duration":0.0022607679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'869","reported_seq":918,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:28.662357+0000","last_change":"2024-05-08T21:21:28.662357+0000","last_active":"2024-05-08T21:21:28.662357+0000","last_peered":"2024-05-08T21:21:28.662357+0000","last_clean":"2024-05-08T21:21:28.662357+0000","last_became_active":"2024-05-08T20:55:42.114846+0000","last_became_peered":"2024-05-08T20:55:42.114846+0000","last_unstale":"2024-05-08T21:21:28.662357+0000","last_undegraded":"2024-05-08T21:21:28.662357+0000","last_fullsized":"2024-05-08T21:21:28.662357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'869","last_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_deep_scrub":"27'869","last_deep_scrub_stamp":"2024-05-08T21:21:28.662201+0000","last_clean_scrub_stamp":"2024-05-08T21:21:28.662201+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:47.788156+0000","scrub_duration":0.0052510159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'817","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:24.739823+0000","last_change":"2024-05-08T21:21:24.739823+0000","last_active":"2024-05-08T21:21:24.739823+0000","last_peered":"2024-05-08T21:21:24.739823+0000","last_clean":"2024-05-08T21:21:24.739823+0000","last_became_active":"2024-05-08T20:55:00.092147+0000","last_became_peered":"2024-05-08T20:55:00.092147+0000","last_unstale":"2024-05-08T21:21:24.739823+0000","last_undegraded":"2024-05-08T21:21:24.739823+0000","last_fullsized":"2024-05-08T21:21:24.739823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'817","last_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_deep_scrub":"27'817","last_deep_scrub_stamp":"2024-05-08T21:21:24.739660+0000","last_clean_scrub_stamp":"2024-05-08T21:21:24.739660+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:15.265642+0000","scrub_duration":0.002018003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'848","reported_seq":889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:51.015747+0000","last_change":"2024-05-08T21:21:51.015747+0000","last_active":"2024-05-08T21:21:51.015747+0000","last_peered":"2024-05-08T21:21:51.015747+0000","last_clean":"2024-05-08T21:21:51.015747+0000","last_became_active":"2024-05-08T20:55:00.094668+0000","last_became_peered":"2024-05-08T20:55:00.094668+0000","last_unstale":"2024-05-08T21:21:51.015747+0000","last_undegraded":"2024-05-08T21:21:51.015747+0000","last_fullsized":"2024-05-08T21:21:51.015747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'848","last_scrub_stamp":"2024-05-08T21:21:51.015622+0000","last_deep_scrub":"27'848","last_deep_scrub_stamp":"2024-05-08T21:21:51.015622+0000","last_clean_scrub_stamp":"2024-05-08T21:21:51.015622+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:07.234691+0000","scrub_duration":0.0025535380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'814","reported_seq":854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.874297+0000","last_change":"2024-05-08T21:21:52.874413+0000","last_active":"2024-05-08T21:21:52.874297+0000","last_peered":"2024-05-08T21:21:52.874297+0000","last_clean":"2024-05-08T21:21:52.874297+0000","last_became_active":"2024-05-08T20:55:00.087052+0000","last_became_peered":"2024-05-08T20:55:00.087052+0000","last_unstale":"2024-05-08T21:21:52.874297+0000","last_undegraded":"2024-05-08T21:21:52.874297+0000","last_fullsized":"2024-05-08T21:21:52.874297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'814","last_scrub_stamp":"2024-05-08T21:21:52.874259+0000","last_deep_scrub":"27'814","last_deep_scrub_stamp":"2024-05-08T21:21:52.874259+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.874259+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:16.138326+0000","scrub_duration":0.001750756,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'818","reported_seq":857,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:44.965165+0000","last_change":"2024-05-08T21:21:44.965262+0000","last_active":"2024-05-08T21:21:44.965165+0000","last_peered":"2024-05-08T21:21:44.965165+0000","last_clean":"2024-05-08T21:21:44.965165+0000","last_became_active":"2024-05-08T20:55:00.090151+0000","last_became_peered":"2024-05-08T20:55:00.090151+0000","last_unstale":"2024-05-08T21:21:44.965165+0000","last_undegraded":"2024-05-08T21:21:44.965165+0000","last_fullsized":"2024-05-08T21:21:44.965165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'818","last_scrub_stamp":"2024-05-08T21:21:44.965141+0000","last_deep_scrub":"27'818","last_deep_scrub_stamp":"2024-05-08T21:21:44.965141+0000","last_clean_scrub_stamp":"2024-05-08T21:21:44.965141+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:39.837977+0000","scrub_duration":0.0064359550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'882","reported_seq":921,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:22:01.857579+0000","last_change":"2024-05-08T21:22:01.857676+0000","last_active":"2024-05-08T21:22:01.857579+0000","last_peered":"2024-05-08T21:22:01.857579+0000","last_clean":"2024-05-08T21:22:01.857579+0000","last_became_active":"2024-05-08T20:55:00.093703+0000","last_became_peered":"2024-05-08T20:55:00.093703+0000","last_unstale":"2024-05-08T21:22:01.857579+0000","last_undegraded":"2024-05-08T21:22:01.857579+0000","last_fullsized":"2024-05-08T21:22:01.857579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'882","last_scrub_stamp":"2024-05-08T21:22:01.857552+0000","last_deep_scrub":"27'882","last_deep_scrub_stamp":"2024-05-08T21:22:01.857552+0000","last_clean_scrub_stamp":"2024-05-08T21:22:01.857552+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:38.930362+0000","scrub_duration":0.0015362259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'808","reported_seq":848,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:23.790030+0000","last_change":"2024-05-08T21:21:23.790119+0000","last_active":"2024-05-08T21:21:23.790030+0000","last_peered":"2024-05-08T21:21:23.790030+0000","last_clean":"2024-05-08T21:21:23.790030+0000","last_became_active":"2024-05-08T20:55:00.091479+0000","last_became_peered":"2024-05-08T20:55:00.091479+0000","last_unstale":"2024-05-08T21:21:23.790030+0000","last_undegraded":"2024-05-08T21:21:23.790030+0000","last_fullsized":"2024-05-08T21:21:23.790030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'808","last_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_deep_scrub":"27'808","last_deep_scrub_stamp":"2024-05-08T21:21:23.790007+0000","last_clean_scrub_stamp":"2024-05-08T21:21:23.790007+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:23:31.585133+0000","scrub_duration":0.0053510820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'808","reported_seq":847,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.760633+0000","last_change":"2024-05-08T21:21:47.760795+0000","last_active":"2024-05-08T21:21:47.760633+0000","last_peered":"2024-05-08T21:21:47.760633+0000","last_clean":"2024-05-08T21:21:47.760633+0000","last_became_active":"2024-05-08T20:55:00.097234+0000","last_became_peered":"2024-05-08T20:55:00.097234+0000","last_unstale":"2024-05-08T21:21:47.760633+0000","last_undegraded":"2024-05-08T21:21:47.760633+0000","last_fullsized":"2024-05-08T21:21:47.760633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'808","last_scrub_stamp":"2024-05-08T21:21:47.760591+0000","last_deep_scrub":"27'808","last_deep_scrub_stamp":"2024-05-08T21:21:47.760591+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.760591+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:42.633427+0000","scrub_duration":0.0020371019999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'798","reported_seq":838,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:45.956784+0000","last_change":"2024-05-08T21:21:45.956784+0000","last_active":"2024-05-08T21:21:45.956784+0000","last_peered":"2024-05-08T21:21:45.956784+0000","last_clean":"2024-05-08T21:21:45.956784+0000","last_became_active":"2024-05-08T20:55:00.085108+0000","last_became_peered":"2024-05-08T20:55:00.085108+0000","last_unstale":"2024-05-08T21:21:45.956784+0000","last_undegraded":"2024-05-08T21:21:45.956784+0000","last_fullsized":"2024-05-08T21:21:45.956784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'798","last_scrub_stamp":"2024-05-08T21:21:45.956652+0000","last_deep_scrub":"27'798","last_deep_scrub_stamp":"2024-05-08T21:21:45.956652+0000","last_clean_scrub_stamp":"2024-05-08T21:21:45.956652+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:25.833049+0000","scrub_duration":0.0027042889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'833","reported_seq":872,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:58.840570+0000","last_change":"2024-05-08T21:21:58.840570+0000","last_active":"2024-05-08T21:21:58.840570+0000","last_peered":"2024-05-08T21:21:58.840570+0000","last_clean":"2024-05-08T21:21:58.840570+0000","last_became_active":"2024-05-08T20:55:00.100737+0000","last_became_peered":"2024-05-08T20:55:00.100737+0000","last_unstale":"2024-05-08T21:21:58.840570+0000","last_undegraded":"2024-05-08T21:21:58.840570+0000","last_fullsized":"2024-05-08T21:21:58.840570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'833","last_scrub_stamp":"2024-05-08T21:21:58.840443+0000","last_deep_scrub":"27'833","last_deep_scrub_stamp":"2024-05-08T21:21:58.840443+0000","last_clean_scrub_stamp":"2024-05-08T21:21:58.840443+0000","objects_scrubbed":0,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:57.029426+0000","scrub_duration":0.0016211890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'841","reported_seq":881,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:52.961917+0000","last_change":"2024-05-08T21:21:52.961917+0000","last_active":"2024-05-08T21:21:52.961917+0000","last_peered":"2024-05-08T21:21:52.961917+0000","last_clean":"2024-05-08T21:21:52.961917+0000","last_became_active":"2024-05-08T20:55:00.100621+0000","last_became_peered":"2024-05-08T20:55:00.100621+0000","last_unstale":"2024-05-08T21:21:52.961917+0000","last_undegraded":"2024-05-08T21:21:52.961917+0000","last_fullsized":"2024-05-08T21:21:52.961917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'841","last_scrub_stamp":"2024-05-08T21:21:52.961795+0000","last_deep_scrub":"27'841","last_deep_scrub_stamp":"2024-05-08T21:21:52.961795+0000","last_clean_scrub_stamp":"2024-05-08T21:21:52.961795+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:48:51.150777+0000","scrub_duration":0.0037096870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'836","reported_seq":875,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T21:21:47.919525+0000","last_change":"2024-05-08T21:21:47.919525+0000","last_active":"2024-05-08T21:21:47.919525+0000","last_peered":"2024-05-08T21:21:47.919525+0000","last_clean":"2024-05-08T21:21:47.919525+0000","last_became_active":"2024-05-08T20:55:00.089917+0000","last_became_peered":"2024-05-08T20:55:00.089917+0000","last_unstale":"2024-05-08T21:21:47.919525+0000","last_undegraded":"2024-05-08T21:21:47.919525+0000","last_fullsized":"2024-05-08T21:21:47.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'836","last_scrub_stamp":"2024-05-08T21:21:47.919374+0000","last_deep_scrub":"27'836","last_deep_scrub_stamp":"2024-05-08T21:21:47.919374+0000","last_clean_scrub_stamp":"2024-05-08T21:21:47.919374+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:04.138444+0000","scrub_duration":0.001520024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86560,"num_write_kb":3335518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113556,"ondisk_log_size":113556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52760,"ondisk_log_size":52760,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":243565076,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":2931,"num_read_kb":7530,"num_write":91807,"num_write_kb":660236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5941,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":487194624,"data_stored":487130152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91125,"ondisk_log_size":91125,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575187,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520812,"kb_used_data":66404,"kb_used_omap":1,"kb_used_meta":454398,"kb_avail":93851028,"statfs":{"total":96636764160,"available":96103452672,"internally_reserved":0,"allocated":67997696,"data_stored":67818226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":465304011},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.74299999999999999,"15min":0.48999999999999999},"min":{"1min":0.41199999999999998,"5min":0.224,"15min":0.191},"max":{"1min":0.69199999999999995,"5min":9.2940000000000005,"15min":9.2940000000000005},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.69799999999999995,"15min":0.51900000000000002},"min":{"1min":0.47199999999999998,"5min":0.23400000000000001,"15min":0.215},"max":{"1min":0.752,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Wed May 8 21:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.78500000000000003,"15min":0.52100000000000002},"min":{"1min":0.44500000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.71599999999999997,"5min":11.247999999999999,"15min":11.247999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.71299999999999997,"15min":0.53700000000000003},"min":{"1min":0.46400000000000002,"5min":0.23499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71099999999999997,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.73499999999999999}]},{"osd":2,"last update":"Wed May 8 21:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63600000000000001,"15min":0.51800000000000002},"min":{"1min":0.53700000000000003,"5min":0.254,"15min":0.23799999999999999},"max":{"1min":0.77200000000000002,"5min":4.3650000000000002,"15min":4.3650000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.64300000000000002,"15min":0.52300000000000002},"min":{"1min":0.46000000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73499999999999999,"5min":8.9450000000000003,"15min":8.9450000000000003},"last":0.75900000000000001}]},{"osd":3,"last update":"Wed May 8 21:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.79700000000000004,"15min":0.57399999999999995},"min":{"1min":0.441,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.68999999999999995,"5min":10.702999999999999,"15min":10.702999999999999},"last":0.749},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.83499999999999996,"15min":0.627},"min":{"1min":0.40999999999999998,"5min":0.29099999999999998,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":9.0800000000000001,"15min":9.0800000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Wed May 8 21:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.57399999999999995,"15min":0.51500000000000001},"min":{"1min":0.379,"5min":0.253,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":5.2320000000000002,"15min":5.2320000000000002},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.68200000000000005,"15min":0.55100000000000005},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":6.6630000000000003,"15min":6.6630000000000003},"last":0.61899999999999999}]},{"osd":5,"last update":"Wed May 8 21:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.67600000000000005,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.28399999999999997,"15min":0.245},"max":{"1min":0.67700000000000005,"5min":8.9849999999999994,"15min":8.9849999999999994},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.751,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.314,"15min":0.28199999999999997},"max":{"1min":0.77200000000000002,"5min":6.5250000000000004,"15min":6.5250000000000004},"last":0.66700000000000004}]},{"osd":6,"last update":"Wed May 8 21:22:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.68300000000000005,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.34100000000000003,"15min":0.25900000000000001},"max":{"1min":0.72399999999999998,"5min":9.1050000000000004,"15min":9.1050000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.75700000000000001,"15min":0.61499999999999999},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.312},"max":{"1min":0.82299999999999995,"5min":6.6399999999999997,"15min":6.6399999999999997},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575187,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547768,"kb_used_data":79536,"kb_used_omap":1,"kb_used_meta":468222,"kb_avail":93824072,"statfs":{"total":96636764160,"available":96075849728,"internally_reserved":0,"allocated":81444864,"data_stored":81263168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":479459783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.27600000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":4.0460000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":9.1980000000000004,"5min":9.1980000000000004,"15min":9.1980000000000004},"last":0.436}]},{"osd":1,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.58799999999999997,"15min":0.505},"min":{"1min":0.26600000000000001,"5min":0.22600000000000001,"15min":0.219},"max":{"1min":0.67100000000000004,"5min":9.6509999999999998,"15min":9.6509999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":1.849,"5min":0.79200000000000004,"15min":0.57799999999999996},"min":{"1min":0.33300000000000002,"5min":0.246,"15min":0.23999999999999999},"max":{"1min":26.343,"5min":26.343,"15min":26.343},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.496},"min":{"1min":0.36199999999999999,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.0089999999999999,"5min":3.694,"15min":3.694},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.64000000000000001,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.26800000000000002,"15min":0.23499999999999999},"max":{"1min":9.1539999999999999,"5min":9.1539999999999999,"15min":9.1539999999999999},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.50800000000000001},"min":{"1min":0.309,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":0.74399999999999999,"5min":2.278,"15min":3.8250000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.26100000000000001},"max":{"1min":2.3039999999999998,"5min":3.6200000000000001,"15min":6.4009999999999998},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.54400000000000004,"15min":0.504},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":4.5670000000000002,"5min":4.5670000000000002,"15min":7.3810000000000002},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.089,"5min":0.70999999999999996,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.307,"15min":0.222},"max":{"1min":12.109999999999999,"5min":12.109999999999999,"15min":12.109999999999999},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54100000000000004,"15min":0.505},"min":{"1min":0.34699999999999998,"5min":0.28000000000000003,"15min":0.25700000000000001},"max":{"1min":1.8680000000000001,"5min":2.9449999999999998,"15min":3.8210000000000002},"last":0.377},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.57299999999999995},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.28000000000000003},"max":{"1min":0.80700000000000005,"5min":3.024,"15min":4.0119999999999996},"last":0.499}]},{"osd":7,"last update":"Wed May 8 21:21:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":0.86199999999999999,"5min":2.2989999999999999,"15min":3.8100000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.56899999999999995},"min":{"1min":0.441,"5min":0.34599999999999997,"15min":0.28699999999999998},"max":{"1min":0.75600000000000001,"5min":2.919,"15min":3.8780000000000001},"last":0.52800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575187,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581444,"kb_used_data":81084,"kb_used_omap":1,"kb_used_meta":500350,"kb_avail":93790396,"statfs":{"total":96636764160,"available":96041365504,"internally_reserved":0,"allocated":83030016,"data_stored":82846318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":512358854},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:22:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.46800000000000003,"15min":0.377},"min":{"1min":0.246,"5min":0.184,"15min":0.17899999999999999},"max":{"1min":0.48199999999999998,"5min":7.1829999999999998,"15min":7.1829999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.432,"15min":0.39500000000000002},"min":{"1min":0.30099999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.52900000000000003,"5min":5.8179999999999996,"15min":5.8179999999999996},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed May 8 21:22:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.433,"15min":0.40000000000000002},"min":{"1min":0.32400000000000001,"5min":0.19500000000000001,"15min":0.189},"max":{"1min":0.51100000000000001,"5min":5.141,"15min":5.141},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56799999999999995,"15min":0.47499999999999998},"min":{"1min":0.35499999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.63,"5min":7.5389999999999997,"15min":7.5389999999999997},"last":0.60199999999999998}]},{"osd":3,"last update":"Wed May 8 21:22:37 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.66100000000000003,"15min":0.51200000000000001},"min":{"1min":0.38800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.64000000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.51500000000000001,"15min":0.47099999999999997},"min":{"1min":0.35199999999999998,"5min":0.223,"15min":0.19},"max":{"1min":0.65500000000000003,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":0.65600000000000003}]},{"osd":4,"last update":"Wed May 8 21:22:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.52100000000000002},"min":{"1min":0.439,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":5.0220000000000002,"15min":6.1379999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.69699999999999995,"15min":0.56599999999999995},"min":{"1min":0.51000000000000001,"5min":0.29399999999999998,"15min":0.248},"max":{"1min":0.90200000000000002,"5min":7.4980000000000002,"15min":7.4980000000000002},"last":0.94799999999999995}]},{"osd":5,"last update":"Wed May 8 21:22:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59699999999999998,"15min":0.52600000000000002},"min":{"1min":0.501,"5min":0.252,"15min":0.252},"max":{"1min":0.97599999999999998,"5min":5.3449999999999998,"15min":5.3449999999999998},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.59799999999999998,"15min":0.57599999999999996},"min":{"1min":0.51800000000000002,"5min":0.311,"15min":0.29199999999999998},"max":{"1min":0.95199999999999996,"5min":6.8049999999999997,"15min":6.8049999999999997},"last":0.751}]},{"osd":6,"last update":"Wed May 8 21:22:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67700000000000005,"15min":0.57399999999999995},"min":{"1min":0.46300000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.93600000000000005,"5min":7.5199999999999996,"15min":7.5199999999999996},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.625,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.34899999999999998,"15min":0.28499999999999998},"max":{"1min":0.88500000000000001,"5min":6.766,"15min":6.766},"last":0.77000000000000002}]},{"osd":7,"last update":"Wed May 8 21:22:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.77300000000000002,"15min":0.62},"min":{"1min":0.51200000000000001,"5min":0.36299999999999999,"15min":0.33800000000000002},"max":{"1min":0.84799999999999998,"5min":7.5640000000000001,"15min":7.5640000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69399999999999995,"15min":0.63400000000000001},"min":{"1min":0.47599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.92400000000000004,"5min":5.3769999999999998,"15min":6.0789999999999997},"last":0.96599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575188,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375604,"kb_used_data":29548,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93996236,"statfs":{"total":96636764160,"available":96252145664,"internally_reserved":0,"allocated":30257152,"data_stored":30069546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":354351559},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.40500000000000003,"15min":0.34699999999999998},"min":{"1min":0.20899999999999999,"5min":0.191,"15min":0.16600000000000001},"max":{"1min":0.86099999999999999,"5min":3.823,"15min":3.823},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.45200000000000001,"15min":0.41199999999999998},"min":{"1min":0.27600000000000002,"5min":0.23100000000000001,"15min":0.19},"max":{"1min":2.734,"5min":3.879,"15min":4.5919999999999996},"last":0.52500000000000002}]},{"osd":2,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.45700000000000002,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20999999999999999,"15min":0.17399999999999999},"max":{"1min":4.6399999999999997,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":0.443},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.23899999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.9870000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.49199999999999999,"15min":0.438},"min":{"1min":0.26900000000000002,"5min":0.219,"15min":0.19900000000000001},"max":{"1min":2.4900000000000002,"5min":3.7160000000000002,"15min":3.895},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.498,"15min":0.44400000000000001},"min":{"1min":0.26500000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"max":{"1min":2.4750000000000001,"5min":3.2050000000000001,"15min":3.2480000000000002},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.48499999999999999},"min":{"1min":0.38500000000000001,"5min":0.26400000000000001,"15min":0.254},"max":{"1min":1.127,"5min":3.794,"15min":5.6559999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.496,"15min":0.45900000000000002},"min":{"1min":0.36199999999999999,"5min":0.30299999999999999,"15min":0.29199999999999998},"max":{"1min":0.76400000000000001,"5min":1.7070000000000001,"15min":3.0339999999999998},"last":0.73899999999999999}]},{"osd":5,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.55500000000000005,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":4.298,"5min":4.298,"15min":4.298},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.77100000000000002,"15min":0.60299999999999998},"min":{"1min":0.40300000000000002,"5min":0.29399999999999998,"15min":0.28199999999999997},"max":{"1min":1.206,"5min":14.901,"15min":14.901},"last":0.64300000000000002}]},{"osd":6,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.29999999999999999,"15min":0.29199999999999998},"max":{"1min":1.0329999999999999,"5min":4.7759999999999998,"15min":8.1739999999999995},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.60199999999999998,"15min":0.58299999999999996},"min":{"1min":0.36299999999999999,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":2.7669999999999999,"5min":5.0899999999999999,"15min":5.0899999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Wed May 8 21:21:41 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.31900000000000001},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":5.0220000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.61699999999999999},"min":{"1min":0.45300000000000001,"5min":0.34999999999999998,"15min":0.34300000000000003},"max":{"1min":1.1739999999999999,"5min":3.7490000000000001,"15min":8.5850000000000009},"last":0.79000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575187,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320932,"kb_used_data":33052,"kb_used_omap":1,"kb_used_meta":287870,"kb_avail":94050908,"statfs":{"total":96636764160,"available":96308129792,"internally_reserved":0,"allocated":33845248,"data_stored":33672844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294779334},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:22:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42199999999999999,"15min":0.34999999999999998},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.17599999999999999},"max":{"1min":0.56200000000000006,"5min":2.9350000000000001,"15min":3.8599999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.47499999999999998,"15min":0.41399999999999998},"min":{"1min":0.252,"5min":0.214,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":5.7359999999999998,"15min":9.0359999999999996},"last":0.29299999999999998}]},{"osd":1,"last update":"Wed May 8 21:22:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47599999999999998,"15min":0.40400000000000003},"min":{"1min":0.26300000000000001,"5min":0.20899999999999999,"15min":0.186},"max":{"1min":0.625,"5min":2.5089999999999999,"15min":5.9720000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.60499999999999998,"15min":0.48299999999999998},"min":{"1min":0.24399999999999999,"5min":0.21099999999999999,"15min":0.19700000000000001},"max":{"1min":0.60599999999999998,"5min":6.5170000000000003,"15min":6.5170000000000003},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed May 8 21:22:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44900000000000001,"15min":0.40300000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20200000000000001},"max":{"1min":0.59299999999999997,"5min":2.0329999999999999,"15min":3.2080000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.47599999999999998},"min":{"1min":0.28899999999999998,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":0.68700000000000006,"5min":2.0150000000000001,"15min":9.5109999999999992},"last":0.35699999999999998}]},{"osd":4,"last update":"Wed May 8 21:22:24 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65200000000000002,"15min":0.59099999999999997},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.26000000000000001},"max":{"1min":0.79900000000000004,"5min":7.3799999999999999,"15min":16.651},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.64600000000000002},"min":{"1min":0.38400000000000001,"5min":0.28699999999999998,"15min":0.27400000000000002},"max":{"1min":0.96199999999999997,"5min":5.7039999999999997,"15min":16.632000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Wed May 8 21:22:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.70999999999999996,"15min":0.56200000000000006},"min":{"1min":0.35899999999999999,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":0.97699999999999998,"5min":7.2599999999999998,"15min":7.2599999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.73299999999999998,"15min":0.624},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.91700000000000004,"5min":9.2729999999999997,"15min":9.2729999999999997},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed May 8 21:22:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.65900000000000003,"15min":0.60299999999999998},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.27400000000000002},"max":{"1min":0.998,"5min":4.0789999999999997,"15min":6.1630000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64100000000000001,"15min":0.55700000000000005},"min":{"1min":0.47099999999999997,"5min":0.34399999999999997,"15min":0.309},"max":{"1min":1.0669999999999999,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.754}]},{"osd":7,"last update":"Wed May 8 21:22:24 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.78600000000000003,"15min":0.64600000000000002},"min":{"1min":0.40200000000000002,"5min":0.35399999999999998,"15min":0.34399999999999997},"max":{"1min":1.0189999999999999,"5min":5.8499999999999996,"15min":6.2000000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.77300000000000002,"15min":0.61599999999999999},"min":{"1min":0.46200000000000002,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":1.03,"5min":11.736000000000001,"15min":11.736000000000001},"last":0.77300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575187,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505452,"kb_used_data":37156,"kb_used_omap":1,"kb_used_meta":468286,"kb_avail":93866388,"statfs":{"total":96636764160,"available":96119181312,"internally_reserved":0,"allocated":38047744,"data_stored":37867820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":479525320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:22:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.44500000000000001,"15min":0.436},"min":{"1min":0.27200000000000002,"5min":0.19,"15min":0.16900000000000001},"max":{"1min":0.56000000000000005,"5min":6.407,"15min":6.407},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.60999999999999999,"15min":0.50900000000000001},"min":{"1min":0.23899999999999999,"5min":0.191,"15min":0.17799999999999999},"max":{"1min":0.63500000000000001,"5min":16.724,"15min":16.724},"last":0.38100000000000001}]},{"osd":1,"last update":"Wed May 8 21:22:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.74299999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.20100000000000001,"15min":0.19800000000000001},"max":{"1min":0.71799999999999997,"5min":13.058,"15min":15.259},"last":0.312},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.61299999999999999,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.217,"15min":0.192},"max":{"1min":0.72899999999999998,"5min":9.5370000000000008,"15min":10.831},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed May 8 21:22:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.499,"15min":0.46899999999999997},"min":{"1min":0.32000000000000001,"5min":0.23000000000000001,"15min":0.214},"max":{"1min":0.54100000000000004,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.64500000000000002,"15min":0.53900000000000003},"min":{"1min":0.30299999999999999,"5min":0.25800000000000001,"15min":0.224},"max":{"1min":0.61799999999999999,"5min":5.9969999999999999,"15min":6.7960000000000003},"last":0.439}]},{"osd":4,"last update":"Wed May 8 21:22:42 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.76100000000000001,"15min":0.72399999999999998},"min":{"1min":0.48699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90900000000000003,"5min":9.3919999999999995,"15min":9.7759999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.98499999999999999,"15min":0.81999999999999995},"min":{"1min":0.55500000000000005,"5min":0.28599999999999998,"15min":0.26700000000000002},"max":{"1min":0.89200000000000002,"5min":11.755000000000001,"15min":15.224},"last":0.625}]},{"osd":5,"last update":"Wed May 8 21:22:42 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59299999999999997,"15min":0.55900000000000005},"min":{"1min":0.51100000000000001,"5min":0.28499999999999998,"15min":0.28399999999999997},"max":{"1min":0.878,"5min":2.3210000000000002,"15min":4.3860000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69699999999999995,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.86099999999999999,"5min":5.548,"15min":5.548},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed May 8 21:22:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.90900000000000003,"15min":0.71599999999999997},"min":{"1min":0.51900000000000002,"5min":0.31900000000000001,"15min":0.28599999999999998},"max":{"1min":0.97399999999999998,"5min":7.9509999999999996,"15min":7.9509999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.63200000000000001},"min":{"1min":0.50600000000000001,"5min":0.32400000000000001,"15min":0.30299999999999999},"max":{"1min":0.92600000000000005,"5min":2.2829999999999999,"15min":5.2530000000000001},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed May 8 21:22:42 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.82799999999999996,"15min":0.69299999999999995},"min":{"1min":0.5,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95999999999999996,"5min":8.4779999999999998,"15min":8.4779999999999998},"last":0.5},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.97099999999999997,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.40600000000000003,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":12.939,"15min":12.939},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575187,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":471792,"kb_used_data":53544,"kb_used_omap":1,"kb_used_meta":418238,"kb_avail":93900048,"statfs":{"total":96636764160,"available":96153649152,"internally_reserved":0,"allocated":54829056,"data_stored":54644490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":428276166},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.65500000000000003,"15min":0.51300000000000001},"min":{"1min":0.38500000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.752,"5min":7.4619999999999997,"15min":7.4619999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.51500000000000001},"min":{"1min":0.41099999999999998,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.72499999999999998,"5min":9.4900000000000002,"15min":9.4900000000000002},"last":0.496}]},{"osd":1,"last update":"Wed May 8 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.88100000000000001,"15min":0.58499999999999996},"min":{"1min":0.45200000000000001,"5min":0.23699999999999999,"15min":0.216},"max":{"1min":0.74199999999999999,"5min":18.529,"15min":18.529},"last":0.434},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.55700000000000005},"min":{"1min":0.40200000000000002,"5min":0.247,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":7.343,"15min":7.4370000000000003},"last":0.53500000000000003}]},{"osd":2,"last update":"Wed May 8 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.81100000000000005,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":0.71399999999999997,"5min":15.917,"15min":15.917},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.50700000000000001,"5min":0.27900000000000003,"15min":0.246},"max":{"1min":0.76600000000000001,"5min":3.9900000000000002,"15min":6.617},"last":0.57799999999999996}]},{"osd":3,"last update":"Wed May 8 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.79400000000000004,"15min":0.61899999999999999},"min":{"1min":0.46400000000000002,"5min":0.27500000000000002,"15min":0.249},"max":{"1min":0.66300000000000003,"5min":9.3759999999999994,"15min":9.3759999999999994},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.83399999999999996,"15min":0.63100000000000001},"min":{"1min":0.497,"5min":0.33200000000000002,"15min":0.29199999999999998},"max":{"1min":0.79700000000000004,"5min":15.956,"15min":15.956},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed May 8 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.70499999999999996,"15min":0.57999999999999996},"min":{"1min":0.32600000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.72299999999999998,"5min":15.766,"15min":15.766},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.68600000000000005,"15min":0.59699999999999998},"min":{"1min":0.379,"5min":0.28999999999999998,"15min":0.23100000000000001},"max":{"1min":0.68000000000000005,"5min":9.5259999999999998,"15min":9.5259999999999998},"last":0.39000000000000001}]},{"osd":6,"last update":"Wed May 8 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.80600000000000005,"15min":0.63100000000000001},"min":{"1min":0.35199999999999998,"5min":0.28599999999999998,"15min":0.27800000000000002},"max":{"1min":0.73399999999999999,"5min":18.463000000000001,"15min":18.463000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.41599999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.77700000000000002,"5min":5.0860000000000003,"15min":9.4550000000000001},"last":0.55800000000000005}]},{"osd":7,"last update":"Wed May 8 21:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.73499999999999999,"15min":0.64200000000000002},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.28000000000000003},"max":{"1min":0.751,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.90600000000000003,"15min":0.73099999999999998},"min":{"1min":0.40899999999999997,"5min":0.38,"15min":0.34499999999999997},"max":{"1min":0.77000000000000002,"5min":18.5,"15min":18.5},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575187,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":544972,"kb_used_data":98884,"kb_used_omap":1,"kb_used_meta":446078,"kb_avail":93826868,"statfs":{"total":96636764160,"available":96078712832,"internally_reserved":0,"allocated":101257216,"data_stored":101075772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":456784326},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:22:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59199999999999997,"15min":0.505},"min":{"1min":0.35699999999999998,"5min":0.22,"15min":0.20899999999999999},"max":{"1min":0.73199999999999998,"5min":7.3769999999999998,"15min":8.6400000000000006},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65500000000000003,"15min":0.63600000000000001},"min":{"1min":0.28699999999999998,"5min":0.23899999999999999,"15min":0.22800000000000001},"max":{"1min":0.76900000000000002,"5min":9.2059999999999995,"15min":24.800000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Wed May 8 21:22:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.70499999999999996,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.81399999999999995,"5min":15.426,"15min":27.719000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.69899999999999995,"15min":0.64800000000000002},"min":{"1min":0.38300000000000001,"5min":0.23899999999999999,"15min":0.20899999999999999},"max":{"1min":0.78000000000000003,"5min":7.1399999999999997,"15min":24.826000000000001},"last":0.64100000000000001}]},{"osd":2,"last update":"Wed May 8 21:22:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.66000000000000003,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.72899999999999998,"5min":7.4779999999999998,"15min":7.4779999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.623,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.28699999999999998,"15min":0.248},"max":{"1min":0.78200000000000003,"5min":7.4009999999999998,"15min":8.8119999999999994},"last":0.626}]},{"osd":3,"last update":"Wed May 8 21:22:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.74099999999999999,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.26200000000000001,"15min":0.251},"max":{"1min":0.77000000000000002,"5min":6.6559999999999997,"15min":24.606000000000002},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.70499999999999996,"15min":0.63300000000000001},"min":{"1min":0.48399999999999999,"5min":0.30299999999999999,"15min":0.253},"max":{"1min":0.76000000000000001,"5min":7.9909999999999997,"15min":7.9909999999999997},"last":0.61499999999999999}]},{"osd":4,"last update":"Wed May 8 21:22:30 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.626,"15min":0.81100000000000005},"min":{"1min":0.34799999999999998,"5min":0.248,"15min":0.22600000000000001},"max":{"1min":0.745,"5min":10.319000000000001,"15min":71.634},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.76100000000000001,"15min":1},"min":{"1min":0.371,"5min":0.29199999999999998,"15min":0.24199999999999999},"max":{"1min":0.755,"5min":10.032,"15min":101.794},"last":0.59699999999999998}]},{"osd":6,"last update":"Wed May 8 21:22:30 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.70499999999999996,"15min":0.628},"min":{"1min":0.38400000000000001,"5min":0.28499999999999998,"15min":0.254},"max":{"1min":0.70299999999999996,"5min":14.997,"15min":14.997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.79100000000000004,"15min":0.73499999999999999},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.26600000000000001},"max":{"1min":0.68700000000000006,"5min":19.137,"15min":28.053999999999998},"last":0.55400000000000005}]},{"osd":7,"last update":"Wed May 8 21:22:30 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":1.5049999999999999,"15min":1.026},"min":{"1min":0.40400000000000003,"5min":0.32300000000000001,"15min":0.30499999999999999},"max":{"1min":0.70399999999999996,"5min":67.849999999999994,"15min":67.849999999999994},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":1.5569999999999999,"15min":1.016},"min":{"1min":0.47699999999999998,"5min":0.32800000000000001,"15min":0.31},"max":{"1min":0.72999999999999998,"5min":67.561000000000007,"15min":67.561000000000007},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82739200,"data_stored":82727906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37756928,"data_stored":37749408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54538240,"data_stored":54526078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100966400,"data_stored":100957360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81154048,"data_stored":81144756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67109446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:22:45.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T21:22:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.141+0000 7f37c8bd2700 1 Processor -- start 2024-05-08T21:22:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.141+0000 7f37c8bd2700 1 -- start start 2024-05-08T21:22:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.141+0000 7f37c8bd2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f930 0x7f37c406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c8bd2700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f37c4153030 0x7f37c41534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c8bd2700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40c3c10 con 0x7f37c406f550 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c8bd2700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c4159c70 con 0x7f37c4153030 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c8bd2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4159f50 con 0x7f37c406f930 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c259c700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f37c406f550 0x7f37c4159420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35670/0 (socket says 172.21.15.135:35670) 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c259c700 1 -- 172.21.15.135:0/2691343357 learned_addr learned my addr 172.21.15.135:0/2691343357 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c2d9d700 1 --2- 172.21.15.135:0/2691343357 >> v2:172.21.15.183:3300/0 conn(0x7f37c4153030 0x7f37c41534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c1d9b700 1 --2- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f930 0x7f37c406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c159a700 1 -- 172.21.15.135:0/2691343357 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447938386 0 0) 0x7f37c40c3c10 con 0x7f37c406f550 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c159a700 1 -- 172.21.15.135:0/2691343357 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ac0035b0 con 0x7f37c406f550 2024-05-08T21:22:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c2d9d700 1 -- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f930 msgr2=0x7f37c406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c2d9d700 1 --2- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f930 0x7f37c406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c159a700 1 -- 172.21.15.135:0/2691343357 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161168741 0 0) 0x7f37ac0035b0 con 0x7f37c406f550 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c2d9d700 1 -- 172.21.15.135:0/2691343357 >> v1:172.21.15.135:6789/0 conn(0x7f37c406f550 legacy=0x7f37c4159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c2d9d700 1 -- 172.21.15.135:0/2691343357 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c415a230 con 0x7f37c4153030 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c1d9b700 1 --2- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f930 0x7f37c406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.142+0000 7f37c2d9d700 1 --2- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 0x7f37c41534c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009d90 tx=0x7f37bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9980a52cb3b82f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c159a700 1 -- 172.21.15.135:0/2691343357 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00e070 con 0x7f37c4153030 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c159a700 1 -- 172.21.15.135:0/2691343357 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc003a20 con 0x7f37c4153030 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c159a700 1 -- 172.21.15.135:0/2691343357 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4001670 con 0x7f37c4153030 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 -- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 msgr2=0x7f37c41534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 0x7f37c41534c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009d90 tx=0x7f37bc00b330 comp rx=0 tx=0).stop 2024-05-08T21:22:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 -- 172.21.15.135:0/2691343357 shutdown_connections 2024-05-08T21:22:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 0x7f37c41534c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/2691343357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f930 0x7f37c406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 -- 172.21.15.135:0/2691343357 >> 172.21.15.135:0/2691343357 conn(0x7f37c406d620 msgr2=0x7f37c406da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 -- 172.21.15.135:0/2691343357 shutdown_connections 2024-05-08T21:22:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.143+0000 7f37c8bd2700 1 -- 172.21.15.135:0/2691343357 wait complete. 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.144+0000 7f37c8bd2700 1 Processor -- start 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c8bd2700 1 -- start start 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c8bd2700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f550 0x7f37c41f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c8bd2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c406f930 0x7f37c41f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c8bd2700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 0x7f37c4157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c8bd2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c41f2a30 con 0x7f37c406f930 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c8bd2700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c41f1650 con 0x7f37c4153030 2024-05-08T21:22:46.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c8bd2700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c41f1930 con 0x7f37c406f550 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c1d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c406f930 0x7f37c41f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c1d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c406f930 0x7f37c41f2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49384/0 (socket says 172.21.15.135:49384) 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c1d9b700 1 -- 172.21.15.135:0/3958406479 learned_addr learned my addr 172.21.15.135:0/3958406479 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.145+0000 7f37c259c700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f550 0x7f37c41f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c2d9d700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 0x7f37c4157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c1d9b700 1 -- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f550 msgr2=0x7f37c41f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c1d9b700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f550 0x7f37c41f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c1d9b700 1 -- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 msgr2=0x7f37c4157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c1d9b700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 0x7f37c4157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c1d9b700 1 -- 172.21.15.135:0/3958406479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80094a0 con 0x7f37c406f930 2024-05-08T21:22:46.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c1d9b700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c406f930 0x7f37c41f2440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f37b800ebe0 tx=0x7f37b8009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800c910 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b800ca70 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800cde0 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc009a70 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.146+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c4156da0 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.147+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c4067fa0 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.147+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f37b8013470 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.148+0000 7f37b2ffd700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f37a406ac90 0x7f37a406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.148+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37b8089a40 con 0x7f37c406f930 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.148+0000 7f37c259c700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f37a406ac90 0x7f37a406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.148+0000 7f37c259c700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f37a406ac90 0x7f37a406d150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f37b4001eb0 tx=0x7f37b4001ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.152+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f37b808be60 con 0x7f37c406f930 2024-05-08T21:22:46.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.349+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f37c40cbe60 con 0x7f37c406f930 2024-05-08T21:22:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.354+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f37b8054750 con 0x7f37c406f930 2024-05-08T21:22:46.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.354+0000 7f37b2ffd700 1 -- 172.21.15.135:0/3958406479 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f37b80581e0 con 0x7f37c406f930 2024-05-08T21:22:46.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.356+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f37a406ac90 msgr2=0x7f37a406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.356+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f37a406ac90 0x7f37a406d150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f37b4001eb0 tx=0x7f37b4001ce0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.356+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c406f930 msgr2=0x7f37c41f2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.356+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c406f930 0x7f37c41f2440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f37b800ebe0 tx=0x7f37b8009ec0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.356+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 shutdown_connections 2024-05-08T21:22:46.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.357+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f37a406ac90 0x7f37a406d150 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.357+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37c4153030 0x7f37c4157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.357+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37c406f550 0x7f37c41f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.357+0000 7f37c8bd2700 1 --2- 172.21.15.135:0/3958406479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37c406f930 0x7f37c41f2440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.357+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 >> 172.21.15.135:0/3958406479 conn(0x7f37c406d620 msgr2=0x7f37c4150890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:46.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.357+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 shutdown_connections 2024-05-08T21:22:46.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.357+0000 7f37c8bd2700 1 -- 172.21.15.135:0/3958406479 wait complete. 2024-05-08T21:22:46.371 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T21:22:46.372 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:22:46.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.491+0000 7f9f4c992700 1 Processor -- start 2024-05-08T21:22:46.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.492+0000 7f9f4c992700 1 -- start start 2024-05-08T21:22:46.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.492+0000 7f9f4c992700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9f480c9520 0x7f9f4815a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.492+0000 7f9f4c992700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9f4806d0d0 0x7f9f480c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.492+0000 7f9f4c992700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f480cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.492+0000 7f9f4c992700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f480c9e40 con 0x7f9f4806d0d0 2024-05-08T21:22:46.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.492+0000 7f9f4c992700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4806bde0 con 0x7f9f480c9520 2024-05-08T21:22:46.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.492+0000 7f9f4c992700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4806c030 con 0x7f9f4815aa20 2024-05-08T21:22:46.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9f4806d0d0 0x7f9f480c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f9f4806d0d0 0x7f9f480c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49388/0 (socket says 172.21.15.135:49388) 2024-05-08T21:22:46.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 -- 172.21.15.135:0/2816948077 learned_addr learned my addr 172.21.15.135:0/2816948077 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:46.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f4659c700 1 --2- 172.21.15.135:0/2816948077 >> v2:172.21.15.183:3300/0 conn(0x7f9f480c9520 0x7f9f4815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f46d9d700 1 --2- 172.21.15.135:0/2816948077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f480cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 -- 172.21.15.135:0/2816948077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 msgr2=0x7f9f480cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:46.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 --2- 172.21.15.135:0/2816948077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f480cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 -- 172.21.15.135:0/2816948077 >> v2:172.21.15.183:3300/0 conn(0x7f9f480c9520 msgr2=0x7f9f4815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:46.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 --2- 172.21.15.135:0/2816948077 >> v2:172.21.15.183:3300/0 conn(0x7f9f480c9520 0x7f9f4815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 -- 172.21.15.135:0/2816948077 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4806c310 con 0x7f9f4806d0d0 2024-05-08T21:22:46.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f46d9d700 1 --2- 172.21.15.135:0/2816948077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f480cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:22:46.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f4659c700 1 --2- 172.21.15.135:0/2816948077 >> v2:172.21.15.183:3300/0 conn(0x7f9f480c9520 0x7f9f4815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:22:46.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f45d9b700 1 --2- 172.21.15.135:0/2816948077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f4806d0d0 0x7f9f480c9900 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9f480cc720 tx=0x7f9f30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f762bffc0acd42bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f4559a700 1 -- 172.21.15.135:0/2816948077 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000b870 con 0x7f9f4806d0d0 2024-05-08T21:22:46.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f4559a700 1 -- 172.21.15.135:0/2816948077 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9f3000b9d0 con 0x7f9f4806d0d0 2024-05-08T21:22:46.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.493+0000 7f9f4559a700 1 -- 172.21.15.135:0/2816948077 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000bd80 con 0x7f9f4806d0d0 2024-05-08T21:22:46.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 -- 172.21.15.135:0/2816948077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f4806d0d0 msgr2=0x7f9f480c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 --2- 172.21.15.135:0/2816948077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f4806d0d0 0x7f9f480c9900 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9f480cc720 tx=0x7f9f30009bd0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 -- 172.21.15.135:0/2816948077 shutdown_connections 2024-05-08T21:22:46.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 --2- 172.21.15.135:0/2816948077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f480cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 --2- 172.21.15.135:0/2816948077 >> v2:172.21.15.183:3300/0 conn(0x7f9f480c9520 0x7f9f4815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 --2- 172.21.15.135:0/2816948077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f4806d0d0 0x7f9f480c9900 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 -- 172.21.15.135:0/2816948077 >> 172.21.15.135:0/2816948077 conn(0x7f9f480b06d0 msgr2=0x7f9f480b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 -- 172.21.15.135:0/2816948077 shutdown_connections 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.494+0000 7f9f4c992700 1 -- 172.21.15.135:0/2816948077 wait complete. 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.495+0000 7f9f4c992700 1 Processor -- start 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.495+0000 7f9f4c992700 1 -- start start 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f4c992700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f4806d0d0 0x7f9f4814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f4c992700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f480c9520 0x7f9f480c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f4c992700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f4814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f4c992700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4814e950 con 0x7f9f480c9520 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f4c992700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f480c6e60 con 0x7f9f4806d0d0 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f4c992700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4814d770 con 0x7f9f4815aa20 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f480c9520 0x7f9f480c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f480c9520 0x7f9f480c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49402/0 (socket says 172.21.15.135:49402) 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 -- 172.21.15.135:0/83809878 learned_addr learned my addr 172.21.15.135:0/83809878 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f46d9d700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f4814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f4659c700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f4806d0d0 0x7f9f4814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 -- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 msgr2=0x7f9f4814ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f4814ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 -- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f4806d0d0 msgr2=0x7f9f4814d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f4806d0d0 0x7f9f4814d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.496+0000 7f9f45d9b700 1 -- 172.21.15.135:0/83809878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f30009550 con 0x7f9f480c9520 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.497+0000 7f9f45d9b700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f480c9520 0x7f9f480c72f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f30014040 tx=0x7f9f30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.497+0000 7f9f3effd700 1 -- 172.21.15.135:0/83809878 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30004520 con 0x7f9f480c9520 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.497+0000 7f9f3effd700 1 -- 172.21.15.135:0/83809878 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9f3001e070 con 0x7f9f480c9520 2024-05-08T21:22:46.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.497+0000 7f9f3effd700 1 -- 172.21.15.135:0/83809878 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f300038c0 con 0x7f9f480c9520 2024-05-08T21:22:46.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.497+0000 7f9f4c992700 1 -- 172.21.15.135:0/83809878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4815d7f0 con 0x7f9f480c9520 2024-05-08T21:22:46.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.497+0000 7f9f4c992700 1 -- 172.21.15.135:0/83809878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f480c7830 con 0x7f9f480c9520 2024-05-08T21:22:46.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.498+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f200052f0 con 0x7f9f480c9520 2024-05-08T21:22:46.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.498+0000 7f9f3effd700 1 -- 172.21.15.135:0/83809878 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f30003a20 con 0x7f9f480c9520 2024-05-08T21:22:46.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.499+0000 7f9f3effd700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f9f2806ac90 0x7f9f2806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.499+0000 7f9f3effd700 1 -- 172.21.15.135:0/83809878 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f30020070 con 0x7f9f480c9520 2024-05-08T21:22:46.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.499+0000 7f9f4659c700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f9f2806ac90 0x7f9f2806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.499+0000 7f9f4659c700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f9f2806ac90 0x7f9f2806d150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009910 tx=0x7f9f40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.503+0000 7f9f3effd700 1 -- 172.21.15.135:0/83809878 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9f30055c70 con 0x7f9f480c9520 2024-05-08T21:22:46.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.743+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f200055a0 con 0x7f9f480c9520 2024-05-08T21:22:46.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.744+0000 7f9f3effd700 1 -- 172.21.15.135:0/83809878 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f9f3002a020 con 0x7f9f480c9520 2024-05-08T21:22:46.746 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:22:46.746 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:23.530682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f9f2806ac90 msgr2=0x7f9f2806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f9f2806ac90 0x7f9f2806d150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009910 tx=0x7f9f40008040 comp rx=0 tx=0).stop 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f480c9520 msgr2=0x7f9f480c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f480c9520 0x7f9f480c72f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f30014040 tx=0x7f9f30004750 comp rx=0 tx=0).stop 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 shutdown_connections 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f9f2806ac90 0x7f9f2806d150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f4806d0d0 0x7f9f4814d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f4815aa20 0x7f9f4814ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 --2- 172.21.15.135:0/83809878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f480c9520 0x7f9f480c72f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 >> 172.21.15.135:0/83809878 conn(0x7f9f480b06d0 msgr2=0x7f9f480b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:46.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 shutdown_connections 2024-05-08T21:22:46.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.746+0000 7f9f3cff9700 1 -- 172.21.15.135:0/83809878 wait complete. 2024-05-08T21:22:46.750 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-08T21:22:46.761 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:22:46.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.881+0000 7f6a5ca85700 1 Processor -- start 2024-05-08T21:22:46.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.881+0000 7f6a5ca85700 1 -- start start 2024-05-08T21:22:46.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a5ca85700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6a580ce380 0x7f6a5806baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a5ca85700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6a580ca0e0 0x7f6a580c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a5ca85700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a58159590 con 0x7f6a580c9b50 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a5ca85700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5806c350 con 0x7f6a580ca0e0 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a5ca85700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a58159850 con 0x7f6a580ce380 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a55d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6a580ca0e0 0x7f6a580c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a56d9d700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f6a580c9b50 0x7f6a580cca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35678/0 (socket says 172.21.15.135:35678) 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a55d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f6a580ca0e0 0x7f6a580c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49406/0 (socket says 172.21.15.135:49406) 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.882+0000 7f6a56d9d700 1 -- 172.21.15.135:0/1858397819 learned_addr learned my addr 172.21.15.135:0/1858397819 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a5659c700 1 --2- 172.21.15.135:0/1858397819 >> v2:172.21.15.183:3300/0 conn(0x7f6a580ce380 0x7f6a5806baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a55d9b700 1 -- 172.21.15.135:0/1858397819 >> v2:172.21.15.183:3300/0 conn(0x7f6a580ce380 msgr2=0x7f6a5806baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a55d9b700 1 --2- 172.21.15.135:0/1858397819 >> v2:172.21.15.183:3300/0 conn(0x7f6a580ce380 0x7f6a5806baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a55d9b700 1 -- 172.21.15.135:0/1858397819 >> v1:172.21.15.135:6789/0 conn(0x7f6a580c9b50 legacy=0x7f6a580cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a5559a700 1 -- 172.21.15.135:0/1858397819 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768045755 0 0) 0x7f6a58159590 con 0x7f6a580c9b50 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a55d9b700 1 -- 172.21.15.135:0/1858397819 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58159b30 con 0x7f6a580ca0e0 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a55d9b700 1 --2- 172.21.15.135:0/1858397819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a580c9610 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6a5808bf00 tx=0x7f6a48009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58864009c995024b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a5559a700 1 -- 172.21.15.135:0/1858397819 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48011830 con 0x7f6a580ca0e0 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a5559a700 1 -- 172.21.15.135:0/1858397819 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6a48011990 con 0x7f6a580ca0e0 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a5559a700 1 -- 172.21.15.135:0/1858397819 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48011d40 con 0x7f6a580ca0e0 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a5ca85700 1 -- 172.21.15.135:0/1858397819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 msgr2=0x7f6a580c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.883+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/1858397819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a580c9610 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6a5808bf00 tx=0x7f6a48009b20 comp rx=0 tx=0).stop 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.884+0000 7f6a5ca85700 1 -- 172.21.15.135:0/1858397819 shutdown_connections 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.884+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/1858397819 >> v2:172.21.15.183:3300/0 conn(0x7f6a580ce380 0x7f6a5806baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.884+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/1858397819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a580c9610 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.884+0000 7f6a5ca85700 1 -- 172.21.15.135:0/1858397819 >> 172.21.15.135:0/1858397819 conn(0x7f6a580cec90 msgr2=0x7f6a580cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:46.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.884+0000 7f6a5ca85700 1 -- 172.21.15.135:0/1858397819 shutdown_connections 2024-05-08T21:22:46.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.884+0000 7f6a5ca85700 1 -- 172.21.15.135:0/1858397819 wait complete. 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.885+0000 7f6a5ca85700 1 Processor -- start 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.885+0000 7f6a5ca85700 1 -- start start 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a580c9b50 0x7f6a58156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a581565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a580ce380 0x7f6a580af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5814b9c0 con 0x7f6a580ca0e0 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58155b00 con 0x7f6a580c9b50 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580b05f0 con 0x7f6a580ce380 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a581565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a581565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49414/0 (socket says 172.21.15.135:49414) 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 -- 172.21.15.135:0/2702415141 learned_addr learned my addr 172.21.15.135:0/2702415141 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:46.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a56d9d700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a580ce380 0x7f6a580af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5659c700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a580c9b50 0x7f6a58156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 -- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a580ce380 msgr2=0x7f6a580af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a580ce380 0x7f6a580af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 -- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a580c9b50 msgr2=0x7f6a58156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a580c9b50 0x7f6a58156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 -- 172.21.15.135:0/2702415141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480094a0 con 0x7f6a580ca0e0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5659c700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a580c9b50 0x7f6a58156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a55d9b700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a581565c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009b60 tx=0x7f6a48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a46ffd700 1 -- 172.21.15.135:0/2702415141 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480036a0 con 0x7f6a580ca0e0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a46ffd700 1 -- 172.21.15.135:0/2702415141 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6a4801e070 con 0x7f6a580ca0e0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a581f00b0 con 0x7f6a580ca0e0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a46ffd700 1 -- 172.21.15.135:0/2702415141 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48003a60 con 0x7f6a580ca0e0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.886+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a580b0890 con 0x7f6a580ca0e0 2024-05-08T21:22:46.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.887+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a580b0450 con 0x7f6a580ca0e0 2024-05-08T21:22:46.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.888+0000 7f6a46ffd700 1 -- 172.21.15.135:0/2702415141 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a48003bc0 con 0x7f6a580ca0e0 2024-05-08T21:22:46.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.888+0000 7f6a46ffd700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6a3806ac90 0x7f6a3806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:46.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.888+0000 7f6a46ffd700 1 -- 172.21.15.135:0/2702415141 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a4808a890 con 0x7f6a580ca0e0 2024-05-08T21:22:46.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.888+0000 7f6a5659c700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6a3806ac90 0x7f6a3806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:46.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.889+0000 7f6a5659c700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6a3806ac90 0x7f6a3806d150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009820 tx=0x7f6a4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:46.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:46.893+0000 7f6a46ffd700 1 -- 172.21.15.135:0/2702415141 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a580b0450 con 0x7f6a580ca0e0 2024-05-08T21:22:47.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.135+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a580b0450 con 0x7f6a580ca0e0 2024-05-08T21:22:47.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.135+0000 7f6a46ffd700 1 -- 172.21.15.135:0/2702415141 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f6a580b0450 con 0x7f6a580ca0e0 2024-05-08T21:22:47.137 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:22:47.137 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6836/138261647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":138261647},{"type":"v1","addr":"172.21.15.135:6836","nonce":138261647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6836/1521950692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1521950692},{"type":"v1","addr":"172.21.15.183:6836","nonce":1521950692}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2879983520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2879983520},{"type":"v1","addr":"172.21.15.135:6839","nonce":2879983520}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/1636746849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6835","nonce":1636746849},{"type":"v1","addr":"172.21.15.135:6837","nonce":1636746849}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3149421736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3149421736},{"type":"v1","addr":"172.21.15.183:6835","nonce":3149421736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:55:00.066076+0000","modified":"2024-05-08T20:55:23.530682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6837/2419873080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2419873080},{"type":"v1","addr":"172.21.15.183:6837","nonce":2419873080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.137+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6a3806ac90 msgr2=0x7f6a3806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6a3806ac90 0x7f6a3806d150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009820 tx=0x7f6a4c008040 comp rx=0 tx=0).stop 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 msgr2=0x7f6a581565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a581565c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009b60 tx=0x7f6a48004750 comp rx=0 tx=0).stop 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 shutdown_connections 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f6a3806ac90 0x7f6a3806d150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a580c9b50 0x7f6a58156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a580ce380 0x7f6a580af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 --2- 172.21.15.135:0/2702415141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a580ca0e0 0x7f6a581565c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 >> 172.21.15.135:0/2702415141 conn(0x7f6a580cec90 msgr2=0x7f6a580c7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:47.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 shutdown_connections 2024-05-08T21:22:47.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.138+0000 7f6a5ca85700 1 -- 172.21.15.135:0/2702415141 wait complete. 2024-05-08T21:22:47.141 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-05-08T21:22:47.152 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:22:47.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.272+0000 7f5eaf690700 1 Processor -- start 2024-05-08T21:22:47.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.272+0000 7f5eaf690700 1 -- start start 2024-05-08T21:22:47.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5eaf690700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea806a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5eaf690700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea815d640 con 0x7f5ea806aea0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5eaf690700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea815ca70 con 0x7f5ea80c47c0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5eaf690700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea815cd10 con 0x7f5ea81533a0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5eacc2b700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f5ea806aea0 0x7f5ea80c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35682/0 (socket says 172.21.15.135:35682) 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5eacc2b700 1 -- 172.21.15.135:0/306978056 learned_addr learned my addr 172.21.15.135:0/306978056 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5ead42c700 1 --2- 172.21.15.135:0/306978056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694063030 0 0) 0x7f5ea815d640 con 0x7f5ea806aea0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e940035b0 con 0x7f5ea806aea0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058127426 0 0) 0x7f5ea815ca70 con 0x7f5ea80c47c0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea815d640 con 0x7f5ea80c47c0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1927021620 0 0) 0x7f5e940035b0 con 0x7f5ea806aea0 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5ead42c700 1 -- 172.21.15.135:0/306978056 >> v1:172.21.15.183:6789/0 conn(0x7f5ea80c47c0 legacy=0x7f5ea81593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5ead42c700 1 -- 172.21.15.135:0/306978056 >> v1:172.21.15.135:6789/0 conn(0x7f5ea806aea0 legacy=0x7f5ea80c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.273+0000 7f5ead42c700 1 -- 172.21.15.135:0/306978056 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea815cff0 con 0x7f5ea81533a0 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5ead42c700 1 --2- 172.21.15.135:0/306978056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea806a960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009870 tx=0x7f5ea4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23a86eb1ff55bd54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980017f0 con 0x7f5ea81533a0 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5ea4004030 con 0x7f5ea81533a0 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5e9ffff700 1 -- 172.21.15.135:0/306978056 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40043e0 con 0x7f5ea81533a0 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5eaf690700 1 -- 172.21.15.135:0/306978056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 msgr2=0x7f5ea806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5eaf690700 1 --2- 172.21.15.135:0/306978056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea806a960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009870 tx=0x7f5ea4009b80 comp rx=0 tx=0).stop 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5eaf690700 1 -- 172.21.15.135:0/306978056 shutdown_connections 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5eaf690700 1 --2- 172.21.15.135:0/306978056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea806a960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5eaf690700 1 -- 172.21.15.135:0/306978056 >> 172.21.15.135:0/306978056 conn(0x7f5ea806fac0 msgr2=0x7f5ea806fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5eaf690700 1 -- 172.21.15.135:0/306978056 shutdown_connections 2024-05-08T21:22:47.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.274+0000 7f5eaf690700 1 -- 172.21.15.135:0/306978056 wait complete. 2024-05-08T21:22:47.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 Processor -- start 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 -- start start 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea806aea0 0x7f5ea81f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea80c47c0 0x7f5ea815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea81432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea814dae0 con 0x7f5ea80c47c0 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea814f080 con 0x7f5ea806aea0 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eaf690700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea814f5b0 con 0x7f5ea81533a0 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eacc2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea80c47c0 0x7f5ea815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eacc2b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea80c47c0 0x7f5ea815bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49428/0 (socket says 172.21.15.135:49428) 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eacc2b700 1 -- 172.21.15.135:0/809715207 learned_addr learned my addr 172.21.15.135:0/809715207 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5ead42c700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea806aea0 0x7f5ea81f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.276+0000 7f5eadc2d700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea81432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eacc2b700 1 -- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 msgr2=0x7f5ea81432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eacc2b700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea81432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eacc2b700 1 -- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea806aea0 msgr2=0x7f5ea81f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eacc2b700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea806aea0 0x7f5ea81f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eacc2b700 1 -- 172.21.15.135:0/809715207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40094a0 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eacc2b700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea80c47c0 0x7f5ea815bba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c500 tx=0x7f5e9800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5e9dffb700 1 -- 172.21.15.135:0/809715207 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980074e0 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5e9dffb700 1 -- 172.21.15.135:0/809715207 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e98007660 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5e9dffb700 1 -- 172.21.15.135:0/809715207 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e98005a90 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea814dcf0 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.277+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea81f2480 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.278+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea8067fa0 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.278+0000 7f5e9dffb700 1 -- 172.21.15.135:0/809715207 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e98005bf0 con 0x7f5ea80c47c0 2024-05-08T21:22:47.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.279+0000 7f5e9dffb700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e8c06acc0 0x7f5e8c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.279+0000 7f5e9dffb700 1 -- 172.21.15.135:0/809715207 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e98088b20 con 0x7f5ea80c47c0 2024-05-08T21:22:47.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.279+0000 7f5ead42c700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e8c06acc0 0x7f5e8c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.279+0000 7f5ead42c700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e8c06acc0 0x7f5e8c06d180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40090b0 tx=0x7f5ea4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:47.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.283+0000 7f5e9dffb700 1 -- 172.21.15.135:0/809715207 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5e98053940 con 0x7f5ea80c47c0 2024-05-08T21:22:47.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.481+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ea8073650 con 0x7f5ea80c47c0 2024-05-08T21:22:47.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.483+0000 7f5e9dffb700 1 -- 172.21.15.135:0/809715207 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18313 (secure 0 0 0) 0x7f5e98017020 con 0x7f5ea80c47c0 2024-05-08T21:22:47.485 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-05-08T21:22:47.485 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":27,"fsid":"2800f999-7ad2-4fbf-96c4-2e5fd73f8089","created":"2024-05-08T20:54:34.743992+0000","modified":"2024-05-08T20:55:41.588092+0000","last_up_change":"2024-05-08T20:54:46.547349+0000","last_in_change":"2024-05-08T20:54:37.356826+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:54:48.495563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:54:57.947571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:54:58.988583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T20:55:02.098509+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"86a512b8-6b0d-4807-8cc2-f4176131b3c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":47109},{"type":"v1","addr":"172.21.15.135:6825","nonce":47109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":47109},{"type":"v1","addr":"172.21.15.135:6827","nonce":47109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":47109},{"type":"v1","addr":"172.21.15.135:6831","nonce":47109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":47109},{"type":"v1","addr":"172.21.15.135:6829","nonce":47109}]},"public_addr":"172.21.15.135:6825/47109","cluster_addr":"172.21.15.135:6827/47109","heartbeat_back_addr":"172.21.15.135:6831/47109","heartbeat_front_addr":"172.21.15.135:6829/47109","state":["exists","up"]},{"osd":1,"uuid":"afc8bb5b-d959-4654-b521-5181a042affa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":47107},{"type":"v1","addr":"172.21.15.135:6809","nonce":47107}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":47107},{"type":"v1","addr":"172.21.15.135:6811","nonce":47107}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":47107},{"type":"v1","addr":"172.21.15.135:6818","nonce":47107}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":47107},{"type":"v1","addr":"172.21.15.135:6814","nonce":47107}]},"public_addr":"172.21.15.135:6809/47107","cluster_addr":"172.21.15.135:6811/47107","heartbeat_back_addr":"172.21.15.135:6818/47107","heartbeat_front_addr":"172.21.15.135:6814/47107","state":["exists","up"]},{"osd":2,"uuid":"43e6e948-9284-4f07-8e6c-91cdb06a16a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6813","nonce":47110},{"type":"v1","addr":"172.21.15.135:6815","nonce":47110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6817","nonce":47110},{"type":"v1","addr":"172.21.15.135:6819","nonce":47110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":47110},{"type":"v1","addr":"172.21.15.135:6823","nonce":47110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":47110},{"type":"v1","addr":"172.21.15.135:6821","nonce":47110}]},"public_addr":"172.21.15.135:6815/47110","cluster_addr":"172.21.15.135:6819/47110","heartbeat_back_addr":"172.21.15.135:6823/47110","heartbeat_front_addr":"172.21.15.135:6821/47110","state":["exists","up"]},{"osd":3,"uuid":"438d2541-1287-42d0-936c-21a306edbb55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":47105},{"type":"v1","addr":"172.21.15.135:6801","nonce":47105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":47105},{"type":"v1","addr":"172.21.15.135:6803","nonce":47105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":47105},{"type":"v1","addr":"172.21.15.135:6807","nonce":47105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":47105},{"type":"v1","addr":"172.21.15.135:6805","nonce":47105}]},"public_addr":"172.21.15.135:6801/47105","cluster_addr":"172.21.15.135:6803/47105","heartbeat_back_addr":"172.21.15.135:6807/47105","heartbeat_front_addr":"172.21.15.135:6805/47105","state":["exists","up"]},{"osd":4,"uuid":"7678d4c2-301e-4d49-be10-2e9f5b3a78a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":47308},{"type":"v1","addr":"172.21.15.183:6801","nonce":47308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":47308},{"type":"v1","addr":"172.21.15.183:6803","nonce":47308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":47308},{"type":"v1","addr":"172.21.15.183:6807","nonce":47308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":47308},{"type":"v1","addr":"172.21.15.183:6805","nonce":47308}]},"public_addr":"172.21.15.183:6801/47308","cluster_addr":"172.21.15.183:6803/47308","heartbeat_back_addr":"172.21.15.183:6807/47308","heartbeat_front_addr":"172.21.15.183:6805/47308","state":["exists","up"]},{"osd":5,"uuid":"cfe0f86c-a074-4e75-be10-ff2d00abd453","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":47320},{"type":"v1","addr":"172.21.15.183:6825","nonce":47320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":47320},{"type":"v1","addr":"172.21.15.183:6827","nonce":47320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":47320},{"type":"v1","addr":"172.21.15.183:6831","nonce":47320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":47320},{"type":"v1","addr":"172.21.15.183:6829","nonce":47320}]},"public_addr":"172.21.15.183:6825/47320","cluster_addr":"172.21.15.183:6827/47320","heartbeat_back_addr":"172.21.15.183:6831/47320","heartbeat_front_addr":"172.21.15.183:6829/47320","state":["exists","up"]},{"osd":6,"uuid":"0fb0e4c3-700e-4b11-816d-10cf4523cb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":47323},{"type":"v1","addr":"172.21.15.183:6817","nonce":47323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":47323},{"type":"v1","addr":"172.21.15.183:6819","nonce":47323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":47323},{"type":"v1","addr":"172.21.15.183:6823","nonce":47323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":47323},{"type":"v1","addr":"172.21.15.183:6821","nonce":47323}]},"public_addr":"172.21.15.183:6817/47323","cluster_addr":"172.21.15.183:6819/47323","heartbeat_back_addr":"172.21.15.183:6823/47323","heartbeat_front_addr":"172.21.15.183:6821/47323","state":["exists","up"]},{"osd":7,"uuid":"26b42625-d983-4f0e-9ca6-ba6c7f2e148d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":47309},{"type":"v1","addr":"172.21.15.183:6809","nonce":47309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":47309},{"type":"v1","addr":"172.21.15.183:6811","nonce":47309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":47309},{"type":"v1","addr":"172.21.15.183:6815","nonce":47309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":47309},{"type":"v1","addr":"172.21.15.183:6813","nonce":47309}]},"public_addr":"172.21.15.183:6809/47309","cluster_addr":"172.21.15.183:6811/47309","heartbeat_back_addr":"172.21.15.183:6815/47309","heartbeat_front_addr":"172.21.15.183:6813/47309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.530519+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.591328+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.524730+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.475112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534375+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.550857+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.589897+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:54:42.534387+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e8c06acc0 msgr2=0x7f5e8c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e8c06acc0 0x7f5e8c06d180 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40090b0 tx=0x7f5ea4008030 comp rx=0 tx=0).stop 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea80c47c0 msgr2=0x7f5ea815bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea80c47c0 0x7f5ea815bba0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c500 tx=0x7f5e9800c810 comp rx=0 tx=0).stop 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 shutdown_connections 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f5e8c06acc0 0x7f5e8c06d180 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea806aea0 0x7f5ea81f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea81533a0 0x7f5ea81432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 --2- 172.21.15.135:0/809715207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ea80c47c0 0x7f5ea815bba0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 >> 172.21.15.135:0/809715207 conn(0x7f5ea806fac0 msgr2=0x7f5ea8072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 shutdown_connections 2024-05-08T21:22:47.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.485+0000 7f5eaf690700 1 -- 172.21.15.135:0/809715207 wait complete. 2024-05-08T21:22:47.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T21:22:47.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.619+0000 7f567325b700 1 Processor -- start 2024-05-08T21:22:47.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.619+0000 7f567325b700 1 -- start start 2024-05-08T21:22:47.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f567325b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f566c0ce380 0x7f566c06baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f567325b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c159590 con 0x7f566c0cca70 2024-05-08T21:22:47.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f567325b700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c06c350 con 0x7f566c0ca0e0 2024-05-08T21:22:47.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f567325b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c159850 con 0x7f566c0ce380 2024-05-08T21:22:47.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f5670ff7700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f566c0ce380 0x7f566c06baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f56717f8700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f566c0cca70 0x7f566c163e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35684/0 (socket says 172.21.15.135:35684) 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f56717f8700 1 -- 172.21.15.135:0/1375378005 learned_addr learned my addr 172.21.15.135:0/1375378005 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f566b7fe700 1 -- 172.21.15.135:0/1375378005 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081457549 0 0) 0x7f566c159590 con 0x7f566c0cca70 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f566b7fe700 1 -- 172.21.15.135:0/1375378005 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f565c0035b0 con 0x7f566c0cca70 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f5670ff7700 1 -- 172.21.15.135:0/1375378005 >> v1:172.21.15.183:6789/0 conn(0x7f566c0ca0e0 legacy=0x7f566c0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f5670ff7700 1 -- 172.21.15.135:0/1375378005 >> v1:172.21.15.135:6789/0 conn(0x7f566c0cca70 legacy=0x7f566c163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f5670ff7700 1 -- 172.21.15.135:0/1375378005 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c159b30 con 0x7f566c0ce380 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f5670ff7700 1 --2- 172.21.15.135:0/1375378005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0ce380 0x7f566c06baa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5660009840 tx=0x7f5660009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58be08c8e56ec6ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.620+0000 7f566b7fe700 1 -- 172.21.15.135:0/1375378005 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660004230 con 0x7f566c0ce380 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f566b7fe700 1 -- 172.21.15.135:0/1375378005 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5660004390 con 0x7f566c0ce380 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f566b7fe700 1 -- 172.21.15.135:0/1375378005 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56600036e0 con 0x7f566c0ce380 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f567325b700 1 -- 172.21.15.135:0/1375378005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0ce380 msgr2=0x7f566c06baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f567325b700 1 --2- 172.21.15.135:0/1375378005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0ce380 0x7f566c06baa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5660009840 tx=0x7f5660009b50 comp rx=0 tx=0).stop 2024-05-08T21:22:47.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f567325b700 1 -- 172.21.15.135:0/1375378005 shutdown_connections 2024-05-08T21:22:47.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f567325b700 1 --2- 172.21.15.135:0/1375378005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0ce380 0x7f566c06baa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f567325b700 1 -- 172.21.15.135:0/1375378005 >> 172.21.15.135:0/1375378005 conn(0x7f566c0cec90 msgr2=0x7f566c0cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:47.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f567325b700 1 -- 172.21.15.135:0/1375378005 shutdown_connections 2024-05-08T21:22:47.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.621+0000 7f567325b700 1 -- 172.21.15.135:0/1375378005 wait complete. 2024-05-08T21:22:47.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.622+0000 7f567325b700 1 Processor -- start 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.622+0000 7f567325b700 1 -- start start 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f567325b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f566c0ca0e0 0x7f566c1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f567325b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0cca70 0x7f566c0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f567325b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f566c0ce380 0x7f566c0c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f567325b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c156880 con 0x7f566c0cca70 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f567325b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1eee50 con 0x7f566c0ce380 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f567325b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1efe00 con 0x7f566c0ca0e0 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f566bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0cca70 0x7f566c0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f566bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0cca70 0x7f566c0afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49444/0 (socket says 172.21.15.135:49444) 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f566bfff700 1 -- 172.21.15.135:0/159676340 learned_addr learned my addr 172.21.15.135:0/159676340 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f5670ff7700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f566c0ca0e0 0x7f566c1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.623+0000 7f56717f8700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f566c0ce380 0x7f566c0c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f566bfff700 1 -- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f566c0ca0e0 msgr2=0x7f566c1f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f566bfff700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f566c0ca0e0 0x7f566c1f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f566bfff700 1 -- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f566c0ce380 msgr2=0x7f566c0c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f566bfff700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f566c0ce380 0x7f566c0c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f566bfff700 1 -- 172.21.15.135:0/159676340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600094a0 con 0x7f566c0cca70 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f56717f8700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f566c0ce380 0x7f566c0c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f566bfff700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0cca70 0x7f566c0afa00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f565800b4d0 tx=0x7f565800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f56697fa700 1 -- 172.21.15.135:0/159676340 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658011830 con 0x7f566c0cca70 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f56697fa700 1 -- 172.21.15.135:0/159676340 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5658011990 con 0x7f566c0cca70 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c1f3310 con 0x7f566c0cca70 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f56697fa700 1 -- 172.21.15.135:0/159676340 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658011d60 con 0x7f566c0cca70 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.624+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c1ef970 con 0x7f566c0cca70 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.625+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c1efb00 con 0x7f566c0cca70 2024-05-08T21:22:47.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.625+0000 7f56697fa700 1 -- 172.21.15.135:0/159676340 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f565801a400 con 0x7f566c0cca70 2024-05-08T21:22:47.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.626+0000 7f56697fa700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f565006acc0 0x7f565006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:47.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.626+0000 7f56697fa700 1 -- 172.21.15.135:0/159676340 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5658089120 con 0x7f566c0cca70 2024-05-08T21:22:47.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.626+0000 7f5670ff7700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f565006acc0 0x7f565006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:47.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.626+0000 7f5670ff7700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f565006acc0 0x7f565006d180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f56600090b0 tx=0x7f5660010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:47.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.630+0000 7f56697fa700 1 -- 172.21.15.135:0/159676340 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5658053f40 con 0x7f566c0cca70 2024-05-08T21:22:47.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.873+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f566c1f3310 con 0x7f566c0cca70 2024-05-08T21:22:47.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.907+0000 7f56697fa700 1 -- 172.21.15.135:0/159676340 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f566c1f3310 con 0x7f566c0cca70 2024-05-08T21:22:47.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f565006acc0 msgr2=0x7f565006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f565006acc0 0x7f565006d180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f56600090b0 tx=0x7f5660010000 comp rx=0 tx=0).stop 2024-05-08T21:22:47.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0cca70 msgr2=0x7f566c0afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:47.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0cca70 0x7f566c0afa00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f565800b4d0 tx=0x7f565800b7e0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 shutdown_connections 2024-05-08T21:22:47.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f565006acc0 0x7f565006d180 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f566c0ce380 0x7f566c0c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f566c0ca0e0 0x7f566c1f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 --2- 172.21.15.135:0/159676340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f566c0cca70 0x7f566c0afa00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:47.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 >> 172.21.15.135:0/159676340 conn(0x7f566c0cec90 msgr2=0x7f566c0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:47.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 shutdown_connections 2024-05-08T21:22:47.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:47.910+0000 7f567325b700 1 -- 172.21.15.135:0/159676340 wait complete. 2024-05-08T21:22:47.913 INFO:teuthology.orchestra.run.smithi135.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T21:22:47.924 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T21:22:47.999 INFO:tasks.ceph.mds.f.smithi183.stdout:starting mds.f at 2024-05-08T21:22:48.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.047+0000 7fa738da1700 1 Processor -- start 2024-05-08T21:22:48.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.047+0000 7fa738da1700 1 -- start start 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa738da1700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7340c8980 0x7fa7340c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa738da1700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7340cca80 0x7fa7340ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa738da1700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7340c8780 con 0x7fa7341514b0 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa738da1700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7341571e0 con 0x7fa7340c8980 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa738da1700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73415ac10 con 0x7fa7340cca80 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7340c8980 0x7fa7340c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7fa7340c8980 0x7fa7340c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49446/0 (socket says 172.21.15.135:49446) 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 -- 172.21.15.135:0/1921923442 learned_addr learned my addr 172.21.15.135:0/1921923442 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa732d9d700 1 --2- 172.21.15.135:0/1921923442 >> v2:172.21.15.183:3300/0 conn(0x7fa7340cca80 0x7fa7340ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 -- 172.21.15.135:0/1921923442 >> v2:172.21.15.183:3300/0 conn(0x7fa7340cca80 msgr2=0x7fa7340ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 --2- 172.21.15.135:0/1921923442 >> v2:172.21.15.183:3300/0 conn(0x7fa7340cca80 0x7fa7340ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 -- 172.21.15.135:0/1921923442 >> v1:172.21.15.183:6789/0 conn(0x7fa7341514b0 legacy=0x7fa734157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 -- 172.21.15.135:0/1921923442 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73415b790 con 0x7fa7340c8980 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa731d9b700 1 --2- 172.21.15.135:0/1921923442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7340c8980 0x7fa7340c8dc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa734070a90 tx=0x7fa728009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4ea91de34d315 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa73159a700 1 -- 172.21.15.135:0/1921923442 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728011830 con 0x7fa7340c8980 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa73159a700 1 -- 172.21.15.135:0/1921923442 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa728011990 con 0x7fa7340c8980 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.048+0000 7fa73159a700 1 -- 172.21.15.135:0/1921923442 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728011d40 con 0x7fa7340c8980 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 -- 172.21.15.135:0/1921923442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7340c8980 msgr2=0x7fa7340c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 --2- 172.21.15.135:0/1921923442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7340c8980 0x7fa7340c8dc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa734070a90 tx=0x7fa728009bd0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 -- 172.21.15.135:0/1921923442 shutdown_connections 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 --2- 172.21.15.135:0/1921923442 >> v2:172.21.15.183:3300/0 conn(0x7fa7340cca80 0x7fa7340ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 --2- 172.21.15.135:0/1921923442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7340c8980 0x7fa7340c8dc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 -- 172.21.15.135:0/1921923442 >> 172.21.15.135:0/1921923442 conn(0x7fa73406a960 msgr2=0x7fa73406ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 -- 172.21.15.135:0/1921923442 shutdown_connections 2024-05-08T21:22:48.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.049+0000 7fa738da1700 1 -- 172.21.15.135:0/1921923442 wait complete. 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.050+0000 7fa738da1700 1 Processor -- start 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa738da1700 1 -- start start 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa738da1700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7340c8980 0x7fa7341e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa738da1700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7340cca80 0x7fa734150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa738da1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7341514b0 0x7fa7340b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa738da1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73414b2e0 con 0x7fa7341514b0 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa738da1700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73414fec0 con 0x7fa7340cca80 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa738da1700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7340c33b0 con 0x7fa7340c8980 2024-05-08T21:22:48.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa732d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7341514b0 0x7fa7340b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa732d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7341514b0 0x7fa7340b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49454/0 (socket says 172.21.15.135:49454) 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa732d9d700 1 -- 172.21.15.135:0/199641522 learned_addr learned my addr 172.21.15.135:0/199641522 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa731d9b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7340cca80 0x7fa734150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.051+0000 7fa73259c700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7340c8980 0x7fa7341e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa732d9d700 1 -- 172.21.15.135:0/199641522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7340c8980 msgr2=0x7fa7341e2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa732d9d700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7340c8980 0x7fa7341e2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa732d9d700 1 -- 172.21.15.135:0/199641522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7340cca80 msgr2=0x7fa734150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa732d9d700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7340cca80 0x7fa734150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa732d9d700 1 -- 172.21.15.135:0/199641522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728009550 con 0x7fa7341514b0 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa732d9d700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7341514b0 0x7fa7340b0860 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009dd0 tx=0x7fa72c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa722ffd700 1 -- 172.21.15.135:0/199641522 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c009c40 con 0x7fa7341514b0 2024-05-08T21:22:48.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa722ffd700 1 -- 172.21.15.135:0/199641522 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa72c00f040 con 0x7fa7341514b0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7340c3110 con 0x7fa7341514b0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa722ffd700 1 -- 172.21.15.135:0/199641522 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00ced0 con 0x7fa7341514b0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.052+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7341f0e50 con 0x7fa7341514b0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.053+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa734067fa0 con 0x7fa7341514b0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.053+0000 7fa722ffd700 1 -- 172.21.15.135:0/199641522 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa72c014480 con 0x7fa7341514b0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.054+0000 7fa722ffd700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa71406ac90 0x7fa71406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.054+0000 7fa722ffd700 1 -- 172.21.15.135:0/199641522 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa72c08a370 con 0x7fa7341514b0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.054+0000 7fa73259c700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa71406ac90 0x7fa71406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:48.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.054+0000 7fa73259c700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa71406ac90 0x7fa71406d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa724007fd0 tx=0x7fa724009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:48.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.058+0000 7fa722ffd700 1 -- 172.21.15.135:0/199641522 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa72c055020 con 0x7fa7341514b0 2024-05-08T21:22:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.303+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa734150000 con 0x7fa7341514b0 2024-05-08T21:22:48.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.952+0000 7fa722ffd700 1 -- 172.21.15.135:0/199641522 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa72c056f50 con 0x7fa7341514b0 2024-05-08T21:22:48.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa71406ac90 msgr2=0x7fa71406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa71406ac90 0x7fa71406d150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa724007fd0 tx=0x7fa724009040 comp rx=0 tx=0).stop 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7341514b0 msgr2=0x7fa7340b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7341514b0 0x7fa7340b0860 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009dd0 tx=0x7fa72c00c3a0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 shutdown_connections 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7fa71406ac90 0x7fa71406d150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7341514b0 0x7fa7340b0860 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa7340c8980 0x7fa7341e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 --2- 172.21.15.135:0/199641522 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7340cca80 0x7fa734150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 >> 172.21.15.135:0/199641522 conn(0x7fa73406a960 msgr2=0x7fa7340c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 shutdown_connections 2024-05-08T21:22:48.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:48.955+0000 7fa738da1700 1 -- 172.21.15.135:0/199641522 wait complete. 2024-05-08T21:22:48.973 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T21:22:49.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.102+0000 7f428df75700 1 Processor -- start 2024-05-08T21:22:49.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.102+0000 7f428df75700 1 -- start start 2024-05-08T21:22:49.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.103+0000 7f428df75700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 0x7f4288072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.103+0000 7f428df75700 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f42880c6600 0x7f42880c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.103+0000 7f428df75700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42881508a0 con 0x7f42881504c0 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.103+0000 7f428df75700 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880c2de0 con 0x7f42880c6600 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.103+0000 7f428df75700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4288159d80 con 0x7f42880c51e0 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.103+0000 7f42877fe700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f42881504c0 0x7f4288159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35688/0 (socket says 172.21.15.135:35688) 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.103+0000 7f42877fe700 1 -- 172.21.15.135:0/2548426666 learned_addr learned my addr 172.21.15.135:0/2548426666 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 0x7f4288072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4287fff700 1 --2- 172.21.15.135:0/2548426666 >> v2:172.21.15.183:3300/0 conn(0x7f42880c6600 0x7f42880c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829262790 0 0) 0x7f42881508a0 con 0x7f42881504c0 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42700035b0 con 0x7f42881504c0 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 <== mon.0 v1:172.21.15.135:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3957062864 0 0) 0x7f42700035b0 con 0x7f42881504c0 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 msgr2=0x7f4288072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 0x7f4288072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 >> v2:172.21.15.183:3300/0 conn(0x7f42880c6600 msgr2=0x7f42880c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 --2- 172.21.15.135:0/2548426666 >> v2:172.21.15.183:3300/0 conn(0x7f42880c6600 0x7f42880c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 --> v1:172.21.15.135:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880c5940 con 0x7f42881504c0 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 <== mon.0 v1:172.21.15.135:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2712603892 0 0) 0x7f427c001670 con 0x7f42881504c0 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 >> v1:172.21.15.135:6789/0 conn(0x7f42881504c0 legacy=0x7f4288159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 0x7f4270003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f4270004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270004d90 0x7f4270005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c2de0 con 0x7f4270003f80 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288159d80 con 0x7f4270004d90 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427000dc50 con 0x7f42880c51e0 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f4270004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f42877fe700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 0x7f4270003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4287fff700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270004d90 0x7f4270005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 -- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 msgr2=0x7f4270003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:49.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42880c51e0 0x7f4270003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 -- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270004d90 msgr2=0x7f4270005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270004d90 0x7f4270005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 -- 172.21.15.135:0/2548426666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700035b0 con 0x7f4270003f80 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.104+0000 7f4286ffd700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f4270004850 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4278009b60 tx=0x7f4270005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f87719e6c78777 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800e6c0 con 0x7f4270003f80 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f427800e820 con 0x7f4270003f80 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f42867fc700 1 -- 172.21.15.135:0/2548426666 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800ebb0 con 0x7f4270003f80 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f428df75700 1 -- 172.21.15.135:0/2548426666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 msgr2=0x7f4270004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f428df75700 1 --2- 172.21.15.135:0/2548426666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f4270004850 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4278009b60 tx=0x7f4270005880 comp rx=0 tx=0).stop 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f4287fff700 1 -- 172.21.15.135:0/2548426666 reap_dead start 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f428df75700 1 -- 172.21.15.135:0/2548426666 shutdown_connections 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f428df75700 1 -- 172.21.15.135:0/2548426666 >> 172.21.15.135:0/2548426666 conn(0x7f428806daf0 msgr2=0x7f428806ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:49.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f428df75700 1 -- 172.21.15.135:0/2548426666 shutdown_connections 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.105+0000 7f428df75700 1 -- 172.21.15.135:0/2548426666 wait complete. 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.106+0000 7f428df75700 1 Processor -- start 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f428df75700 1 -- start start 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f428df75700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f428813fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f428df75700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4288140870 0x7f428806aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f428df75700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4288140c70 0x7f428806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f428df75700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428813ff80 con 0x7f4270003f80 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f428df75700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288140320 con 0x7f4288140870 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f428df75700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428814c6e0 con 0x7f4288140c70 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f42877fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f428813fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f42877fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f428813fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49470/0 (socket says 172.21.15.135:49470) 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f42877fe700 1 -- 172.21.15.135:0/1689056806 learned_addr learned my addr 172.21.15.135:0/1689056806 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:49.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f4286ffd700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4288140870 0x7f428806aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.107+0000 7f4287fff700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4288140c70 0x7f428806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f42877fe700 1 -- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4288140c70 msgr2=0x7f428806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f42877fe700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4288140c70 0x7f428806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f42877fe700 1 -- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4288140870 msgr2=0x7f428806aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f42877fe700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4288140870 0x7f428806aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f42877fe700 1 -- 172.21.15.135:0/1689056806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428814c440 con 0x7f4270003f80 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f42877fe700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f428813fa40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f427c000c00 tx=0x7f427c0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f426ffff700 1 -- 172.21.15.135:0/1689056806 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011580 con 0x7f4270003f80 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f426ffff700 1 -- 172.21.15.135:0/1689056806 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f427c0116e0 con 0x7f4270003f80 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428814e100 con 0x7f4270003f80 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f426ffff700 1 -- 172.21.15.135:0/1689056806 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c011ab0 con 0x7f4270003f80 2024-05-08T21:22:49.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.108+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428814e920 con 0x7f4270003f80 2024-05-08T21:22:49.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.109+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428806a960 con 0x7f4270003f80 2024-05-08T21:22:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.109+0000 7f426ffff700 1 -- 172.21.15.135:0/1689056806 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f427c011c10 con 0x7f4270003f80 2024-05-08T21:22:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.110+0000 7f426ffff700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f427406ac90 0x7f427406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.110+0000 7f426ffff700 1 -- 172.21.15.135:0/1689056806 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f427c0896c0 con 0x7f4270003f80 2024-05-08T21:22:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.110+0000 7f4286ffd700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f427406ac90 0x7f427406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.110+0000 7f4286ffd700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f427406ac90 0x7f427406d150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42780090b0 tx=0x7f427801f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.114+0000 7f426ffff700 1 -- 172.21.15.135:0/1689056806 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f427c057e90 con 0x7f4270003f80 2024-05-08T21:22:49.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.315+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f428814e2c0 con 0x7f4270003f80 2024-05-08T21:22:49.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.957+0000 7f426ffff700 1 -- 172.21.15.135:0/1689056806 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f427c0562a0 con 0x7f4270003f80 2024-05-08T21:22:49.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.962+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f427406ac90 msgr2=0x7f427406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:49.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.962+0000 7f428df75700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f427406ac90 0x7f427406d150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42780090b0 tx=0x7f427801f040 comp rx=0 tx=0).stop 2024-05-08T21:22:49.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.962+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 msgr2=0x7f428813fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:49.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.962+0000 7f428df75700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f428813fa40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f427c000c00 tx=0x7f427c0075f0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.963+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 shutdown_connections 2024-05-08T21:22:49.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.963+0000 7f428df75700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f427406ac90 0x7f427406d150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.963+0000 7f428df75700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4288140c70 0x7f428806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.963+0000 7f428df75700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4270003f80 0x7f428813fa40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.963+0000 7f428df75700 1 --2- 172.21.15.135:0/1689056806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4288140870 0x7f428806aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:49.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.963+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 >> 172.21.15.135:0/1689056806 conn(0x7f428806daf0 msgr2=0x7f42880cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:49.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.964+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 shutdown_connections 2024-05-08T21:22:49.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:49.964+0000 7f428df75700 1 -- 172.21.15.135:0/1689056806 wait complete. 2024-05-08T21:22:49.979 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' removed 2024-05-08T21:22:49.999 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T21:22:50.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.124+0000 7f984870b700 1 Processor -- start 2024-05-08T21:22:50.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.124+0000 7f984870b700 1 -- start start 2024-05-08T21:22:50.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f984870b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9840153450 0x7f9840072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:50.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f984870b700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98400cc770 0x7f9840072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f984870b700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98400c2d40 con 0x7f98400c6990 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f984870b700 1 -- --> v2:172.21.15.135:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98400cc0b0 con 0x7f98400cc770 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f984870b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98400c2130 con 0x7f9840153450 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9846ca8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98400cc770 0x7f9840072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9845ca6700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f98400c6990 0x7f984015cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35694/0 (socket says 172.21.15.135:35694) 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9846ca8700 1 --2- >> v2:172.21.15.135:3300/0 conn(0x7f98400cc770 0x7f9840072660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49476/0 (socket says 172.21.15.135:49476) 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9845ca6700 1 -- 172.21.15.135:0/1666842193 learned_addr learned my addr 172.21.15.135:0/1666842193 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f98464a7700 1 --2- 172.21.15.135:0/1666842193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9840153450 0x7f9840072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9846ca8700 1 -- 172.21.15.135:0/1666842193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9840153450 msgr2=0x7f9840072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9846ca8700 1 --2- 172.21.15.135:0/1666842193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9840153450 0x7f9840072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9846ca8700 1 -- 172.21.15.135:0/1666842193 >> v1:172.21.15.135:6789/0 conn(0x7f98400c6990 legacy=0x7f984015cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9846ca8700 1 -- 172.21.15.135:0/1666842193 --> v2:172.21.15.135:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400c2410 con 0x7f98400cc770 2024-05-08T21:22:50.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f98454a5700 1 -- 172.21.15.135:0/1666842193 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354307720 0 0) 0x7f98400c2d40 con 0x7f98400c6990 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f9846ca8700 1 --2- 172.21.15.135:0/1666842193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f9840072660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9838009d90 tx=0x7f983800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c466821b3a3de7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f98454a5700 1 -- 172.21.15.135:0/1666842193 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800e070 con 0x7f98400cc770 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f98454a5700 1 -- 172.21.15.135:0/1666842193 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f983800bbd0 con 0x7f98400cc770 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.125+0000 7f98454a5700 1 -- 172.21.15.135:0/1666842193 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838012430 con 0x7f98400cc770 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 -- 172.21.15.135:0/1666842193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 msgr2=0x7f9840072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 --2- 172.21.15.135:0/1666842193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f9840072660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9838009d90 tx=0x7f983800b330 comp rx=0 tx=0).stop 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 -- 172.21.15.135:0/1666842193 shutdown_connections 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 --2- 172.21.15.135:0/1666842193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9840153450 0x7f9840072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 --2- 172.21.15.135:0/1666842193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f9840072660 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 -- 172.21.15.135:0/1666842193 >> 172.21.15.135:0/1666842193 conn(0x7f984006ec40 msgr2=0x7f984006ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 -- 172.21.15.135:0/1666842193 shutdown_connections 2024-05-08T21:22:50.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.126+0000 7f984870b700 1 -- 172.21.15.135:0/1666842193 wait complete. 2024-05-08T21:22:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.127+0000 7f984870b700 1 Processor -- start 2024-05-08T21:22:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.127+0000 7f984870b700 1 -- start start 2024-05-08T21:22:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f984870b700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98400c6990 0x7f98401ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f984870b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f984015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f984870b700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9840153450 0x7f984015bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f984870b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9840157150 con 0x7f98400cc770 2024-05-08T21:22:50.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f984870b700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98401efd80 con 0x7f9840153450 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f984870b700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98401580f0 con 0x7f98400c6990 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f984015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f984015b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49480/0 (socket says 172.21.15.135:49480) 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 -- 172.21.15.135:0/2101059808 learned_addr learned my addr 172.21.15.135:0/2101059808 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f98464a7700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98400c6990 0x7f98401ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9846ca8700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9840153450 0x7f984015bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 -- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98400c6990 msgr2=0x7f98401ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98400c6990 0x7f98401ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 -- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9840153450 msgr2=0x7f984015bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9840153450 0x7f984015bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.128+0000 7f9845ca6700 1 -- 172.21.15.135:0/2101059808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009a70 con 0x7f98400cc770 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.129+0000 7f9845ca6700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f984015b6f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f983c0011e0 tx=0x7f983c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:50.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.129+0000 7f9836ffd700 1 -- 172.21.15.135:0/2101059808 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c004c80 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.129+0000 7f9836ffd700 1 -- 172.21.15.135:0/2101059808 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f983c004e00 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.129+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98401ef850 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.129+0000 7f9836ffd700 1 -- 172.21.15.135:0/2101059808 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c007330 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.129+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9840157af0 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.130+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984015a2e0 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.130+0000 7f9836ffd700 1 -- 172.21.15.135:0/2101059808 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f983c007490 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.130+0000 7f9836ffd700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f982406ac90 0x7f982406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.131+0000 7f9836ffd700 1 -- 172.21.15.135:0/2101059808 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f983c0892e0 con 0x7f98400cc770 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.131+0000 7f98464a7700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f982406ac90 0x7f982406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:50.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.131+0000 7f98464a7700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f982406ac90 0x7f982406d150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9830006b20 tx=0x7f9830008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:50.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.135+0000 7f9836ffd700 1 -- 172.21.15.135:0/2101059808 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f983c054140 con 0x7f98400cc770 2024-05-08T21:22:50.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.330+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9840067fa0 con 0x7f98400cc770 2024-05-08T21:22:50.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.976+0000 7f9836ffd700 1 -- 172.21.15.135:0/2101059808 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f983c056070 con 0x7f98400cc770 2024-05-08T21:22:50.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.980+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f982406ac90 msgr2=0x7f982406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:50.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.980+0000 7f984870b700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f982406ac90 0x7f982406d150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9830006b20 tx=0x7f9830008040 comp rx=0 tx=0).stop 2024-05-08T21:22:50.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.980+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 msgr2=0x7f984015b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:50.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.980+0000 7f984870b700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f984015b6f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f983c0011e0 tx=0x7f983c00ca30 comp rx=0 tx=0).stop 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 shutdown_connections 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f982406ac90 0x7f982406d150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9840153450 0x7f984015bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98400c6990 0x7f98401ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 --2- 172.21.15.135:0/2101059808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98400cc770 0x7f984015b6f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 >> 172.21.15.135:0/2101059808 conn(0x7f984006ec40 msgr2=0x7f984006fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 shutdown_connections 2024-05-08T21:22:50.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:50.981+0000 7f984870b700 1 -- 172.21.15.135:0/2101059808 wait complete. 2024-05-08T21:22:50.984 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' removed 2024-05-08T21:22:51.001 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-08T21:22:51.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.124+0000 7f768f13d700 1 Processor -- start 2024-05-08T21:22:51.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.124+0000 7f768f13d700 1 -- start start 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768f13d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76880cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768f13d700 1 -- --> v1:172.21.15.135:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768806d5a0 con 0x7f7688159bf0 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768f13d700 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768815ce30 con 0x7f76881538f0 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768f13d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880cadb0 con 0x7f768815a030 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f7687fff700 1 --1- >> v1:172.21.15.135:6789/0 conn(0x7f7688159bf0 0x7f76880cd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.135:6789/0 says I am v1:172.21.15.135:35702/0 (socket says 172.21.15.135:35702) 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f7687fff700 1 -- 172.21.15.135:0/150517737 learned_addr learned my addr 172.21.15.135:0/150517737 (peer_addr_for_me v1:172.21.15.135:0/0) 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768d6da700 1 --2- 172.21.15.135:0/150517737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76880cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f76877fe700 1 -- 172.21.15.135:0/150517737 <== mon.0 v1:172.21.15.135:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212835211 0 0) 0x7f768806d5a0 con 0x7f7688159bf0 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f76877fe700 1 -- 172.21.15.135:0/150517737 --> v1:172.21.15.135:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76780035b0 con 0x7f7688159bf0 2024-05-08T21:22:51.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f76877fe700 1 -- 172.21.15.135:0/150517737 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136824079 0 0) 0x7f768815ce30 con 0x7f76881538f0 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f76877fe700 1 -- 172.21.15.135:0/150517737 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f768806d5a0 con 0x7f76881538f0 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768d6da700 1 -- 172.21.15.135:0/150517737 >> v1:172.21.15.183:6789/0 conn(0x7f76881538f0 legacy=0x7f768806cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768d6da700 1 -- 172.21.15.135:0/150517737 >> v1:172.21.15.135:6789/0 conn(0x7f7688159bf0 legacy=0x7f76880cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768d6da700 1 -- 172.21.15.135:0/150517737 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768815d110 con 0x7f768815a030 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.125+0000 7f768d6da700 1 --2- 172.21.15.135:0/150517737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76880cd890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7680009dc0 tx=0x7f768000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16125d0e46eda9fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f76877fe700 1 -- 172.21.15.135:0/150517737 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000e070 con 0x7f768815a030 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f76877fe700 1 -- 172.21.15.135:0/150517737 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f768000bb20 con 0x7f768815a030 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f76877fe700 1 -- 172.21.15.135:0/150517737 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680012430 con 0x7f768815a030 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f768f13d700 1 -- 172.21.15.135:0/150517737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 msgr2=0x7f76880cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:51.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f768f13d700 1 --2- 172.21.15.135:0/150517737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76880cd890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7680009dc0 tx=0x7f768000b330 comp rx=0 tx=0).stop 2024-05-08T21:22:51.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f768f13d700 1 -- 172.21.15.135:0/150517737 shutdown_connections 2024-05-08T21:22:51.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f768f13d700 1 --2- 172.21.15.135:0/150517737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76880cd890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:51.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f768f13d700 1 -- 172.21.15.135:0/150517737 >> 172.21.15.135:0/150517737 conn(0x7f768806c1b0 msgr2=0x7f7688072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:51.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f768f13d700 1 -- 172.21.15.135:0/150517737 shutdown_connections 2024-05-08T21:22:51.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.126+0000 7f768f13d700 1 -- 172.21.15.135:0/150517737 wait complete. 2024-05-08T21:22:51.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.127+0000 7f768f13d700 1 Processor -- start 2024-05-08T21:22:51.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.127+0000 7f768f13d700 1 -- start start 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768f13d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881538f0 0x7f76880c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768f13d700 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688159bf0 0x7f7688147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768f13d700 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76881497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768f13d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76881597d0 con 0x7f76881538f0 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768f13d700 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76881efba0 con 0x7f7688159bf0 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768f13d700 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76881eecd0 con 0x7f768815a030 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768ced9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881538f0 0x7f76880c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768ced9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881538f0 0x7f76880c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49496/0 (socket says 172.21.15.135:49496) 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768ced9700 1 -- 172.21.15.135:0/3020107093 learned_addr learned my addr 172.21.15.135:0/3020107093 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f7687fff700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688159bf0 0x7f7688147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.128+0000 7f768d6da700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76881497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768ced9700 1 -- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 msgr2=0x7f76881497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:51.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768ced9700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76881497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768ced9700 1 -- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688159bf0 msgr2=0x7f7688147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768ced9700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688159bf0 0x7f7688147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768ced9700 1 -- 172.21.15.135:0/3020107093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680009a70 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768ced9700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881538f0 0x7f76880c28d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c520 tx=0x7f767c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f76857fa700 1 -- 172.21.15.135:0/3020107093 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0052d0 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f76857fa700 1 -- 172.21.15.135:0/3020107093 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f767c005430 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f76857fa700 1 -- 172.21.15.135:0/3020107093 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0038e0 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76881eef90 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.129+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76881ef550 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.130+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7688067fa0 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.131+0000 7f76857fa700 1 -- 172.21.15.135:0/3020107093 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f767c003a40 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.131+0000 7f76857fa700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f766c06ac90 0x7f766c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.131+0000 7f76857fa700 1 -- 172.21.15.135:0/3020107093 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f767c088860 con 0x7f76881538f0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.131+0000 7f7687fff700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f766c06ac90 0x7f766c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:22:51.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.131+0000 7f7687fff700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f766c06ac90 0x7f766c06d150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768815cd10 tx=0x7f7674007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:22:51.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.135+0000 7f76857fa700 1 -- 172.21.15.135:0/3020107093 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f767c053960 con 0x7f76881538f0 2024-05-08T21:22:51.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.330+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f768806d760 con 0x7f76881538f0 2024-05-08T21:22:51.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.978+0000 7f76857fa700 1 -- 172.21.15.135:0/3020107093 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f767c056f80 con 0x7f76881538f0 2024-05-08T21:22:51.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f766c06ac90 msgr2=0x7f766c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:51.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f766c06ac90 0x7f766c06d150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768815cd10 tx=0x7f7674007dc0 comp rx=0 tx=0).stop 2024-05-08T21:22:51.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881538f0 msgr2=0x7f76880c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:22:51.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881538f0 0x7f76880c28d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c520 tx=0x7f767c00c830 comp rx=0 tx=0).stop 2024-05-08T21:22:51.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 shutdown_connections 2024-05-08T21:22:51.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:6832/46829,v1:172.21.15.135:6833/46829] conn(0x7f766c06ac90 0x7f766c06d150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:51.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768815a030 0x7f76881497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:51.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f76881538f0 0x7f76880c28d0 secure :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c520 tx=0x7f767c00c830 comp rx=0 tx=0).stop 2024-05-08T21:22:51.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 --2- 172.21.15.135:0/3020107093 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688159bf0 0x7f7688147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:22:51.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.982+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 >> 172.21.15.135:0/3020107093 conn(0x7f768806c1b0 msgr2=0x7f7688157970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:22:51.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.983+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 shutdown_connections 2024-05-08T21:22:51.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-05-08T21:22:51.983+0000 7f768f13d700 1 -- 172.21.15.135:0/3020107093 wait complete. 2024-05-08T21:22:52.019 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data_ec' removed 2024-05-08T21:22:52.046 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T21:22:52.047 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T21:22:52.047 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.067 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T21:22:52.067 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T21:22:52.067 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.136 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T21:22:52.136 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-08T21:22:52.136 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.195 INFO:tasks.ceph.mds.e:Stopped 2024-05-08T21:22:52.196 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T21:22:52.196 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.207 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T21:22:52.207 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T21:22:52.207 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.276 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T21:22:52.276 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-08T21:22:52.276 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.326 INFO:tasks.ceph.mds.f:Stopped 2024-05-08T21:22:52.326 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T21:22:52.326 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T21:22:52.326 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.370 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T21:22:52.370 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T21:22:52.370 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.444 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T21:22:52.444 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T21:22:52.444 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.494 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T21:22:52.495 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T21:22:52.495 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-08T21:22:52.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-08T21:22:52.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-05-08T21:22:52.557 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T21:22:52.557 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T21:22:52.558 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.628 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T21:22:52.628 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T21:22:52.629 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.690 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T21:22:52.691 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T21:22:52.691 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.759 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T21:22:52.759 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T21:22:52.759 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.828 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T21:22:52.828 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T21:22:52.828 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T21:22:52.829 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.853 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T21:22:52.853 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T21:22:52.853 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.876 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T21:22:52.876 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T21:22:52.876 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T21:22:52.876 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.905 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T21:22:52.905 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T21:22:52.905 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.926 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T21:22:52.926 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T21:22:52.926 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:22:52.978 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T21:22:52.979 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T21:22:52.979 DEBUG:teuthology.orchestra.run.smithi135:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-08T21:22:53.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T21:22:53.057 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T21:22:53.572 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T21:22:53.572 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T21:22:53.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T21:22:53.738 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T21:22:53.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T21:22:53.845 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T21:22:53.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T21:22:53.948 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T21:22:54.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T21:22:54.398 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T21:22:54.529 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T21:22:54.530 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T21:22:54.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T21:22:54.629 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T21:22:54.760 INFO:tasks.ceph:Archiving mon data... 2024-05-08T21:22:54.762 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/data/mon.a.tgz 2024-05-08T21:22:54.762 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-05-08T21:22:54.801 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.wguYoCFSKW 2024-05-08T21:22:54.801 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wguYoCFSKW 2024-05-08T21:22:54.993 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.wguYoCFSKW 2024-05-08T21:22:55.124 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.wguYoCFSKW is 292KB 2024-05-08T21:22:55.220 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.wguYoCFSKW 2024-05-08T21:22:55.237 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/data/mon.b.tgz 2024-05-08T21:22:55.237 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-05-08T21:22:55.254 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.IZk4l33Egz 2024-05-08T21:22:55.255 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.IZk4l33Egz 2024-05-08T21:22:55.391 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.IZk4l33Egz 2024-05-08T21:22:55.504 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.IZk4l33Egz is 297KB 2024-05-08T21:22:55.597 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.IZk4l33Egz 2024-05-08T21:22:55.614 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/data/mon.c.tgz 2024-05-08T21:22:55.614 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-05-08T21:22:55.670 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.N3ZsP2xffk 2024-05-08T21:22:55.670 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.N3ZsP2xffk 2024-05-08T21:22:55.792 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.N3ZsP2xffk 2024-05-08T21:22:55.878 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.N3ZsP2xffk is 297KB 2024-05-08T21:22:55.972 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.N3ZsP2xffk 2024-05-08T21:22:55.989 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T21:22:55.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:22:55.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:22:56.067 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-08T21:22:56.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:22:56.070 DEBUG:teuthology.orchestra.run.smithi183:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:22:56.099 INFO:teuthology.orchestra.run.smithi135.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:22:56.135 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:22:56.141 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T21:22:56.143 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/remote/smithi135/crash 2024-05-08T21:22:56.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:22:56.174 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/remote/smithi183/crash 2024-05-08T21:22:56.175 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:22:56.206 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T21:22:56.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:56.220 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:56.310 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:56.342 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:22:56.369 INFO:tasks.ceph:Compressing logs... 2024-05-08T21:22:56.369 DEBUG:teuthology.orchestra.run.smithi135:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:22:56.385 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:22:57.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-08T21:22:57.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-08T21:22:57.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-05-08T21:33:06.577 INFO:tasks.ceph:Archiving logs... 2024-05-08T21:33:06.612 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/remote/smithi135/log 2024-05-08T21:33:06.613 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:34:21.640 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/remote/smithi183/log 2024-05-08T21:34:21.641 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:35:49.003 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T21:35:49.013 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T21:35:49.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:35:49.017 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:35:49.101 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T21:35:49.111 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T21:35:49.112 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:35:49.114 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:35:49.130 INFO:teuthology.orchestra.run.smithi135.stderr:bash: ntpq: command not found 2024-05-08T21:35:49.133 INFO:teuthology.orchestra.run.smithi183.stderr:bash: ntpq: command not found 2024-05-08T21:35:49.141 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:35:49.141 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-05-08T21:35:49.141 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +1798us[+1811us] +/- 69ms 2024-05-08T21:35:49.141 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -1574us[-1562us] +/- 75ms 2024-05-08T21:35:49.141 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -447us[ -434us] +/- 94ms 2024-05-08T21:35:49.141 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:35:49.168 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T21:35:49.168 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-05-08T21:35:49.168 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 28 +1814us[+1782us] +/- 69ms 2024-05-08T21:35:49.168 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -1552us[-1552us] +/- 75ms 2024-05-08T21:35:49.168 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -443us[ -443us] +/- 94ms 2024-05-08T21:35:49.168 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T21:35:49.168 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T21:35:49.182 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T21:35:49.183 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T21:35:49.195 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T21:35:49.327 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T21:35:49.419 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:35:49.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:49.451 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T21:35:49.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:49.483 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T21:35:49.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T21:35:49.529 INFO:teuthology.task.internal:Duration was 3299.973735 seconds 2024-05-08T21:35:49.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T21:35:49.539 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T21:35:49.540 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:35:49.542 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:35:49.604 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:35:49.623 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T21:35:49.787 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T21:35:49.787 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-05-08T21:35:49.787 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:35:49.818 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-05-08T21:35:49.818 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:35:49.845 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T21:35:49.845 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:35:49.860 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:35:49.932 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T21:35:49.933 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:35:49.935 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:35:50.022 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T21:35:50.033 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T21:35:50.033 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:35:50.135 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:35:50.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T21:35:50.188 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:35:50.191 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:35:50.232 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-05-08T21:35:50.250 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-05-08T21:35:50.272 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:35:50.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:50.303 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:35:50.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:35:50.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T21:35:50.338 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T21:35:50.342 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/remote/smithi135 2024-05-08T21:35:50.342 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:35:50.383 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698020/remote/smithi183 2024-05-08T21:35:50.383 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:35:50.423 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T21:35:50.423 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:35:50.426 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:35:50.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T21:35:50.485 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T21:35:50.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T21:35:50.495 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T21:35:50.495 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:35:50.498 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:35:50.511 INFO:teuthology.orchestra.run.smithi135.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:35 /home/ubuntu/cephtest 2024-05-08T21:35:50.529 INFO:teuthology.orchestra.run.smithi183.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:35 /home/ubuntu/cephtest 2024-05-08T21:35:50.531 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T21:35:50.541 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T21:35:50.566 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/lockdep} duration: 3299.973734855652 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T21:35:50.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T21:35:50.639 INFO:teuthology.run:pass